Aug 05 16:19:33.223246 ip-10-0-133-70 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 05 16:19:33.223255 ip-10-0-133-70 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 05 16:19:33.223263 ip-10-0-133-70 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 05 16:19:33.223558 ip-10-0-133-70 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 05 16:19:43.407434 ip-10-0-133-70 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 05 16:19:43.407449 ip-10-0-133-70 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f01ee2e01ed04687a2178fa41850af04 --
Aug 05 16:21:17.352313 ip-10-0-133-70 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 16:21:17.794450 ip-10-0-133-70 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:21:17.794450 ip-10-0-133-70 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 16:21:17.794450 ip-10-0-133-70 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:21:17.794450 ip-10-0-133-70 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 16:21:17.794450 ip-10-0-133-70 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:21:17.795444 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.795358    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 16:21:17.799137 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799122    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:17.799137 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799137    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799143    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799147    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799150    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799153    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799157    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799160    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799163    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799166    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799169    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799172    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799174    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799177    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799184    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799187    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799189    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799192    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799194    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799198    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799200    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:17.799203 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799203    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799207    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799210    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799213    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799215    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799218    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799221    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799223    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799226    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799229    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799231    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799234    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799237    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799240    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799244    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799247    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799250    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799253    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799255    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:17.799675 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799258    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799261    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799263    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799267    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799269    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799272    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799274    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799277    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799280    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799282    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799285    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799287    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799290    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799293    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799295    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799298    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799301    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799304    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799306    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799309    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:17.800147 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799312    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799314    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799317    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799320    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799323    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799325    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799328    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799332    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799335    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799338    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799341    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799344    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799347    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799349    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799352    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799355    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799357    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799359    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799362    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:17.800632 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799364    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799367    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799370    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799372    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799375    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799377    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799380    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799382    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799386    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799389    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799391    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799394    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799397    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799400    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799402    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799405    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799407    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799410    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799412    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.799415    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:17.801131 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800109    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800116    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800119    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800122    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800125    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800128    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800131    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800133    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800136    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800139    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800141    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800144    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800147    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800149    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800152    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800155    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800158    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800161    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800164    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800166    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:17.801625 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800169    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800172    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800175    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800178    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800180    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800183    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800185    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800188    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800190    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800193    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800196    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800198    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800201    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800204    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800206    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800209    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800211    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800214    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800217    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800220    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:17.802139 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800222    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800225    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800228    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800230    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800233    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800235    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800238    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800241    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800243    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800246    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800248    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800251    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800255    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800258    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800261    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800263    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800266    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800269    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800271    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800274    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:17.802617 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800276    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800279    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800282    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800284    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800287    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800289    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800292    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800294    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800297    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800299    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800302    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800305    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800307    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800310    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800313    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800315    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800318    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800322    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800325    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800328    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:17.803119 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800332    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800335    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800338    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800340    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800344    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800346    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800349    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800352    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800354    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800357    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800359    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800364    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800368    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800371    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800373    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800376    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800378    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800381    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:17.803626 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800385    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800740    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800745    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800749    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800752    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800755    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800758    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800760    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800763    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800765    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800768    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800771    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800773    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800776    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800779    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800781    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800784    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800788    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800791    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:17.804085 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800795    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800798    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800801    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800803    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800806    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800809    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800811    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800815    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800818    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800821    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800824    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800827    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800829    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800832    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800834    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800837    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800839    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800842    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800844    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:17.804558 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800847    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800850    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800853    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800855    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800858    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800860    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800863    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800866    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800868    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800871    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800873    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800876    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800879    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800881    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800884    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800886    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800889    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800891    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800894    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800896    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:17.805068 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800899    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800901    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800905    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800908    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800911    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800913    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800916    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800918    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800921    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800923    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800926    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800928    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800931    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800934    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800937    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800939    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800942    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800944    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800947    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800949    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:17.805555 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800954    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800957    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800959    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800962    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800964    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800967    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800969    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800972    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800975    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800978    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800981    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800983    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800986    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800988    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800991    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800993    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800995    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.800998    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801000    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801003    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:17.806083 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801019    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801024    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801087    2579 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801100    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801106    2579 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801111    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801117    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801121    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801125    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801129    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801132    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801136    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801140    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801144    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801147    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801150    2579 flags.go:64] FLAG: --cgroup-root=""
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801153    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801156    2579 flags.go:64] FLAG: --client-ca-file=""
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801159    2579 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801162    2579 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801171    2579 flags.go:64] FLAG: --cluster-domain=""
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801174    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801177    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801180    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 16:21:17.806568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801184    2579 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801188    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801191    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801194    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801197    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801200    2579 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801203    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801206    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801209    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801212    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801216    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801219    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801222    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801225    2579 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801229    2579 flags.go:64] FLAG: --enable-server="true"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801232    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801236    2579 flags.go:64] FLAG: --event-burst="100"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801240    2579 flags.go:64] FLAG: --event-qps="50"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801243    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801246    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801249    2579 flags.go:64] FLAG: --eviction-hard=""
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801253    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801256    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801259    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801262    2579 flags.go:64] FLAG: --eviction-soft=""
Aug 05 16:21:17.807159 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801265    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801268    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801271    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801274    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801277    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801280    2579 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801283    2579 flags.go:64] FLAG: --feature-gates=""
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801287    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801290    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801293    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801296    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801299    2579 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801302    2579 flags.go:64] FLAG: --help="false"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801305    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-133-70.ec2.internal"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801308    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801311    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801313    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801317    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801320    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801323    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801326    2579 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801330    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801333    2579 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 16:21:17.807771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801337    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801340    2579 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801343    2579 flags.go:64] FLAG: --kube-reserved=""
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801346    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801349    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801352    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801355    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801358    2579 flags.go:64] FLAG: --lock-file=""
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801361    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801364    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801367    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801372    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801376    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801378    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801381    2579 flags.go:64] FLAG: --logging-format="text"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801384    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801388    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801390    2579 flags.go:64] FLAG: --manifest-url=""
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801393    2579 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801398    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801400    2579 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801405    2579 flags.go:64] FLAG: --max-pods="110"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801408    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801411    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801414    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 16:21:17.808481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801417    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801420    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801423    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801426    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801432    2579 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801435    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801439    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801442    2579 flags.go:64] FLAG: --pod-cidr=""
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801445    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801451    2579 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801454    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801457    2579 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801460    2579 flags.go:64] FLAG: --port="10250"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801463    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801466    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04dab5d55eb4e3e23"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801469    2579 flags.go:64] FLAG: --qos-reserved=""
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801472    2579 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801474    2579 flags.go:64] FLAG: --register-node="true"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801478    2579 flags.go:64] FLAG: --register-with-taints=""
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801481    2579 flags.go:64] FLAG: --registry-burst="10"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801484    2579 flags.go:64] FLAG: --registry-qps="5"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801487    2579 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801489    2579 flags.go:64] FLAG: --reserved-memory=""
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801493    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801496    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 16:21:17.809106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801499    2579 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801501    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801504    2579 flags.go:64] FLAG: --runonce="false"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801507    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801510    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801513    2579 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801515    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801518    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801521    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801524    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801527    2579 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801530    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801533    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801536    2579 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801538    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801541    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801545    2579 flags.go:64] FLAG: --system-cgroups=""
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801550    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801555    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801559    2579 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801562    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801567    2579 flags.go:64] FLAG: --tls-min-version=""
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801569    2579 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801572    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801575    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 16:21:17.809742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801578    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801581    2579 flags.go:64] FLAG: --v="2"
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801585    2579 flags.go:64] FLAG: --version="false"
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801589    2579 flags.go:64] FLAG: --vmodule=""
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801593    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801596    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801706    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801710    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801713    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801716    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801719    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801721    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801724    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801726    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801729    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801731    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801734    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801736    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801739    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801743    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801745    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:17.810361 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801748    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801751    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801753    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801758    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801760    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801763    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801766    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801768    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801771    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801774    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801776    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801779    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801782    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801784    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801787    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801789    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801792    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801795    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801798    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801800    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:17.810871 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801803    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801806    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801808    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801811    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801815    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801819    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801823    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801827    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801831    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801834    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801838    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801841    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801844    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801847    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801850    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801854    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801857    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801860    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:17.811384 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801862    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801865    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801867    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801870    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801872    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801875    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801878    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801880    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801883    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801886    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801888    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801891    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801894    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801896    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801898    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801901    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801904    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801906    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801909    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801912    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:17.811828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801914    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801916    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801919    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801922    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801926    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801928    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801931    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801933    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801936    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801940    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801943    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801946    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801948    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801951    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801954    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801957    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801959    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801962    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801965    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801967    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:17.812389 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801970    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801972    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801975    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801978    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801980    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.801983    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.801988    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.809527    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.809542    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.810373    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.810381    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810437    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810443    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810447    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810450    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:17.813180 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810453    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810456    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810459    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810462    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810465    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810467    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810470    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810473    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810475    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810478    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810481    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810484    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810487    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810489    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810492    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810494    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810497    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810499    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810502    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810505    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:17.813561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810508    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810510    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810513    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810515    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810519    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810525    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810528    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810531    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810533    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810536    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810539    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810541    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810544    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810547    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810550    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810552    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810555    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810557    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810560    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:17.814061 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810562    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810565    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810568    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810570    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810574    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810578    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810582    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810584    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810587    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810590    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810593    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810596    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810598    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810601    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810604    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810606    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810609    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810612    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810616    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:17.814510 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810621    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810624    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810627    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810630    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810632    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810635    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810638    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810640    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810643    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810645    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810648    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810650    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810653    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810656    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810658    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810661    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810664    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810666    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810669    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810671    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:17.814972 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810674    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810677    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810679    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810682    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810684    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810687    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810689    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810692    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810694    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810697    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810699    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810702    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810705    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810708    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810711    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810714    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:17.815491 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810716    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.810721    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810836    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810840    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810843    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810846    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810849    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810852    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810855    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810857    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810860    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810863    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810865    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810868    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:17.815905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810870    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810873    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810876    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810878    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810881    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810884    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810886    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810889    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810891    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810894    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810897    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810899    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810902    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810904    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810907    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810910    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810913    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810916    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810919    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810922    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:17.816322 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810924    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810927    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810929    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810932    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810934    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810937    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810939    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810942    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810945    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810947    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810950    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810952    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810955    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810957    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810960    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810963    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810965    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810968    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810970    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810973    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:17.816827 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810975    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810978    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810981    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810983    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810986    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810988    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810991    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810994    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810996    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.810999    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811001    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811004    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811021    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811025    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811027    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811031    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811035    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811038    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811041    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811043    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:17.817428 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811046    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811049    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811053    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811056    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811059    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811062    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811065    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811067    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811070    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811072    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811074    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811077    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811079    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811082    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811084    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811087    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811089    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811092    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811094    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811097    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:17.817906 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811099    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:17.818400 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811102    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:17.818400 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811105    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:17.818400 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811108    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:17.818400 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811110    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:17.818400 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811113    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:17.818400 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:17.811115    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:17.818400 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.811120    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:21:17.818400 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.811225    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 16:21:17.818605 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.818426    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 16:21:17.820428 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.820415    2579 server.go:1019] "Starting client certificate rotation"
Aug 05 16:21:17.820543 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.820525    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:21:17.820604 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.820576    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:21:17.823058 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.823042    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:21:17.826137 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.826119    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:21:17.837653 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.837635    2579 log.go:25] "Validated CRI v1 runtime API"
Aug 05 16:21:17.840439 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.840426    2579 log.go:25] "Validated CRI v1 image API"
Aug 05 16:21:17.841222 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.841205    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 16:21:17.845988 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.845969    2579 fs.go:135] Filesystem UUIDs: map[0f48b989-12ac-46fb-908c-992626d4e72f:/dev/nvme0n1p3 69c72cc0-72e4-4abe-a8b3-19aafe947744:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Aug 05 16:21:17.846072 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.845986    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 16:21:17.851876 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.851857    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:21:17.853539 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.853423    2579 manager.go:216] Machine: {Timestamp:2026-08-05 16:21:17.852117802 +0000 UTC m=+0.371250432 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098966 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de7034b5c74651eac9f59a524ee97 SystemUUID:ec2de703-4b5c-7465-1eac-9f59a524ee97 BootID:f01ee2e0-1ed0-4687-a217-8fa41850af04 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:90:a4:a5:fb:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:90:a4:a5:fb:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:33:86:c1:c2:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 16:21:17.853539 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.853538    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 16:21:17.853636 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.853622    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 16:21:17.856884 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.856843    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 16:21:17.857046 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.856893    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 16:21:17.857722 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.857713    2579 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 16:21:17.857751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.857725    2579 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 16:21:17.857751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.857733    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:21:17.857751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.857749    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:21:17.858832 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.858823    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 16:21:17.862820 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.862809    2579 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:21:17.862948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.862939    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 16:21:17.863000 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.862992    2579 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 16:21:17.863039 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.863022    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 16:21:17.863039 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.863035    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 16:21:17.863099 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.863055    2579 kubelet.go:398] "Adding apiserver pod source"
Aug 05 16:21:17.863099 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.863068    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 16:21:17.863447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.863431    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:21:17.863447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.863449    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:21:17.867750 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.867729    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 16:21:17.869711 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.869697    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 16:21:17.869761 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.869728    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 16:21:17.871151 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871135    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 16:21:17.871151 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871153    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871159    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871165    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871174    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871179    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871188    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871196    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871206    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871212    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871220    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 16:21:17.871269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.871225    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 16:21:17.872128 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.872118    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 16:21:17.872128 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.872128    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 16:21:17.875402 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.875386    2579 server.go:1268] "Started kubelet"
Aug 05 16:21:17.875512 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.875425    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 16:21:17.875512 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.875461    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 16:21:17.875512 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.875504    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 16:21:17.876240 ip-10-0-133-70 systemd[1]: Started Kubernetes Kubelet.
Aug 05 16:21:17.877314 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.876898    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 16:21:17.877512 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.877497    2579 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 16:21:17.878980 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.878279    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 16:21:17.878980 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.878316    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 16:21:17.878980 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.878879    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 16:21:17.882812 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.882790    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 16:21:17.883653 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.882520    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-70.ec2.internal.18c8f5391b77a36b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-70.ec2.internal,UID:ip-10-0-133-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-70.ec2.internal,},FirstTimestamp:2026-08-05 16:21:17.875168107 +0000 UTC m=+0.394300732,LastTimestamp:2026-08-05 16:21:17.875168107 +0000 UTC m=+0.394300732,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-70.ec2.internal,}"
Aug 05 16:21:17.887213 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.887198    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 16:21:17.887295 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.887214    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 16:21:17.887344 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.887291    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:17.887960 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.887930    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 16:21:17.887960 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.887921    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 16:21:17.887960 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.887950    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 16:21:17.888175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888070    2579 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 16:21:17.888175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888079    2579 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 16:21:17.888175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888078    2579 factory.go:55] Registering systemd factory
Aug 05 16:21:17.888175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888109    2579 factory.go:223] Registration of the systemd container factory successfully
Aug 05 16:21:17.888418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888401    2579 factory.go:153] Registering CRI-O factory
Aug 05 16:21:17.888418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888419    2579 factory.go:223] Registration of the crio container factory successfully
Aug 05 16:21:17.888533 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888468    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 16:21:17.888533 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888492    2579 factory.go:103] Registering Raw factory
Aug 05 16:21:17.888533 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888505    2579 manager.go:1196] Started watching for new ooms in manager
Aug 05 16:21:17.888929 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.888913    2579 manager.go:349] Starting recovery of all containers
Aug 05 16:21:17.889034 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.888933    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 16:21:17.889034 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.888943    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 16:21:17.899555 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.899458    2579 manager.go:354] Recovery completed
Aug 05 16:21:17.904896 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.904878    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:17.907813 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.907795    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:17.907883 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.907828    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:17.907883 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.907842    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:17.908418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.908403    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 16:21:17.908418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.908412    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:17.908418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.908417    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 16:21:17.908588 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.908433    2579 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:21:17.909618 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.909606    2579 policy_none.go:49] "None policy: Start"
Aug 05 16:21:17.909658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.909621    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 16:21:17.909658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.909631    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 16:21:17.910460 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.910444    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:17.910545 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.910474    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:17.910545 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.910488    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:17.910545 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.910511    2579 policy_none.go:47] "Start"
Aug 05 16:21:17.919233 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.919162    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-70.ec2.internal.18c8f5391d69c22a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-70.ec2.internal,UID:ip-10-0-133-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-70.ec2.internal,},FirstTimestamp:2026-08-05 16:21:17.907812906 +0000 UTC m=+0.426945531,LastTimestamp:2026-08-05 16:21:17.907812906 +0000 UTC m=+0.426945531,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-70.ec2.internal,}"
Aug 05 16:21:17.923777 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.923710    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-70.ec2.internal.18c8f5391d6a17ce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-70.ec2.internal,UID:ip-10-0-133-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-70.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-70.ec2.internal,},FirstTimestamp:2026-08-05 16:21:17.90783483 +0000 UTC m=+0.426967462,LastTimestamp:2026-08-05 16:21:17.90783483 +0000 UTC m=+0.426967462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-70.ec2.internal,}"
Aug 05 16:21:17.926113 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.926095    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w448d"
Aug 05 16:21:17.931169 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.931106    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-70.ec2.internal.18c8f5391d6a43e2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-70.ec2.internal,UID:ip-10-0-133-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-70.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-70.ec2.internal,},FirstTimestamp:2026-08-05 16:21:17.907846114 +0000 UTC m=+0.426978739,LastTimestamp:2026-08-05 16:21:17.907846114 +0000 UTC m=+0.426978739,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-70.ec2.internal,}"
Aug 05 16:21:17.935259 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.935076    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-70.ec2.internal.18c8f5391d69c22a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-70.ec2.internal.18c8f5391d69c22a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-70.ec2.internal,UID:ip-10-0-133-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-70.ec2.internal,},FirstTimestamp:2026-08-05 16:21:17.907812906 +0000 UTC m=+0.426945531,LastTimestamp:2026-08-05 16:21:17.910458659 +0000 UTC m=+0.429591287,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-70.ec2.internal,}"
Aug 05 16:21:17.935851 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.935831    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w448d"
Aug 05 16:21:17.937691 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.937675    2579 manager.go:337] "Starting Device Plugin manager"
Aug 05 16:21:17.937766 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.937725    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 16:21:17.937766 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.937738    2579 server.go:87] "Starting device plugin registration server"
Aug 05 16:21:17.937994 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.937980    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 16:21:17.938241 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.937999    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 16:21:17.938241 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.938122    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 16:21:17.938241 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.938187    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 16:21:17.938241 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.938197    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 16:21:17.938977 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.938737    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 16:21:17.938977 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.938791    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:17.941417 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.941336    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-70.ec2.internal.18c8f5391d6a17ce\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-70.ec2.internal.18c8f5391d6a17ce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-70.ec2.internal,UID:ip-10-0-133-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-70.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-70.ec2.internal,},FirstTimestamp:2026-08-05 16:21:17.90783483 +0000 UTC m=+0.426967462,LastTimestamp:2026-08-05 16:21:17.910480686 +0000 UTC m=+0.429613312,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-70.ec2.internal,}"
Aug 05 16:21:17.997362 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.997325    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 16:21:17.998444 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.998427    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 16:21:17.998505 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.998464    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 16:21:17.998505 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:17.998485    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 16:21:17.998594 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:17.998517    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 16:21:18.000894 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.000875    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:18.038718 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.038691    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:18.039707 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.039687    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:18.039803 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.039724    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:18.039803 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.039738    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:18.039803 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.039762    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.046300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.046257    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.046300 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:18.046276    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-70.ec2.internal\": node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:18.073051 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:18.073033    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:18.099023 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.098988    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal"]
Aug 05 16:21:18.099127 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.099065    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:18.099914 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.099897    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:18.099993 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.099925    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:18.099993 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.099953    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:18.101058 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101046    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:18.101199 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.101234 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101212    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:18.101754 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101733    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:18.101827 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101764    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:18.101827 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101775    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:18.101827 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101739    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:18.101927 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101837    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:18.101927 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.101852    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:18.104403 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.104385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.104476 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.104411    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:18.105059 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.105044    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:18.105133 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.105068    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:18.105133 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.105079    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:18.125727 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:18.125709    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-70.ec2.internal\" not found" node="ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.130023 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:18.129996    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-70.ec2.internal\" not found" node="ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.173411 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:18.173387    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:18.190084 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.190065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c6330fe9fe3288c90c5bc334f4663811-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal\" (UID: \"c6330fe9fe3288c90c5bc334f4663811\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.190174 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.190091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6330fe9fe3288c90c5bc334f4663811-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal\" (UID: \"c6330fe9fe3288c90c5bc334f4663811\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.190174 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.190122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec80920c6181151ca83a615f0c6f4f91-config\") pod \"kube-apiserver-proxy-ip-10-0-133-70.ec2.internal\" (UID: \"ec80920c6181151ca83a615f0c6f4f91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.274202 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:18.274156    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:18.290495 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.290472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c6330fe9fe3288c90c5bc334f4663811-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal\" (UID: \"c6330fe9fe3288c90c5bc334f4663811\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.290564 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.290501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6330fe9fe3288c90c5bc334f4663811-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal\" (UID: \"c6330fe9fe3288c90c5bc334f4663811\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.290564 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.290526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec80920c6181151ca83a615f0c6f4f91-config\") pod \"kube-apiserver-proxy-ip-10-0-133-70.ec2.internal\" (UID: \"ec80920c6181151ca83a615f0c6f4f91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.290564 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.290559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6330fe9fe3288c90c5bc334f4663811-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal\" (UID: \"c6330fe9fe3288c90c5bc334f4663811\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.290658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.290566    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c6330fe9fe3288c90c5bc334f4663811-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal\" (UID: \"c6330fe9fe3288c90c5bc334f4663811\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.290658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.290600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec80920c6181151ca83a615f0c6f4f91-config\") pod \"kube-apiserver-proxy-ip-10-0-133-70.ec2.internal\" (UID: \"ec80920c6181151ca83a615f0c6f4f91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.374979 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:18.374911    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:18.428433 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.428405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.432997 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:18.432602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:18.475203 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:18.475170    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:19.759046 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:19.759012    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:19.859628 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:19.859555    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:19.960132 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:19.960101    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-70.ec2.internal\" not found"
Aug 05 16:21:19.978268 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:19.978240    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:20.001337 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.001315    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:20.002331 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.002318    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 16:21:20.002454 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.002438    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 16:21:20.002501 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.002484    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 16:21:20.046617 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.046585    2579 apiserver.go:52] "Watching apiserver"
Aug 05 16:21:20.065787 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.065757    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:20.068028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.068004    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 16:21:20.068302 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.068284    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ngdgn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp","openshift-dns/node-resolver-l7pkr","openshift-multus/multus-additional-cni-plugins-sj6vh","openshift-multus/network-metrics-daemon-vztjl","openshift-network-operator/iptables-alerter-dt52w","openshift-ovn-kubernetes/ovnkube-node-pbkr7","openshift-cluster-node-tuning-operator/tuned-kk2nq","openshift-image-registry/node-ca-gbfjb","openshift-multus/multus-7ghpf","openshift-network-diagnostics/network-check-target-k69ps","kube-system/global-pull-secret-syncer-gzhh7"]
Aug 05 16:21:20.070043 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.070027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:20.070781 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.070763    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:20.070859 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.070787    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 16:21:20.071281 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.071260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.072296 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.072282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.072745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.072724    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 16:21:20.072871 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.072857    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 16:21:20.072979 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.072963    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j6hpc\""
Aug 05 16:21:20.073583 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.073567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.074044 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.074023    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 16:21:20.074136 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.074082    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-txbvl\""
Aug 05 16:21:20.074262 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.074249    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 16:21:20.074321 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.074285    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 16:21:20.074639 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.074625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:20.074703 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.074685    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:20.075767 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.075747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.076427 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076411    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 16:21:20.076427 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076424    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jf7qf\""
Aug 05 16:21:20.076634 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9gpm\" (UniqueName: \"kubernetes.io/projected/d403013a-53dd-4441-9871-6bbde2e785ca-kube-api-access-p9gpm\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.076634 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076631    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 16:21:20.076745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.076745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.076745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvz4g\" (UniqueName: \"kubernetes.io/projected/c329924c-ec37-43dc-8e22-088c197381ea-kube-api-access-gvz4g\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.076745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c329924c-ec37-43dc-8e22-088c197381ea-hosts-file\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.076745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c329924c-ec37-43dc-8e22-088c197381ea-tmp-dir\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.076745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2808e440-611f-4111-b468-a34f18b5f32f-agent-certs\") pod \"konnectivity-agent-ngdgn\" (UID: \"2808e440-611f-4111-b468-a34f18b5f32f\") " pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2808e440-611f-4111-b468-a34f18b5f32f-konnectivity-ca\") pod \"konnectivity-agent-ngdgn\" (UID: \"2808e440-611f-4111-b468-a34f18b5f32f\") " pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-socket-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-device-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076825    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-registration-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076887    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-sys-fs\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076925    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 16:21:20.077028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.076965    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 16:21:20.077403 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.077169    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2glc4\""
Aug 05 16:21:20.077403 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.077361    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.077943 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.077931    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 16:21:20.078379 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.078366    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.079525 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.079513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.080725 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.080712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.081693 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.081675    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 16:21:20.081751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.081683    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 16:21:20.081751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.081723    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 16:21:20.081751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.081728    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 16:21:20.081866 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.081701    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 16:21:20.081866 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.081702    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:21:20.082023 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.082009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:20.082110 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.082085    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:20.083310 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.083292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 16:21:20.083469 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.083453    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 16:21:20.083545 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.083530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.083599 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.083585    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:20.083637 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.083532    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6r27v\""
Aug 05 16:21:20.084429 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.084409    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 16:21:20.085010 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.084992    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 16:21:20.085106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.085068    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p64ww\""
Aug 05 16:21:20.085162 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.085113    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:21:20.085226 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.085206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ccjk8\""
Aug 05 16:21:20.085274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.085245    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kzc92\""
Aug 05 16:21:20.085501 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.085482    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 16:21:20.085695 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.085675    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 16:21:20.086326 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.086310    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 16:21:20.087121 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.087102    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bcvpm\""
Aug 05 16:21:20.087792 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.087759    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 16:21:20.091962 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.091945    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:21:20.092055 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.092023    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal"
Aug 05 16:21:20.092113 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.092058    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:21:20.092604 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.092587    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal"]
Aug 05 16:21:20.103086 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.103062    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:21:20.103191 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.103107    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal"]
Aug 05 16:21:20.123712 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.123662    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pkzpp"
Aug 05 16:21:20.125725 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.125675    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 16:16:19 +0000 UTC" deadline="2028-04-07 14:49:29.490627681 +0000 UTC"
Aug 05 16:21:20.125795 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.125728    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14662h28m9.364903863s"
Aug 05 16:21:20.138454 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.138433    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pkzpp"
Aug 05 16:21:20.173029 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.173007    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 16:21:20.177873 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.177854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-conf-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.177979 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.177886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-multus-certs\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.177979 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.177952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztdhk\" (UniqueName: \"kubernetes.io/projected/eae6af2d-10b8-4bd5-ad0e-fba85717528b-kube-api-access-ztdhk\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.178065 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.177995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-log-socket\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.178065 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.178065 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-cni-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.178185 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-kubelet\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.178185 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0363dba-026b-4911-9700-4046397b9860-iptables-alerter-script\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.178185 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-kubernetes\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.178185 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2621541a-3317-43cc-9a31-067039a63449-etc-tuned\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.178185 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-daemon-config\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.178436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0363dba-026b-4911-9700-4046397b9860-host-slash\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.178436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovn-node-metrics-cert\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.178436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sv7g\" (UniqueName: \"kubernetes.io/projected/2621541a-3317-43cc-9a31-067039a63449-kube-api-access-6sv7g\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.178436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-host\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.178436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-serviceca\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.178436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-device-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.178436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.178436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-lib-modules\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpqlk\" (UniqueName: \"kubernetes.io/projected/073ce27a-9484-4be3-9687-18881f4ace00-kube-api-access-lpqlk\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178478    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-device-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-cni-multus\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-etc-kubernetes\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-modprobe-d\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysconfig\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdccw\" (UniqueName: \"kubernetes.io/projected/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-kube-api-access-zdccw\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-run-netns\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-var-lib-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-cni-bin\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-systemd\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.178737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-host\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2808e440-611f-4111-b468-a34f18b5f32f-agent-certs\") pod \"konnectivity-agent-ngdgn\" (UID: \"2808e440-611f-4111-b468-a34f18b5f32f\") " pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-socket-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-os-release\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-socket-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-system-cni-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.178981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-socket-dir-parent\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-systemd\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-etc-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-registration-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-sys-fs\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gpm\" (UniqueName: \"kubernetes.io/projected/d403013a-53dd-4441-9871-6bbde2e785ca-kube-api-access-p9gpm\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179153    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-registration-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179170    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.179276 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-sys-fs\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovnkube-config\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-var-lib-kubelet\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvz4g\" (UniqueName: \"kubernetes.io/projected/c329924c-ec37-43dc-8e22-088c197381ea-kube-api-access-gvz4g\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-system-cni-dir\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f760ce6-beba-4e85-88b4-cd8b33410e66-dbus\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-cni-netd\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovnkube-script-lib\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c329924c-ec37-43dc-8e22-088c197381ea-tmp-dir\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-os-release\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-systemd-units\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-env-overrides\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysctl-conf\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-run\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-netns\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.180132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx9j6\" (UniqueName: \"kubernetes.io/projected/c0363dba-026b-4911-9700-4046397b9860-kube-api-access-tx9j6\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysctl-d\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c329924c-ec37-43dc-8e22-088c197381ea-tmp-dir\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cnibin\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180024    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae6af2d-10b8-4bd5-ad0e-fba85717528b-cni-binary-copy\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.179991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d403013a-53dd-4441-9871-6bbde2e785ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-k8s-cni-cncf-io\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-kubelet\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg6qm\" (UniqueName: \"kubernetes.io/projected/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-kube-api-access-wg6qm\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-hostroot\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-ovn\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.180850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-node-log\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nckp\" (UniqueName: \"kubernetes.io/projected/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-kube-api-access-6nckp\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-sys\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2621541a-3317-43cc-9a31-067039a63449-tmp\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c329924c-ec37-43dc-8e22-088c197381ea-hosts-file\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2808e440-611f-4111-b468-a34f18b5f32f-konnectivity-ca\") pod \"konnectivity-agent-ngdgn\" (UID: \"2808e440-611f-4111-b468-a34f18b5f32f\") " pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c329924c-ec37-43dc-8e22-088c197381ea-hosts-file\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f760ce6-beba-4e85-88b4-cd8b33410e66-kubelet-config\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-slash\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-cnibin\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.180740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-cni-bin\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.181627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.181032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2808e440-611f-4111-b468-a34f18b5f32f-konnectivity-ca\") pod \"konnectivity-agent-ngdgn\" (UID: \"2808e440-611f-4111-b468-a34f18b5f32f\") " pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:20.182919 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.182903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2808e440-611f-4111-b468-a34f18b5f32f-agent-certs\") pod \"konnectivity-agent-ngdgn\" (UID: \"2808e440-611f-4111-b468-a34f18b5f32f\") " pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:20.190199 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.190165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvz4g\" (UniqueName: \"kubernetes.io/projected/c329924c-ec37-43dc-8e22-088c197381ea-kube-api-access-gvz4g\") pod \"node-resolver-l7pkr\" (UID: \"c329924c-ec37-43dc-8e22-088c197381ea\") " pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.190468 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.190450    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9gpm\" (UniqueName: \"kubernetes.io/projected/d403013a-53dd-4441-9871-6bbde2e785ca-kube-api-access-p9gpm\") pod \"aws-ebs-csi-driver-node-pgllp\" (UID: \"d403013a-53dd-4441-9871-6bbde2e785ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.243312 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.243271    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec80920c6181151ca83a615f0c6f4f91.slice/crio-45a33d6041b233e5204503a63a9593c2462256936aa304db4fa4f951839a3d7f WatchSource:0}: Error finding container 45a33d6041b233e5204503a63a9593c2462256936aa304db4fa4f951839a3d7f: Status 404 returned error can't find the container with id 45a33d6041b233e5204503a63a9593c2462256936aa304db4fa4f951839a3d7f
Aug 05 16:21:20.243879 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.243859    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6330fe9fe3288c90c5bc334f4663811.slice/crio-1f7c4e094f6252b8d617d2fd9b332f8770de5c3bc5464b3828df497b3f7fdb17 WatchSource:0}: Error finding container 1f7c4e094f6252b8d617d2fd9b332f8770de5c3bc5464b3828df497b3f7fdb17: Status 404 returned error can't find the container with id 1f7c4e094f6252b8d617d2fd9b332f8770de5c3bc5464b3828df497b3f7fdb17
Aug 05 16:21:20.250424 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.249983    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:21:20.281734 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:20.281734 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cnibin\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae6af2d-10b8-4bd5-ad0e-fba85717528b-cni-binary-copy\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-k8s-cni-cncf-io\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-kubelet\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cnibin\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg6qm\" (UniqueName: \"kubernetes.io/projected/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-kube-api-access-wg6qm\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-hostroot\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281867    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-k8s-cni-cncf-io\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.281894    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-ovn\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.281941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-hostroot\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-ovn\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.281973    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs podName:073ce27a-9484-4be3-9687-18881f4ace00 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:20.781951573 +0000 UTC m=+2.117749510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs") pod "network-metrics-daemon-vztjl" (UID: "073ce27a-9484-4be3-9687-18881f4ace00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-node-log\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nckp\" (UniqueName: \"kubernetes.io/projected/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-kube-api-access-6nckp\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-sys\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-node-log\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2621541a-3317-43cc-9a31-067039a63449-tmp\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-sys\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.281891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-kubelet\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f760ce6-beba-4e85-88b4-cd8b33410e66-kubelet-config\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-slash\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-cnibin\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-cni-bin\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f760ce6-beba-4e85-88b4-cd8b33410e66-kubelet-config\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-conf-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.282473 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-cnibin\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-cni-bin\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-multus-certs\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-conf-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-slash\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282378    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae6af2d-10b8-4bd5-ad0e-fba85717528b-cni-binary-copy\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-multus-certs\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztdhk\" (UniqueName: \"kubernetes.io/projected/eae6af2d-10b8-4bd5-ad0e-fba85717528b-kube-api-access-ztdhk\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-log-socket\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-cni-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282535    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-log-socket\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-kubelet\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0363dba-026b-4911-9700-4046397b9860-iptables-alerter-script\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-kubernetes\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2621541a-3317-43cc-9a31-067039a63449-etc-tuned\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.283274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-kubelet\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-kubernetes\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-daemon-config\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0363dba-026b-4911-9700-4046397b9860-host-slash\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-cni-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovn-node-metrics-cert\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sv7g\" (UniqueName: \"kubernetes.io/projected/2621541a-3317-43cc-9a31-067039a63449-kube-api-access-6sv7g\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-host\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0363dba-026b-4911-9700-4046397b9860-host-slash\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-serviceca\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-lib-modules\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpqlk\" (UniqueName: \"kubernetes.io/projected/073ce27a-9484-4be3-9687-18881f4ace00-kube-api-access-lpqlk\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-cni-multus\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-etc-kubernetes\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.282960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-modprobe-d\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284120 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysconfig\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdccw\" (UniqueName: \"kubernetes.io/projected/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-kube-api-access-zdccw\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-run-netns\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-var-lib-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-lib-modules\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283150    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-cni-bin\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0363dba-026b-4911-9700-4046397b9860-iptables-alerter-script\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-daemon-config\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-systemd\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-host\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283249    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysconfig\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283260    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-systemd\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-os-release\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-host\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-etc-kubernetes\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.284973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-host\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-system-cni-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-socket-dir-parent\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-modprobe-d\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-var-lib-cni-multus\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-systemd\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-multus-socket-dir-parent\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-system-cni-dir\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-etc-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-var-lib-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-run-netns\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-os-release\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-cni-bin\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-systemd\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovnkube-config\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-run-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-etc-openvswitch\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.283688    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.283830    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret podName:1f760ce6-beba-4e85-88b4-cd8b33410e66 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:20.783813763 +0000 UTC m=+2.119611688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret") pod "global-pull-secret-syncer-gzhh7" (UID: "1f760ce6-beba-4e85-88b4-cd8b33410e66") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-serviceca\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-var-lib-kubelet\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-system-cni-dir\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f760ce6-beba-4e85-88b4-cd8b33410e66-dbus\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-system-cni-dir\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-cni-netd\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovnkube-script-lib\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-os-release\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-systemd-units\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-env-overrides\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysctl-conf\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-run\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.285948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-var-lib-kubelet\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-netns\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx9j6\" (UniqueName: \"kubernetes.io/projected/c0363dba-026b-4911-9700-4046397b9860-kube-api-access-tx9j6\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-systemd-units\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysctl-d\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovnkube-config\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-host-cni-netd\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-run\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284435    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysctl-conf\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-os-release\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.283949    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f760ce6-beba-4e85-88b4-cd8b33410e66-dbus\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284570    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2621541a-3317-43cc-9a31-067039a63449-etc-sysctl-d\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eae6af2d-10b8-4bd5-ad0e-fba85717528b-host-run-netns\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-env-overrides\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovnkube-script-lib\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.286432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2621541a-3317-43cc-9a31-067039a63449-tmp\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.286916 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.284976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2621541a-3317-43cc-9a31-067039a63449-etc-tuned\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.286916 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.285164    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-ovn-node-metrics-cert\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.291755 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.291740    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:20.291802 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.291757    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:20.291802 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.291767    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wvw5g for pod openshift-network-diagnostics/network-check-target-k69ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:20.291873 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.291805    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g podName:2523d3de-9ed7-40c4-80f0-d5c331abf9a1 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:20.791794327 +0000 UTC m=+2.127592248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wvw5g" (UniqueName: "kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g") pod "network-check-target-k69ps" (UID: "2523d3de-9ed7-40c4-80f0-d5c331abf9a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:20.293788 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.293768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg6qm\" (UniqueName: \"kubernetes.io/projected/d47eb5ed-6047-4a9e-a101-253ce3d8cc4c-kube-api-access-wg6qm\") pod \"multus-additional-cni-plugins-sj6vh\" (UID: \"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c\") " pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.294141 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.294119    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nckp\" (UniqueName: \"kubernetes.io/projected/92ab4d4b-a4a1-45dc-b762-e5a9fcf76197-kube-api-access-6nckp\") pod \"ovnkube-node-pbkr7\" (UID: \"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.295538 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.295514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sv7g\" (UniqueName: \"kubernetes.io/projected/2621541a-3317-43cc-9a31-067039a63449-kube-api-access-6sv7g\") pod \"tuned-kk2nq\" (UID: \"2621541a-3317-43cc-9a31-067039a63449\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.295886 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.295865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx9j6\" (UniqueName: \"kubernetes.io/projected/c0363dba-026b-4911-9700-4046397b9860-kube-api-access-tx9j6\") pod \"iptables-alerter-dt52w\" (UID: \"c0363dba-026b-4911-9700-4046397b9860\") " pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.295977 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.295963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdccw\" (UniqueName: \"kubernetes.io/projected/5bebfabf-dc9a-4acd-9ed6-0f6663195f74-kube-api-access-zdccw\") pod \"node-ca-gbfjb\" (UID: \"5bebfabf-dc9a-4acd-9ed6-0f6663195f74\") " pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.296638 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.296615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztdhk\" (UniqueName: \"kubernetes.io/projected/eae6af2d-10b8-4bd5-ad0e-fba85717528b-kube-api-access-ztdhk\") pod \"multus-7ghpf\" (UID: \"eae6af2d-10b8-4bd5-ad0e-fba85717528b\") " pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.296704 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.296667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpqlk\" (UniqueName: \"kubernetes.io/projected/073ce27a-9484-4be3-9687-18881f4ace00-kube-api-access-lpqlk\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:20.396620 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.396536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:20.404913 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.404886    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2808e440_611f_4111_b468_a34f18b5f32f.slice/crio-cd290206644dc7ed6b9335d66c541fd94b43e9b91fb983f0b3fc4fa209bfc5ed WatchSource:0}: Error finding container cd290206644dc7ed6b9335d66c541fd94b43e9b91fb983f0b3fc4fa209bfc5ed: Status 404 returned error can't find the container with id cd290206644dc7ed6b9335d66c541fd94b43e9b91fb983f0b3fc4fa209bfc5ed
Aug 05 16:21:20.430468 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.430443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp"
Aug 05 16:21:20.437661 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.437636    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd403013a_53dd_4441_9871_6bbde2e785ca.slice/crio-8a13c4fa37be496e82a4a02289c9e446596e02d9ac2e3d226debbc53a1820dd5 WatchSource:0}: Error finding container 8a13c4fa37be496e82a4a02289c9e446596e02d9ac2e3d226debbc53a1820dd5: Status 404 returned error can't find the container with id 8a13c4fa37be496e82a4a02289c9e446596e02d9ac2e3d226debbc53a1820dd5
Aug 05 16:21:20.448752 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.448732    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l7pkr"
Aug 05 16:21:20.455504 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.455488    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sj6vh"
Aug 05 16:21:20.456433 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.456410    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc329924c_ec37_43dc_8e22_088c197381ea.slice/crio-9ec0b0595bb129a532aec6c202cf83ebdfe8a0d4e7c42e479f401edc2669de2d WatchSource:0}: Error finding container 9ec0b0595bb129a532aec6c202cf83ebdfe8a0d4e7c42e479f401edc2669de2d: Status 404 returned error can't find the container with id 9ec0b0595bb129a532aec6c202cf83ebdfe8a0d4e7c42e479f401edc2669de2d
Aug 05 16:21:20.462567 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.462546    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47eb5ed_6047_4a9e_a101_253ce3d8cc4c.slice/crio-8200ac01027bfc56b973c9da065af10a4883f42e297aba529df5309a0ce59e00 WatchSource:0}: Error finding container 8200ac01027bfc56b973c9da065af10a4883f42e297aba529df5309a0ce59e00: Status 404 returned error can't find the container with id 8200ac01027bfc56b973c9da065af10a4883f42e297aba529df5309a0ce59e00
Aug 05 16:21:20.472522 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.472499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dt52w"
Aug 05 16:21:20.478768 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.478749    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:20.479599 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.479576    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0363dba_026b_4911_9700_4046397b9860.slice/crio-d9ef597537d21c710f6bd171e6143d2e02b634fd1455197cd9d1ff048e1257ef WatchSource:0}: Error finding container d9ef597537d21c710f6bd171e6143d2e02b634fd1455197cd9d1ff048e1257ef: Status 404 returned error can't find the container with id d9ef597537d21c710f6bd171e6143d2e02b634fd1455197cd9d1ff048e1257ef
Aug 05 16:21:20.485656 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.485633    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ab4d4b_a4a1_45dc_b762_e5a9fcf76197.slice/crio-cad05d80ef6a26733913d4f1a393a51f1b3ea164c60ec209fdb3e9c509ec201e WatchSource:0}: Error finding container cad05d80ef6a26733913d4f1a393a51f1b3ea164c60ec209fdb3e9c509ec201e: Status 404 returned error can't find the container with id cad05d80ef6a26733913d4f1a393a51f1b3ea164c60ec209fdb3e9c509ec201e
Aug 05 16:21:20.499187 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.499166    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk2nq"
Aug 05 16:21:20.505882 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.505857    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2621541a_3317_43cc_9a31_067039a63449.slice/crio-16578fb43948c3bb17d07221c924f9c25b4f46e20c1829621140a22377b2f20d WatchSource:0}: Error finding container 16578fb43948c3bb17d07221c924f9c25b4f46e20c1829621140a22377b2f20d: Status 404 returned error can't find the container with id 16578fb43948c3bb17d07221c924f9c25b4f46e20c1829621140a22377b2f20d
Aug 05 16:21:20.516117 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.516098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gbfjb"
Aug 05 16:21:20.520850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.520761    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7ghpf"
Aug 05 16:21:20.523015 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.522993    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bebfabf_dc9a_4acd_9ed6_0f6663195f74.slice/crio-251d7d11cc0ec89f05ec205119bc71d82e36455c0cdf930ec30fe5e1b353d244 WatchSource:0}: Error finding container 251d7d11cc0ec89f05ec205119bc71d82e36455c0cdf930ec30fe5e1b353d244: Status 404 returned error can't find the container with id 251d7d11cc0ec89f05ec205119bc71d82e36455c0cdf930ec30fe5e1b353d244
Aug 05 16:21:20.527708 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:20.527689    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae6af2d_10b8_4bd5_ad0e_fba85717528b.slice/crio-c354e811f79a48b077b8d73e8b91ce46aa86c06220575d63688da1bdc2dfc549 WatchSource:0}: Error finding container c354e811f79a48b077b8d73e8b91ce46aa86c06220575d63688da1bdc2dfc549: Status 404 returned error can't find the container with id c354e811f79a48b077b8d73e8b91ce46aa86c06220575d63688da1bdc2dfc549
Aug 05 16:21:20.788153 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.788080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:20.788298 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.788176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:20.788298 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.788260    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:20.788432 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.788314    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:20.788432 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.788327    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret podName:1f760ce6-beba-4e85-88b4-cd8b33410e66 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:21.788306365 +0000 UTC m=+3.124104290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret") pod "global-pull-secret-syncer-gzhh7" (UID: "1f760ce6-beba-4e85-88b4-cd8b33410e66") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:20.788432 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.788377    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs podName:073ce27a-9484-4be3-9687-18881f4ace00 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:21.788361451 +0000 UTC m=+3.124159387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs") pod "network-metrics-daemon-vztjl" (UID: "073ce27a-9484-4be3-9687-18881f4ace00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:20.889354 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.889269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:20.889523 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.889420    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:20.889523 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.889436    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:20.889523 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.889448    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wvw5g for pod openshift-network-diagnostics/network-check-target-k69ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:20.889523 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:20.889502    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g podName:2523d3de-9ed7-40c4-80f0-d5c331abf9a1 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:21.88948553 +0000 UTC m=+3.225283453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvw5g" (UniqueName: "kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g") pod "network-check-target-k69ps" (UID: "2523d3de-9ed7-40c4-80f0-d5c331abf9a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:20.908438 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:20.908290    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:21.141207 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.141044    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:16:20 +0000 UTC" deadline="2028-04-05 00:54:44.206610224 +0000 UTC"
Aug 05 16:21:21.141207 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.141082    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14600h33m23.065533917s"
Aug 05 16:21:21.184673 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.182526    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:21.184673 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.182659    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:21.198319 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.198229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp" event={"ID":"d403013a-53dd-4441-9871-6bbde2e785ca","Type":"ContainerStarted","Data":"8a13c4fa37be496e82a4a02289c9e446596e02d9ac2e3d226debbc53a1820dd5"}
Aug 05 16:21:21.204830 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.204802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal" event={"ID":"ec80920c6181151ca83a615f0c6f4f91","Type":"ContainerStarted","Data":"45a33d6041b233e5204503a63a9593c2462256936aa304db4fa4f951839a3d7f"}
Aug 05 16:21:21.208921 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.208771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7ghpf" event={"ID":"eae6af2d-10b8-4bd5-ad0e-fba85717528b","Type":"ContainerStarted","Data":"c354e811f79a48b077b8d73e8b91ce46aa86c06220575d63688da1bdc2dfc549"}
Aug 05 16:21:21.215308 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.215239    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk2nq" event={"ID":"2621541a-3317-43cc-9a31-067039a63449","Type":"ContainerStarted","Data":"16578fb43948c3bb17d07221c924f9c25b4f46e20c1829621140a22377b2f20d"}
Aug 05 16:21:21.229810 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.229758    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dt52w" event={"ID":"c0363dba-026b-4911-9700-4046397b9860","Type":"ContainerStarted","Data":"d9ef597537d21c710f6bd171e6143d2e02b634fd1455197cd9d1ff048e1257ef"}
Aug 05 16:21:21.247624 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.247537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" event={"ID":"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c","Type":"ContainerStarted","Data":"8200ac01027bfc56b973c9da065af10a4883f42e297aba529df5309a0ce59e00"}
Aug 05 16:21:21.253158 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.253131    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ngdgn" event={"ID":"2808e440-611f-4111-b468-a34f18b5f32f","Type":"ContainerStarted","Data":"cd290206644dc7ed6b9335d66c541fd94b43e9b91fb983f0b3fc4fa209bfc5ed"}
Aug 05 16:21:21.259105 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.259078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal" event={"ID":"c6330fe9fe3288c90c5bc334f4663811","Type":"ContainerStarted","Data":"1f7c4e094f6252b8d617d2fd9b332f8770de5c3bc5464b3828df497b3f7fdb17"}
Aug 05 16:21:21.267877 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.267735    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gbfjb" event={"ID":"5bebfabf-dc9a-4acd-9ed6-0f6663195f74","Type":"ContainerStarted","Data":"251d7d11cc0ec89f05ec205119bc71d82e36455c0cdf930ec30fe5e1b353d244"}
Aug 05 16:21:21.275131 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.274697    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"cad05d80ef6a26733913d4f1a393a51f1b3ea164c60ec209fdb3e9c509ec201e"}
Aug 05 16:21:21.287418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.286797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l7pkr" event={"ID":"c329924c-ec37-43dc-8e22-088c197381ea","Type":"ContainerStarted","Data":"9ec0b0595bb129a532aec6c202cf83ebdfe8a0d4e7c42e479f401edc2669de2d"}
Aug 05 16:21:21.798105 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.797561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:21.798105 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.797635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:21.798105 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.797764    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:21.798105 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.797822    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs podName:073ce27a-9484-4be3-9687-18881f4ace00 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:23.797804621 +0000 UTC m=+5.133602558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs") pod "network-metrics-daemon-vztjl" (UID: "073ce27a-9484-4be3-9687-18881f4ace00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:21.798105 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.797962    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:21.798105 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.798024    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret podName:1f760ce6-beba-4e85-88b4-cd8b33410e66 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:23.798007262 +0000 UTC m=+5.133805189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret") pod "global-pull-secret-syncer-gzhh7" (UID: "1f760ce6-beba-4e85-88b4-cd8b33410e66") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:21.863573 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.863542    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:21.898934 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:21.898899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:21.899121 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.899096    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:21.899196 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.899123    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:21.899196 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.899138    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wvw5g for pod openshift-network-diagnostics/network-check-target-k69ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:21.899196 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:21.899194    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g podName:2523d3de-9ed7-40c4-80f0-d5c331abf9a1 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:23.899176902 +0000 UTC m=+5.234974826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvw5g" (UniqueName: "kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g") pod "network-check-target-k69ps" (UID: "2523d3de-9ed7-40c4-80f0-d5c331abf9a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:22.142150 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:22.141982    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:16:20 +0000 UTC" deadline="2028-03-08 13:26:22.317449993 +0000 UTC"
Aug 05 16:21:22.142150 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:22.142040    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13941h5m0.175414752s"
Aug 05 16:21:22.183230 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:22.182593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:22.183230 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:22.182738    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:22.183230 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:22.182818    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:22.183230 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:22.182889    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:23.184936 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:23.184469    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:23.184936 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.184606    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:23.815421 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:23.815360    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:23.815603 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:23.815435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:23.815603 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.815577    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:23.815720 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.815643    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs podName:073ce27a-9484-4be3-9687-18881f4ace00 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:27.815624042 +0000 UTC m=+9.151421966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs") pod "network-metrics-daemon-vztjl" (UID: "073ce27a-9484-4be3-9687-18881f4ace00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:23.816057 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.816023    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:23.816156 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.816096    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret podName:1f760ce6-beba-4e85-88b4-cd8b33410e66 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:27.816078191 +0000 UTC m=+9.151876126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret") pod "global-pull-secret-syncer-gzhh7" (UID: "1f760ce6-beba-4e85-88b4-cd8b33410e66") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:23.915963 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:23.915928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:23.916145 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.916113    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:23.916145 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.916136    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:23.916251 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.916149    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wvw5g for pod openshift-network-diagnostics/network-check-target-k69ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:23.916251 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:23.916206    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g podName:2523d3de-9ed7-40c4-80f0-d5c331abf9a1 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:27.916188414 +0000 UTC m=+9.251986336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvw5g" (UniqueName: "kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g") pod "network-check-target-k69ps" (UID: "2523d3de-9ed7-40c4-80f0-d5c331abf9a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:24.183050 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:24.183016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:24.183205 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:24.183161    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:24.183279 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:24.183258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:24.183422 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:24.183397    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:25.185332 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:25.184829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:25.185332 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:25.184960    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:26.182929 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:26.182877    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:26.182929 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:26.182897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:26.183393 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:26.183026    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:26.188068 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:26.188018    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:27.182555 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:27.182521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:27.182704 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.182634    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:27.850041 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:27.850003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:27.850500 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:27.850088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:27.850500 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.850159    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:27.850500 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.850212    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:27.850500 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.850247    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs podName:073ce27a-9484-4be3-9687-18881f4ace00 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:35.850224581 +0000 UTC m=+17.186022522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs") pod "network-metrics-daemon-vztjl" (UID: "073ce27a-9484-4be3-9687-18881f4ace00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:27.850500 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.850274    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret podName:1f760ce6-beba-4e85-88b4-cd8b33410e66 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:35.850263235 +0000 UTC m=+17.186061165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret") pod "global-pull-secret-syncer-gzhh7" (UID: "1f760ce6-beba-4e85-88b4-cd8b33410e66") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:27.951236 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:27.951112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:27.951409 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.951300    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:27.951409 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.951326    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:27.951409 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.951339    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wvw5g for pod openshift-network-diagnostics/network-check-target-k69ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:27.951543 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:27.951413    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g podName:2523d3de-9ed7-40c4-80f0-d5c331abf9a1 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:35.951394775 +0000 UTC m=+17.287192711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvw5g" (UniqueName: "kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g") pod "network-check-target-k69ps" (UID: "2523d3de-9ed7-40c4-80f0-d5c331abf9a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:28.182371 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:28.182328    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:28.182538 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:28.182465    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:28.182880 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:28.182854    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:28.182984 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:28.182966    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:29.183813 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:29.183780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:29.184269 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:29.183900    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:30.182196 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:30.182156    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:30.182196 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:30.182194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:30.182500 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:30.182292    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:30.182500 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:30.182428    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:31.182671 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:31.182627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:31.183094 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:31.182757    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:32.182165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:32.182073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:32.182165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:32.182122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:32.182387 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:32.182228    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:32.182387 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:32.182373    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:33.182521 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:33.182486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:33.182948 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:33.182611    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:34.182194 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:34.182159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:34.182370 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:34.182160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:34.182370 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:34.182278    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:34.182370 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:34.182331    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:35.182573 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:35.182369    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:35.182983 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:35.182661    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:35.914679 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:35.914620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:35.914833 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:35.914692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:35.914833 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:35.914776    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:35.914833 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:35.914825    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret podName:1f760ce6-beba-4e85-88b4-cd8b33410e66 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:51.914810946 +0000 UTC m=+33.250608868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret") pod "global-pull-secret-syncer-gzhh7" (UID: "1f760ce6-beba-4e85-88b4-cd8b33410e66") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:35.914998 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:35.914776    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:35.914998 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:35.914893    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs podName:073ce27a-9484-4be3-9687-18881f4ace00 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:51.914879423 +0000 UTC m=+33.250677359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs") pod "network-metrics-daemon-vztjl" (UID: "073ce27a-9484-4be3-9687-18881f4ace00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:36.015411 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:36.015380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:36.015561 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:36.015520    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:36.015561 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:36.015536    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:36.015561 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:36.015546    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wvw5g for pod openshift-network-diagnostics/network-check-target-k69ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:36.015714 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:36.015595    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g podName:2523d3de-9ed7-40c4-80f0-d5c331abf9a1 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:52.015580342 +0000 UTC m=+33.351378265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvw5g" (UniqueName: "kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g") pod "network-check-target-k69ps" (UID: "2523d3de-9ed7-40c4-80f0-d5c331abf9a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:36.182153 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:36.182083    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:36.182153 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:36.182126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:36.182358 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:36.182197    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:36.182435 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:36.182412    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:37.182401 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:37.182371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:37.182970 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:37.182490    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:38.182352 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:38.182325    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:38.182352 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:38.182363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:38.182841 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:38.182486    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:38.182841 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:38.182608    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:39.183628 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:39.183596    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:39.184075 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:39.183700    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:40.182901 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.182882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:40.183002 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.182916    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:40.183002 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:40.182973    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:40.183068 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:40.183025    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:40.347004 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.346846    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:21:40.351669 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.351612    2579 generic.go:356] "Generic (PLEG): container finished" podID="92ab4d4b-a4a1-45dc-b762-e5a9fcf76197" containerID="5949cb426e69106ea3233b84c9d6d236b0ae324a402fae9b9f9d3d9f19a33e14" exitCode=1
Aug 05 16:21:40.351759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.351699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"b95478e718299a2d08ac234b68bd983523c31c9b283ab9f8c4b6a8ac04166492"}
Aug 05 16:21:40.351819 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.351790    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerDied","Data":"5949cb426e69106ea3233b84c9d6d236b0ae324a402fae9b9f9d3d9f19a33e14"}
Aug 05 16:21:40.351886 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.351873    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"df1ddf754be33fb55552c86f706e8d4ed897cd96dce1e1c234ff7a4e4708fd99"}
Aug 05 16:21:40.353713 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.353663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal" event={"ID":"ec80920c6181151ca83a615f0c6f4f91","Type":"ContainerStarted","Data":"7c6e2b0de9457b72a8c3e8b461276d33b005ca700ffda748204d7131763bd2db"}
Aug 05 16:21:40.358948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.358918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7ghpf" event={"ID":"eae6af2d-10b8-4bd5-ad0e-fba85717528b","Type":"ContainerStarted","Data":"6a363b3f773baf29503e86e1e9a04cbba5d223afc6ae29faf1f23bd0326baff6"}
Aug 05 16:21:40.365873 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.365716    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk2nq" event={"ID":"2621541a-3317-43cc-9a31-067039a63449","Type":"ContainerStarted","Data":"f82157cfc55966e12e7cfca17d216f40bbe23ceb781df754f387e05ad5834a77"}
Aug 05 16:21:40.372264 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.372215    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-70.ec2.internal" podStartSLOduration=20.372198034 podStartE2EDuration="20.372198034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:40.371515039 +0000 UTC m=+21.707312984" watchObservedRunningTime="2026-08-05 16:21:40.372198034 +0000 UTC m=+21.707995980"
Aug 05 16:21:40.395767 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.395216    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kk2nq" podStartSLOduration=2.070592346 podStartE2EDuration="21.395193021s" totalImagesPullingTime="19.324600675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:40.394423363 +0000 UTC m=+21.730221307" watchObservedRunningTime="2026-08-05 16:21:40.395193021 +0000 UTC m=+21.730990980"
Aug 05 16:21:40.430185 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:40.430131    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7ghpf" podStartSLOduration=1.712148467 podStartE2EDuration="21.430111964s" totalImagesPullingTime="19.717963497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:40.429782647 +0000 UTC m=+21.765580594" watchObservedRunningTime="2026-08-05 16:21:40.430111964 +0000 UTC m=+21.765909909"
Aug 05 16:21:41.182972 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.182933    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:41.183157 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:41.183041    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:41.369205 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.368952    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dt52w" event={"ID":"c0363dba-026b-4911-9700-4046397b9860","Type":"ContainerStarted","Data":"62992e28f13641bcbf63eb16b0e3276f3908ccada4dcb4d37364885f0bd6c8c5"}
Aug 05 16:21:41.370377 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.370356    2579 generic.go:356] "Generic (PLEG): container finished" podID="d47eb5ed-6047-4a9e-a101-253ce3d8cc4c" containerID="aebf30e3c5a35a1bd07010871c1eddc43c15ddab9e3413a734225cf1da8fff48" exitCode=0
Aug 05 16:21:41.370463 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.370424    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" event={"ID":"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c","Type":"ContainerDied","Data":"aebf30e3c5a35a1bd07010871c1eddc43c15ddab9e3413a734225cf1da8fff48"}
Aug 05 16:21:41.371803 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.371767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ngdgn" event={"ID":"2808e440-611f-4111-b468-a34f18b5f32f","Type":"ContainerStarted","Data":"2bfd006679a9b71d72ddfa52faf3530f346c4aa58fc8ad8b434b76eee21caaeb"}
Aug 05 16:21:41.373076 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.373056    2579 generic.go:356] "Generic (PLEG): container finished" podID="c6330fe9fe3288c90c5bc334f4663811" containerID="60b38564d5ab55abeeb1ed65101fbee06416f5f05ae134adfa180a0aa0477c93" exitCode=0
Aug 05 16:21:41.373192 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.373124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal" event={"ID":"c6330fe9fe3288c90c5bc334f4663811","Type":"ContainerDied","Data":"60b38564d5ab55abeeb1ed65101fbee06416f5f05ae134adfa180a0aa0477c93"}
Aug 05 16:21:41.374629 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.374599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gbfjb" event={"ID":"5bebfabf-dc9a-4acd-9ed6-0f6663195f74","Type":"ContainerStarted","Data":"9cd56de2212469cab89b02194052c864dffe925beda2c703606f7223fb959222"}
Aug 05 16:21:41.377157 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.377141    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:21:41.377494 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.377477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"f5c950db0bf9c27e1279dee7b60ef9d42aff58a30843439323d09be664333039"}
Aug 05 16:21:41.377569 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.377535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"1d226a3731929b8e82ed75549d61ae47fd6ca2e95f6b2c4f47aea3ce2d8b97d4"}
Aug 05 16:21:41.377569 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.377565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"8bc0316eb535ef7d959a0a723f53924a2a75350aa12baa4c34547157e1a31cfd"}
Aug 05 16:21:41.378729 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.378710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l7pkr" event={"ID":"c329924c-ec37-43dc-8e22-088c197381ea","Type":"ContainerStarted","Data":"addf279bd61dd966eb134fe01f76daf92b4a557f19b5d2b186299b66382518f1"}
Aug 05 16:21:41.380125 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.380107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp" event={"ID":"d403013a-53dd-4441-9871-6bbde2e785ca","Type":"ContainerStarted","Data":"f2e0d156cf3bc8211aa126736baf19c33c1f5dd3cad150b0528ff4b767867a67"}
Aug 05 16:21:41.392407 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.392375    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dt52w" podStartSLOduration=3.037484429 podStartE2EDuration="22.392363016s" totalImagesPullingTime="19.354878587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:41.392136024 +0000 UTC m=+22.727933982" watchObservedRunningTime="2026-08-05 16:21:41.392363016 +0000 UTC m=+22.728160951"
Aug 05 16:21:41.455105 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.455059    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gbfjb" podStartSLOduration=3.169611719 podStartE2EDuration="22.455041257s" totalImagesPullingTime="19.285429538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:41.454437623 +0000 UTC m=+22.790235568" watchObservedRunningTime="2026-08-05 16:21:41.455041257 +0000 UTC m=+22.790839203"
Aug 05 16:21:41.493589 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.492294    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ngdgn" podStartSLOduration=7.05467119 podStartE2EDuration="22.492271918s" totalImagesPullingTime="15.437600728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:41.471440643 +0000 UTC m=+22.807238588" watchObservedRunningTime="2026-08-05 16:21:41.492271918 +0000 UTC m=+22.828069864"
Aug 05 16:21:41.493589 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:41.492520    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l7pkr" podStartSLOduration=3.140406631 podStartE2EDuration="22.492511528s" totalImagesPullingTime="19.352104897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:41.491225533 +0000 UTC m=+22.827023478" watchObservedRunningTime="2026-08-05 16:21:41.492511528 +0000 UTC m=+22.828309474"
Aug 05 16:21:42.182143 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:42.182068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:42.182362 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:42.182189    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:42.182362 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:42.182225    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:42.182362 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:42.182306    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:42.252148 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:42.252081    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 16:21:42.384247 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:42.384172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp" event={"ID":"d403013a-53dd-4441-9871-6bbde2e785ca","Type":"ContainerStarted","Data":"1f71540633e019a62071ed249fad596c797cbc79ee061c549bb55db550935055"}
Aug 05 16:21:42.385891 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:42.385865    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal" event={"ID":"c6330fe9fe3288c90c5bc334f4663811","Type":"ContainerStarted","Data":"51409fa17bd311ad14a1a18e9d093eb630d25541f75c57249a1eac4329e9158d"}
Aug 05 16:21:42.413186 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:42.413132    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-70.ec2.internal" podStartSLOduration=22.413117084 podStartE2EDuration="22.413117084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:42.407949044 +0000 UTC m=+23.743746988" watchObservedRunningTime="2026-08-05 16:21:42.413117084 +0000 UTC m=+23.748915027"
Aug 05 16:21:43.137175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:43.136981    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T16:21:42.2520954Z","UUID":"f7d93f7b-08ee-4b52-aa3b-c4cb0fb2fbdc","Handler":null,"Name":"","Endpoint":""}
Aug 05 16:21:43.140177 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:43.140143    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 16:21:43.140331 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:43.140188    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 16:21:43.182551 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:43.182522    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:43.182705 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:43.182638    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:43.390757 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:43.390688    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:21:43.391188 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:43.391117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"7cf2b524bcfa41965ffaa5e25cb28b203168166d936d37243584edca17b8026e"}
Aug 05 16:21:44.053126 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:44.053095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:44.053715 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:44.053693    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:44.181956 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:44.181931    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:44.182126 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:44.182040    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:44.182126 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:44.182070    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:44.182241 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:44.182174    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:44.393289 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:44.393259    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:44.394035 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:44.394018    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ngdgn"
Aug 05 16:21:45.183080 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:45.182810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:45.183233 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:45.183132    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:45.399454 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:45.399421    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:21:45.400166 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:45.399865    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"440f1fc24bb60cebd44ce61283cd38f7b0d5788118d499b04bfb07807e9f54df"}
Aug 05 16:21:45.400229 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:45.400198    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:45.400354 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:45.400321    2579 scope.go:117] "RemoveContainer" containerID="5949cb426e69106ea3233b84c9d6d236b0ae324a402fae9b9f9d3d9f19a33e14"
Aug 05 16:21:45.402357 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:45.402296    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp" event={"ID":"d403013a-53dd-4441-9871-6bbde2e785ca","Type":"ContainerStarted","Data":"7984b8c5291c5902ba83bf1feb31e73ee25782e371faca75509f06b2c3668f3e"}
Aug 05 16:21:45.417732 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:45.417709    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:45.477010 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:45.476918    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgllp" podStartSLOduration=3.376916769 podStartE2EDuration="26.476904322s" totalImagesPullingTime="23.099987553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:45.476903112 +0000 UTC m=+26.812701055" watchObservedRunningTime="2026-08-05 16:21:45.476904322 +0000 UTC m=+26.812702266"
Aug 05 16:21:46.187644 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:46.186673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:46.187644 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:46.186800    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:46.187644 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:46.186904    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:46.187644 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:46.186983    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:47.183055 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.182743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:47.183506 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:47.183117    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:47.216332 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.216302    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gzhh7"]
Aug 05 16:21:47.218954 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.218930    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k69ps"]
Aug 05 16:21:47.219075 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.219061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:47.219184 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:47.219165    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:47.229296 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.229274    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vztjl"]
Aug 05 16:21:47.229417 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.229403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:47.229512 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:47.229488    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:47.409024 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.408994    2579 generic.go:356] "Generic (PLEG): container finished" podID="d47eb5ed-6047-4a9e-a101-253ce3d8cc4c" containerID="9ee43a3fc7e3c00d5978b59ed7fb677234f2fa1e5a5e332e798cfe0037a43d28" exitCode=0
Aug 05 16:21:47.409191 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.409085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" event={"ID":"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c","Type":"ContainerDied","Data":"9ee43a3fc7e3c00d5978b59ed7fb677234f2fa1e5a5e332e798cfe0037a43d28"}
Aug 05 16:21:47.412823 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.412805    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:21:47.413179 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.413162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:47.413258 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.413190    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" event={"ID":"92ab4d4b-a4a1-45dc-b762-e5a9fcf76197","Type":"ContainerStarted","Data":"f1b53faf48f78e9b10e4ff8bfe6220163b0d381c0f78b935df0664308ad77444"}
Aug 05 16:21:47.413316 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:47.413260    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:47.413404 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.413385    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:47.413468 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.413455    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:47.428072 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.428050    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:21:47.467870 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:47.467771    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" podStartSLOduration=8.899920438 podStartE2EDuration="28.467756651s" totalImagesPullingTime="19.567836213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:47.466457275 +0000 UTC m=+28.802255218" watchObservedRunningTime="2026-08-05 16:21:47.467756651 +0000 UTC m=+28.803554577"
Aug 05 16:21:49.183272 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:49.183199    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:49.183631 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:49.183282    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:49.183631 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:49.183388    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:49.183631 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:49.183468    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:49.183631 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:49.183508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:49.183631 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:49.183554    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:49.419114 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:49.419084    2579 generic.go:356] "Generic (PLEG): container finished" podID="d47eb5ed-6047-4a9e-a101-253ce3d8cc4c" containerID="c6386f70cb932dea60a915b5e66b2f3687530e160bca9874ca98a4f237c52c32" exitCode=0
Aug 05 16:21:49.419302 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:49.419173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" event={"ID":"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c","Type":"ContainerDied","Data":"c6386f70cb932dea60a915b5e66b2f3687530e160bca9874ca98a4f237c52c32"}
Aug 05 16:21:49.436408 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:49.436322    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7" podUID="92ab4d4b-a4a1-45dc-b762-e5a9fcf76197" containerName="ovnkube-controller" probeResult="failure" output=""
Aug 05 16:21:51.182551 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:51.182378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:51.182898 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:51.182386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:51.182898 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:51.182630    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k69ps" podUID="2523d3de-9ed7-40c4-80f0-d5c331abf9a1"
Aug 05 16:21:51.182898 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:51.182743    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vztjl" podUID="073ce27a-9484-4be3-9687-18881f4ace00"
Aug 05 16:21:51.182898 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:51.182403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:51.182898 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:51.182846    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzhh7" podUID="1f760ce6-beba-4e85-88b4-cd8b33410e66"
Aug 05 16:21:51.426412 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:51.426382    2579 generic.go:356] "Generic (PLEG): container finished" podID="d47eb5ed-6047-4a9e-a101-253ce3d8cc4c" containerID="29330d7c468e294da83827b5ee762860e63ab389d479c83808995a070bd8ea63" exitCode=0
Aug 05 16:21:51.426540 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:51.426439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" event={"ID":"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c","Type":"ContainerDied","Data":"29330d7c468e294da83827b5ee762860e63ab389d479c83808995a070bd8ea63"}
Aug 05 16:21:51.934998 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:51.934965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:51.935165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:51.935011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:51.935165 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:51.935126    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:51.935165 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:51.935130    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:51.935301 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:51.935178    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs podName:073ce27a-9484-4be3-9687-18881f4ace00 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:23.9351613 +0000 UTC m=+65.270959224 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs") pod "network-metrics-daemon-vztjl" (UID: "073ce27a-9484-4be3-9687-18881f4ace00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:51.935301 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:51.935192    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret podName:1f760ce6-beba-4e85-88b4-cd8b33410e66 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:23.935186729 +0000 UTC m=+65.270984650 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret") pod "global-pull-secret-syncer-gzhh7" (UID: "1f760ce6-beba-4e85-88b4-cd8b33410e66") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:52.035857 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.035825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:52.036019 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:52.035955    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:52.036019 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:52.035970    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:52.036019 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:52.035979    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wvw5g for pod openshift-network-diagnostics/network-check-target-k69ps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:52.036109 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:52.036035    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g podName:2523d3de-9ed7-40c4-80f0-d5c331abf9a1 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:24.036017307 +0000 UTC m=+65.371815230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvw5g" (UniqueName: "kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g") pod "network-check-target-k69ps" (UID: "2523d3de-9ed7-40c4-80f0-d5c331abf9a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:52.920040 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.919969    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-70.ec2.internal" event="NodeReady"
Aug 05 16:21:52.920448 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.920124    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 16:21:52.955312 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.955275    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fbdc8b4fb-whvkt"]
Aug 05 16:21:52.967082 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.967051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:52.969950 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.969912    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 16:21:52.970115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.970068    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fbdc8b4fb-whvkt"]
Aug 05 16:21:52.970186 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.970131    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 16:21:52.970386 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.970370    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 16:21:52.970493 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.970482    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-28g65\""
Aug 05 16:21:52.973260 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.973237    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8h86p"]
Aug 05 16:21:52.976876 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.976858    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 16:21:52.987527 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.987507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8h86p"]
Aug 05 16:21:52.987634 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.987605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8h86p"
Aug 05 16:21:52.990637 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.990616    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5c2w7\""
Aug 05 16:21:52.990637 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.990635    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 16:21:52.990879 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.990858    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 16:21:52.990879 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:52.990875    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 16:21:53.043405 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.043370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.043551 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.043485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-image-registry-private-configuration\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.043551 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.043527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-trusted-ca\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.043623 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.043559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-bound-sa-token\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.043623 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.043586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-certificates\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.043623 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.043602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-installation-pull-secrets\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.043623 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.043619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-ca-trust-extracted\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.043745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.043646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc2mn\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-kube-api-access-sc2mn\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.067942 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.067910    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hz9xq"]
Aug 05 16:21:53.081669 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.081644    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hz9xq"]
Aug 05 16:21:53.081785 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.081759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.084500 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.084481    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 16:21:53.084609 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.084499    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 16:21:53.084609 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.084584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cnw72\""
Aug 05 16:21:53.144366 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc2mn\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-kube-api-access-sc2mn\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.144584 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.144584 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12eb06cb-2535-4f84-9367-fa5191f444dc-cert\") pod \"ingress-canary-8h86p\" (UID: \"12eb06cb-2535-4f84-9367-fa5191f444dc\") " pod="openshift-ingress-canary/ingress-canary-8h86p"
Aug 05 16:21:53.144584 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-image-registry-private-configuration\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.144584 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-trusted-ca\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.144584 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8hgw\" (UniqueName: \"kubernetes.io/projected/12eb06cb-2535-4f84-9367-fa5191f444dc-kube-api-access-v8hgw\") pod \"ingress-canary-8h86p\" (UID: \"12eb06cb-2535-4f84-9367-fa5191f444dc\") " pod="openshift-ingress-canary/ingress-canary-8h86p"
Aug 05 16:21:53.144584 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.144539    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:21:53.144584 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.144563    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fbdc8b4fb-whvkt: secret "image-registry-tls" not found
Aug 05 16:21:53.144584 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-bound-sa-token\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.145013 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.144622    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls podName:77ca1d8d-d7c9-4199-9d4f-9a405b4905c7 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:53.644602422 +0000 UTC m=+34.980400344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls") pod "image-registry-fbdc8b4fb-whvkt" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7") : secret "image-registry-tls" not found
Aug 05 16:21:53.145013 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-certificates\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.145013 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144730    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-installation-pull-secrets\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.145013 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.144854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-ca-trust-extracted\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.145253 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.145232    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-ca-trust-extracted\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.145476 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.145421    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-certificates\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.145645 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.145626    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-trusted-ca\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.149807 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.149783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-installation-pull-secrets\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.149893 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.149788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-image-registry-private-configuration\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.156986 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.156960    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc2mn\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-kube-api-access-sc2mn\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.157084 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.156964    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-bound-sa-token\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.182262 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.182191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:21:53.182428 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.182191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:21:53.182428 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.182191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:21:53.185637 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.185613    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:21:53.185751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.185645    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:21:53.185917 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.185904    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:21:53.185989 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.185909    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-64w4b\""
Aug 05 16:21:53.186149 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.186133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:21:53.186222 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.186154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w287q\""
Aug 05 16:21:53.245962 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.245919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12eb06cb-2535-4f84-9367-fa5191f444dc-cert\") pod \"ingress-canary-8h86p\" (UID: \"12eb06cb-2535-4f84-9367-fa5191f444dc\") " pod="openshift-ingress-canary/ingress-canary-8h86p"
Aug 05 16:21:53.246113 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.246000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-config-volume\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.246113 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.246026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffffc\" (UniqueName: \"kubernetes.io/projected/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-kube-api-access-ffffc\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.246113 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.246055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8hgw\" (UniqueName: \"kubernetes.io/projected/12eb06cb-2535-4f84-9367-fa5191f444dc-kube-api-access-v8hgw\") pod \"ingress-canary-8h86p\" (UID: \"12eb06cb-2535-4f84-9367-fa5191f444dc\") " pod="openshift-ingress-canary/ingress-canary-8h86p"
Aug 05 16:21:53.246113 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.246084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.246282 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.246162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-tmp-dir\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.248611 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.248588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12eb06cb-2535-4f84-9367-fa5191f444dc-cert\") pod \"ingress-canary-8h86p\" (UID: \"12eb06cb-2535-4f84-9367-fa5191f444dc\") " pod="openshift-ingress-canary/ingress-canary-8h86p"
Aug 05 16:21:53.260193 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.260174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8hgw\" (UniqueName: \"kubernetes.io/projected/12eb06cb-2535-4f84-9367-fa5191f444dc-kube-api-access-v8hgw\") pod \"ingress-canary-8h86p\" (UID: \"12eb06cb-2535-4f84-9367-fa5191f444dc\") " pod="openshift-ingress-canary/ingress-canary-8h86p"
Aug 05 16:21:53.298134 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.298109    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8h86p"
Aug 05 16:21:53.347603 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.347467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-tmp-dir\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.347603 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.347572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-config-volume\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.347603 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.347599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffffc\" (UniqueName: \"kubernetes.io/projected/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-kube-api-access-ffffc\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.347872 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.347638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.348053 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.348028    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:21:53.348170 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.348080    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-tmp-dir\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.348170 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.348088    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls podName:d0a65919-baf3-43b4-a28a-2b9e0a8f85f5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:53.848070726 +0000 UTC m=+35.183868647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls") pod "dns-default-hz9xq" (UID: "d0a65919-baf3-43b4-a28a-2b9e0a8f85f5") : secret "dns-default-metrics-tls" not found
Aug 05 16:21:53.348736 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.348710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-config-volume\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.359115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.359079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffffc\" (UniqueName: \"kubernetes.io/projected/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-kube-api-access-ffffc\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.485020 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.484946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8h86p"]
Aug 05 16:21:53.492943 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:21:53.492904    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12eb06cb_2535_4f84_9367_fa5191f444dc.slice/crio-158b023d84d1e39f683226e4053b4de45f2257b715ee02d98d281bbb456d37f1 WatchSource:0}: Error finding container 158b023d84d1e39f683226e4053b4de45f2257b715ee02d98d281bbb456d37f1: Status 404 returned error can't find the container with id 158b023d84d1e39f683226e4053b4de45f2257b715ee02d98d281bbb456d37f1
Aug 05 16:21:53.649836 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.649797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:53.650078 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.649965    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:21:53.650078 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.649986    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fbdc8b4fb-whvkt: secret "image-registry-tls" not found
Aug 05 16:21:53.650078 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.650067    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls podName:77ca1d8d-d7c9-4199-9d4f-9a405b4905c7 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:54.650035437 +0000 UTC m=+35.985833379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls") pod "image-registry-fbdc8b4fb-whvkt" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7") : secret "image-registry-tls" not found
Aug 05 16:21:53.852061 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:53.851970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:53.852308 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.852140    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:21:53.852308 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:53.852224    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls podName:d0a65919-baf3-43b4-a28a-2b9e0a8f85f5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:54.852199252 +0000 UTC m=+36.187997177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls") pod "dns-default-hz9xq" (UID: "d0a65919-baf3-43b4-a28a-2b9e0a8f85f5") : secret "dns-default-metrics-tls" not found
Aug 05 16:21:54.436839 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:54.436799    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8h86p" event={"ID":"12eb06cb-2535-4f84-9367-fa5191f444dc","Type":"ContainerStarted","Data":"158b023d84d1e39f683226e4053b4de45f2257b715ee02d98d281bbb456d37f1"}
Aug 05 16:21:54.657935 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:54.657901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:54.658078 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:54.658047    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:21:54.658078 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:54.658065    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fbdc8b4fb-whvkt: secret "image-registry-tls" not found
Aug 05 16:21:54.658153 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:54.658118    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls podName:77ca1d8d-d7c9-4199-9d4f-9a405b4905c7 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:56.658103283 +0000 UTC m=+37.993901225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls") pod "image-registry-fbdc8b4fb-whvkt" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7") : secret "image-registry-tls" not found
Aug 05 16:21:54.860261 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:54.859988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:54.860444 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:54.860146    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:21:54.860444 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:54.860340    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls podName:d0a65919-baf3-43b4-a28a-2b9e0a8f85f5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:56.860320213 +0000 UTC m=+38.196118139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls") pod "dns-default-hz9xq" (UID: "d0a65919-baf3-43b4-a28a-2b9e0a8f85f5") : secret "dns-default-metrics-tls" not found
Aug 05 16:21:56.675275 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:56.675238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:21:56.675724 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:56.675415    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:21:56.675724 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:56.675435    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fbdc8b4fb-whvkt: secret "image-registry-tls" not found
Aug 05 16:21:56.675724 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:56.675495    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls podName:77ca1d8d-d7c9-4199-9d4f-9a405b4905c7 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:00.675473724 +0000 UTC m=+42.011271647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls") pod "image-registry-fbdc8b4fb-whvkt" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7") : secret "image-registry-tls" not found
Aug 05 16:21:56.876910 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:56.876818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:21:56.877068 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:56.876989    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:21:56.877127 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:21:56.877067    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls podName:d0a65919-baf3-43b4-a28a-2b9e0a8f85f5 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:00.877045008 +0000 UTC m=+42.212842940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls") pod "dns-default-hz9xq" (UID: "d0a65919-baf3-43b4-a28a-2b9e0a8f85f5") : secret "dns-default-metrics-tls" not found
Aug 05 16:21:58.447637 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:58.447600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8h86p" event={"ID":"12eb06cb-2535-4f84-9367-fa5191f444dc","Type":"ContainerStarted","Data":"486289e4d73207d3c5c75a77ab6fe1caf92c79cb7af4642b017ea60c12fc5173"}
Aug 05 16:21:58.450375 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:58.450333    2579 generic.go:356] "Generic (PLEG): container finished" podID="d47eb5ed-6047-4a9e-a101-253ce3d8cc4c" containerID="72466e2e94c3ca29739b4bd46b0078fee03394164213ad44ed5521daed6221ab" exitCode=0
Aug 05 16:21:58.450485 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:58.450371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" event={"ID":"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c","Type":"ContainerDied","Data":"72466e2e94c3ca29739b4bd46b0078fee03394164213ad44ed5521daed6221ab"}
Aug 05 16:21:58.466361 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:58.466312    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8h86p" podStartSLOduration=2.473450134 podStartE2EDuration="6.466294287s" totalImagesPullingTime="3.992844153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:58.46564202 +0000 UTC m=+39.801439967" watchObservedRunningTime="2026-08-05 16:21:58.466294287 +0000 UTC m=+39.802092233"
Aug 05 16:21:59.455470 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:59.455439    2579 generic.go:356] "Generic (PLEG): container finished" podID="d47eb5ed-6047-4a9e-a101-253ce3d8cc4c" containerID="44fca1de1b953f6cd613834f7d3eaea06347ce02fd1373854daa39f38a595b19" exitCode=0
Aug 05 16:21:59.455821 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:21:59.455522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" event={"ID":"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c","Type":"ContainerDied","Data":"44fca1de1b953f6cd613834f7d3eaea06347ce02fd1373854daa39f38a595b19"}
Aug 05 16:22:00.463076 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:00.463041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" event={"ID":"d47eb5ed-6047-4a9e-a101-253ce3d8cc4c","Type":"ContainerStarted","Data":"91411143ce1170e9040c5952c36addc4e5d463df4b35de2c482984472238950d"}
Aug 05 16:22:00.490260 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:00.490215    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sj6vh" podStartSLOduration=8.195211458 podStartE2EDuration="41.490201875s" totalImagesPullingTime="33.294990417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:00.488248404 +0000 UTC m=+41.824046349" watchObservedRunningTime="2026-08-05 16:22:00.490201875 +0000 UTC m=+41.825999821"
Aug 05 16:22:00.702928 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:00.702897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:22:00.703076 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:00.702986    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:00.703076 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:00.702997    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fbdc8b4fb-whvkt: secret "image-registry-tls" not found
Aug 05 16:22:00.703076 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:00.703043    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls podName:77ca1d8d-d7c9-4199-9d4f-9a405b4905c7 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:08.703028578 +0000 UTC m=+50.038826500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls") pod "image-registry-fbdc8b4fb-whvkt" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7") : secret "image-registry-tls" not found
Aug 05 16:22:00.904590 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:00.904521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:22:00.904715 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:00.904635    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:00.904715 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:00.904680    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls podName:d0a65919-baf3-43b4-a28a-2b9e0a8f85f5 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:08.904667147 +0000 UTC m=+50.240465069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls") pod "dns-default-hz9xq" (UID: "d0a65919-baf3-43b4-a28a-2b9e0a8f85f5") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:05.681110 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.681078    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"]
Aug 05 16:22:05.731150 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.731125    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t"]
Aug 05 16:22:05.731300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.731249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:05.739865 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.739837    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 05 16:22:05.739966 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.739873    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9t6cx\""
Aug 05 16:22:05.739966 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.739884    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 05 16:22:05.739966 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.739850    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 16:22:05.739966 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.739848    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 16:22:05.752595 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.752576    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"]
Aug 05 16:22:05.752686 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.752601    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t"]
Aug 05 16:22:05.752686 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.752660    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t"
Aug 05 16:22:05.756082 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.756064    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l2drr\""
Aug 05 16:22:05.837206 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.837182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:05.837316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.837224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:05.837316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.837278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv75c\" (UniqueName: \"kubernetes.io/projected/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-kube-api-access-lv75c\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:05.937593 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.937535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:05.937593 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.937575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:05.937728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.937595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqdm\" (UniqueName: \"kubernetes.io/projected/56bfc27d-5f57-48fa-8196-06a5fdb15b1f-kube-api-access-bsqdm\") pod \"network-check-source-65bdbbff45-l6g5t\" (UID: \"56bfc27d-5f57-48fa-8196-06a5fdb15b1f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t"
Aug 05 16:22:05.937728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.937639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv75c\" (UniqueName: \"kubernetes.io/projected/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-kube-api-access-lv75c\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:05.937728 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:05.937667    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:05.937728 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:05.937721    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls podName:e9520ecb-d16e-4d30-95bd-1c10d571ec9a nodeName:}" failed. No retries permitted until 2026-08-05 16:22:06.437705665 +0000 UTC m=+47.773503587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-445dx" (UID: "e9520ecb-d16e-4d30-95bd-1c10d571ec9a") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:05.938214 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.938197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:05.956847 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:05.956825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv75c\" (UniqueName: \"kubernetes.io/projected/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-kube-api-access-lv75c\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:06.037889 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:06.037871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqdm\" (UniqueName: \"kubernetes.io/projected/56bfc27d-5f57-48fa-8196-06a5fdb15b1f-kube-api-access-bsqdm\") pod \"network-check-source-65bdbbff45-l6g5t\" (UID: \"56bfc27d-5f57-48fa-8196-06a5fdb15b1f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t"
Aug 05 16:22:06.054908 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:06.054885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqdm\" (UniqueName: \"kubernetes.io/projected/56bfc27d-5f57-48fa-8196-06a5fdb15b1f-kube-api-access-bsqdm\") pod \"network-check-source-65bdbbff45-l6g5t\" (UID: \"56bfc27d-5f57-48fa-8196-06a5fdb15b1f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t"
Aug 05 16:22:06.060648 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:06.060630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t"
Aug 05 16:22:06.195745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:06.195673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t"]
Aug 05 16:22:06.198483 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:06.198458    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bfc27d_5f57_48fa_8196_06a5fdb15b1f.slice/crio-54a1b47e50b5c2a2c4f060310bfef7b294d05b3cc117e4d1f2ae3e16c220e379 WatchSource:0}: Error finding container 54a1b47e50b5c2a2c4f060310bfef7b294d05b3cc117e4d1f2ae3e16c220e379: Status 404 returned error can't find the container with id 54a1b47e50b5c2a2c4f060310bfef7b294d05b3cc117e4d1f2ae3e16c220e379
Aug 05 16:22:06.442233 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:06.442201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:06.442381 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:06.442364    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:06.442435 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:06.442425    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls podName:e9520ecb-d16e-4d30-95bd-1c10d571ec9a nodeName:}" failed. No retries permitted until 2026-08-05 16:22:07.44241014 +0000 UTC m=+48.778208063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-445dx" (UID: "e9520ecb-d16e-4d30-95bd-1c10d571ec9a") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:06.477727 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:06.477666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t" event={"ID":"56bfc27d-5f57-48fa-8196-06a5fdb15b1f","Type":"ContainerStarted","Data":"54a1b47e50b5c2a2c4f060310bfef7b294d05b3cc117e4d1f2ae3e16c220e379"}
Aug 05 16:22:07.451644 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:07.451612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:07.452056 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:07.451817    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:07.452056 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:07.451897    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls podName:e9520ecb-d16e-4d30-95bd-1c10d571ec9a nodeName:}" failed. No retries permitted until 2026-08-05 16:22:09.451876932 +0000 UTC m=+50.787674868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-445dx" (UID: "e9520ecb-d16e-4d30-95bd-1c10d571ec9a") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:08.762712 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:08.762678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:22:08.763113 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:08.762806    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:08.763113 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:08.762818    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fbdc8b4fb-whvkt: secret "image-registry-tls" not found
Aug 05 16:22:08.763113 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:08.762881    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls podName:77ca1d8d-d7c9-4199-9d4f-9a405b4905c7 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:24.762865122 +0000 UTC m=+66.098663064 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls") pod "image-registry-fbdc8b4fb-whvkt" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7") : secret "image-registry-tls" not found
Aug 05 16:22:08.963763 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:08.963717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:22:08.963946 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:08.963860    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:08.963946 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:08.963936    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls podName:d0a65919-baf3-43b4-a28a-2b9e0a8f85f5 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:24.963914953 +0000 UTC m=+66.299712877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls") pod "dns-default-hz9xq" (UID: "d0a65919-baf3-43b4-a28a-2b9e0a8f85f5") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:09.468173 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:09.468133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:09.468472 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:09.468263    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:09.468472 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:09.468320    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls podName:e9520ecb-d16e-4d30-95bd-1c10d571ec9a nodeName:}" failed. No retries permitted until 2026-08-05 16:22:13.468306236 +0000 UTC m=+54.804104158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-445dx" (UID: "e9520ecb-d16e-4d30-95bd-1c10d571ec9a") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:09.485621 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:09.485583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t" event={"ID":"56bfc27d-5f57-48fa-8196-06a5fdb15b1f","Type":"ContainerStarted","Data":"e40822097241a4cb31117c05bf4273fa451d12a1ae18d82a23b8b4765aa4bd74"}
Aug 05 16:22:09.503174 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:09.503118    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-l6g5t" podStartSLOduration=1.423676533 podStartE2EDuration="4.50309851s" totalImagesPullingTime="3.079421977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:09.502797864 +0000 UTC m=+50.838595808" watchObservedRunningTime="2026-08-05 16:22:09.50309851 +0000 UTC m=+50.838896455"
Aug 05 16:22:11.009516 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.009487    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bpnrc"]
Aug 05 16:22:11.011630 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.011607    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.021328 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.021142    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 16:22:11.022148 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.022054    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 16:22:11.023583 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.022315    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 16:22:11.023583 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.022553    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 16:22:11.023583 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.022847    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rq9ls\""
Aug 05 16:22:11.037529 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.037509    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bpnrc"]
Aug 05 16:22:11.081468 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.081439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-crio-socket\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.081468 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.081466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-data-volume\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.081605 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.081497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.081639 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.081610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.081677 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.081638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kswlh\" (UniqueName: \"kubernetes.io/projected/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-api-access-kswlh\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.182166 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.182138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.182280 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.182231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.182280 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:11.182246    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:11.182280 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.182256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kswlh\" (UniqueName: \"kubernetes.io/projected/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-api-access-kswlh\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.182414 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:11.182312    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:11.682294119 +0000 UTC m=+53.018092063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:11.182414 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.182366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-crio-socket\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.182414 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.182389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-data-volume\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.182551 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:11.182409    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:11.182551 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:11.182517    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:11.682498368 +0000 UTC m=+53.018296306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:11.182654 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.182590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-crio-socket\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.182743 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.182728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-data-volume\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.192933 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.192908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kswlh\" (UniqueName: \"kubernetes.io/projected/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-api-access-kswlh\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.686010 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.685967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.686179 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:11.686110    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:11.686179 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:11.686158    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:11.686179 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:11.686177    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:12.686160665 +0000 UTC m=+54.021958587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:11.686304 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:11.686115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:11.686304 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:11.686205    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:12.686193607 +0000 UTC m=+54.021991547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:12.127370 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.127286    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74"]
Aug 05 16:22:12.129257 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.129242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74"
Aug 05 16:22:12.132230 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.132213    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nrq8c\""
Aug 05 16:22:12.132326 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.132246    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 05 16:22:12.133373 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.133355    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 05 16:22:12.142521 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.142502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74"]
Aug 05 16:22:12.188773 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.188752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cxp7\" (UniqueName: \"kubernetes.io/projected/ded1f5c2-630e-474e-a537-fe7b0b0a0042-kube-api-access-6cxp7\") pod \"migrator-68bc745d87-zrt74\" (UID: \"ded1f5c2-630e-474e-a537-fe7b0b0a0042\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74"
Aug 05 16:22:12.289716 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.289695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxp7\" (UniqueName: \"kubernetes.io/projected/ded1f5c2-630e-474e-a537-fe7b0b0a0042-kube-api-access-6cxp7\") pod \"migrator-68bc745d87-zrt74\" (UID: \"ded1f5c2-630e-474e-a537-fe7b0b0a0042\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74"
Aug 05 16:22:12.298733 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.298711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cxp7\" (UniqueName: \"kubernetes.io/projected/ded1f5c2-630e-474e-a537-fe7b0b0a0042-kube-api-access-6cxp7\") pod \"migrator-68bc745d87-zrt74\" (UID: \"ded1f5c2-630e-474e-a537-fe7b0b0a0042\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74"
Aug 05 16:22:12.437283 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.437257    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74"
Aug 05 16:22:12.551962 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.551933    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74"]
Aug 05 16:22:12.554653 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:12.554629    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded1f5c2_630e_474e_a537_fe7b0b0a0042.slice/crio-bbe38d37d2125979ce08a5cd581c9c741ed61ca84b9cfd9288860e4887059242 WatchSource:0}: Error finding container bbe38d37d2125979ce08a5cd581c9c741ed61ca84b9cfd9288860e4887059242: Status 404 returned error can't find the container with id bbe38d37d2125979ce08a5cd581c9c741ed61ca84b9cfd9288860e4887059242
Aug 05 16:22:12.692961 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.692882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:12.692961 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.692952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:12.693197 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:12.693017    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:12.693197 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:12.693046    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:12.693197 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:12.693082    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:14.693067056 +0000 UTC m=+56.028864978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:12.693197 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:12.693095    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:14.693089281 +0000 UTC m=+56.028887202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:12.775781 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:12.775755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7pkr_c329924c-ec37-43dc-8e22-088c197381ea/dns-node-resolver/0.log"
Aug 05 16:22:13.496518 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:13.496469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74" event={"ID":"ded1f5c2-630e-474e-a537-fe7b0b0a0042","Type":"ContainerStarted","Data":"bbe38d37d2125979ce08a5cd581c9c741ed61ca84b9cfd9288860e4887059242"}
Aug 05 16:22:13.499817 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:13.499775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:13.499943 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:13.499900    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:13.499995 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:13.499960    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls podName:e9520ecb-d16e-4d30-95bd-1c10d571ec9a nodeName:}" failed. No retries permitted until 2026-08-05 16:22:21.499945458 +0000 UTC m=+62.835743380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-445dx" (UID: "e9520ecb-d16e-4d30-95bd-1c10d571ec9a") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:22:13.979121 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:13.979092    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gbfjb_5bebfabf-dc9a-4acd-9ed6-0f6663195f74/node-ca/0.log"
Aug 05 16:22:14.501514 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:14.501477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74" event={"ID":"ded1f5c2-630e-474e-a537-fe7b0b0a0042","Type":"ContainerStarted","Data":"fb2a8f829cfb810d0e0a273810422ee01c7aa8684e8e8bfee457b0d500e39b90"}
Aug 05 16:22:14.501924 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:14.501538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74" event={"ID":"ded1f5c2-630e-474e-a537-fe7b0b0a0042","Type":"ContainerStarted","Data":"a5beee7022e8bf5cb8f0d0a66333c84d3bec84bcb43248d9993b9012baa47419"}
Aug 05 16:22:14.534862 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:14.534814    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zrt74" podStartSLOduration=1.355545194 podStartE2EDuration="2.534798079s" totalImagesPullingTime="1.179252885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:14.534114857 +0000 UTC m=+55.869912801" watchObservedRunningTime="2026-08-05 16:22:14.534798079 +0000 UTC m=+55.870596023"
Aug 05 16:22:14.709156 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:14.709126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:14.709314 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:14.709189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:14.709314 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:14.709269    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:14.709314 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:14.709279    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:14.709314 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:14.709316    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:18.709302925 +0000 UTC m=+60.045100847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:14.709508 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:14.709338    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:18.709321441 +0000 UTC m=+60.045119369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:14.980937 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:14.980914    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8h86p_12eb06cb-2535-4f84-9367-fa5191f444dc/serve-healthcheck-canary/0.log"
Aug 05 16:22:18.738202 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:18.738167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:18.738597 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:18.738249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:18.738597 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:18.738323    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:18.738597 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:18.738400    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:26.738385261 +0000 UTC m=+68.074183186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:18.738597 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:18.738322    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:18.738597 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:18.738457    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm podName:a77f5879-0acc-4a4f-8202-6f1a0cf29b88 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:26.738446709 +0000 UTC m=+68.074244645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bpnrc" (UID: "a77f5879-0acc-4a4f-8202-6f1a0cf29b88") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:19.428710 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:19.428679    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbkr7"
Aug 05 16:22:21.558798 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:21.558766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:21.561060 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:21.561028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9520ecb-d16e-4d30-95bd-1c10d571ec9a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-445dx\" (UID: \"e9520ecb-d16e-4d30-95bd-1c10d571ec9a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:21.644381 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:21.644359    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9t6cx\""
Aug 05 16:22:21.651841 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:21.651815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"
Aug 05 16:22:21.772610 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:21.772582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx"]
Aug 05 16:22:21.774900 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:21.774875    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9520ecb_d16e_4d30_95bd_1c10d571ec9a.slice/crio-252d35b606c6c66bb393799f23e8b38702fe5151af85728955bcdc094c622496 WatchSource:0}: Error finding container 252d35b606c6c66bb393799f23e8b38702fe5151af85728955bcdc094c622496: Status 404 returned error can't find the container with id 252d35b606c6c66bb393799f23e8b38702fe5151af85728955bcdc094c622496
Aug 05 16:22:22.521826 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:22.521783    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx" event={"ID":"e9520ecb-d16e-4d30-95bd-1c10d571ec9a","Type":"ContainerStarted","Data":"252d35b606c6c66bb393799f23e8b38702fe5151af85728955bcdc094c622496"}
Aug 05 16:22:23.981461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:23.980941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:22:23.981461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:23.981037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:22:23.984202 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:23.983954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:22:23.985146 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:23.985125    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:22:23.994177 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:23.994155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f760ce6-beba-4e85-88b4-cd8b33410e66-original-pull-secret\") pod \"global-pull-secret-syncer-gzhh7\" (UID: \"1f760ce6-beba-4e85-88b4-cd8b33410e66\") " pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:22:23.994291 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:23.994184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073ce27a-9484-4be3-9687-18881f4ace00-metrics-certs\") pod \"network-metrics-daemon-vztjl\" (UID: \"073ce27a-9484-4be3-9687-18881f4ace00\") " pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:22:24.081746 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.081721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:22:24.084189 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.084167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvw5g\" (UniqueName: \"kubernetes.io/projected/2523d3de-9ed7-40c4-80f0-d5c331abf9a1-kube-api-access-wvw5g\") pod \"network-check-target-k69ps\" (UID: \"2523d3de-9ed7-40c4-80f0-d5c331abf9a1\") " pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:22:24.096744 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.096725    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w287q\""
Aug 05 16:22:24.102157 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.102116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzhh7"
Aug 05 16:22:24.103816 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.103790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vztjl"
Aug 05 16:22:24.109758 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.109742    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-64w4b\""
Aug 05 16:22:24.117130 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.117107    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:22:24.264951 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.264896    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vztjl"]
Aug 05 16:22:24.267255 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:24.267222    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073ce27a_9484_4be3_9687_18881f4ace00.slice/crio-a95a3f89808bd7e33e00ddf6a6682ee3e02ccbba8b870c24e62c86e0d56d48d6 WatchSource:0}: Error finding container a95a3f89808bd7e33e00ddf6a6682ee3e02ccbba8b870c24e62c86e0d56d48d6: Status 404 returned error can't find the container with id a95a3f89808bd7e33e00ddf6a6682ee3e02ccbba8b870c24e62c86e0d56d48d6
Aug 05 16:22:24.473462 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.473441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k69ps"]
Aug 05 16:22:24.475763 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:24.475738    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2523d3de_9ed7_40c4_80f0_d5c331abf9a1.slice/crio-7b6d91f29a83b584ef3d8165c26ae60f313eba9e2d1ce0648f64b92524dff6fc WatchSource:0}: Error finding container 7b6d91f29a83b584ef3d8165c26ae60f313eba9e2d1ce0648f64b92524dff6fc: Status 404 returned error can't find the container with id 7b6d91f29a83b584ef3d8165c26ae60f313eba9e2d1ce0648f64b92524dff6fc
Aug 05 16:22:24.475851 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.475757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gzhh7"]
Aug 05 16:22:24.478048 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:24.478028    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f760ce6_beba_4e85_88b4_cd8b33410e66.slice/crio-5f02e87924d03ab2eb39e62ca7574dcf2a475f74e31e24d3629c1a37dbabacb9 WatchSource:0}: Error finding container 5f02e87924d03ab2eb39e62ca7574dcf2a475f74e31e24d3629c1a37dbabacb9: Status 404 returned error can't find the container with id 5f02e87924d03ab2eb39e62ca7574dcf2a475f74e31e24d3629c1a37dbabacb9
Aug 05 16:22:24.528859 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.528828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gzhh7" event={"ID":"1f760ce6-beba-4e85-88b4-cd8b33410e66","Type":"ContainerStarted","Data":"5f02e87924d03ab2eb39e62ca7574dcf2a475f74e31e24d3629c1a37dbabacb9"}
Aug 05 16:22:24.530576 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.530534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k69ps" event={"ID":"2523d3de-9ed7-40c4-80f0-d5c331abf9a1","Type":"ContainerStarted","Data":"7b6d91f29a83b584ef3d8165c26ae60f313eba9e2d1ce0648f64b92524dff6fc"}
Aug 05 16:22:24.532091 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.532064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx" event={"ID":"e9520ecb-d16e-4d30-95bd-1c10d571ec9a","Type":"ContainerStarted","Data":"f323bb5a87095e3722535925e81489e8d413cae8faa69c9b24c66d9ce424a31d"}
Aug 05 16:22:24.533243 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.533220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vztjl" event={"ID":"073ce27a-9484-4be3-9687-18881f4ace00","Type":"ContainerStarted","Data":"a95a3f89808bd7e33e00ddf6a6682ee3e02ccbba8b870c24e62c86e0d56d48d6"}
Aug 05 16:22:24.557115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.557072    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-445dx" podStartSLOduration=17.481627184 podStartE2EDuration="19.557059174s" totalImagesPullingTime="2.07543199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:24.556462844 +0000 UTC m=+65.892260787" watchObservedRunningTime="2026-08-05 16:22:24.557059174 +0000 UTC m=+65.892857117"
Aug 05 16:22:24.787731 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.787658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:22:24.789902 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.789875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"image-registry-fbdc8b4fb-whvkt\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") " pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:22:24.989289 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.989252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:22:24.991704 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:24.991677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0a65919-baf3-43b4-a28a-2b9e0a8f85f5-metrics-tls\") pod \"dns-default-hz9xq\" (UID: \"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5\") " pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:22:25.082331 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.082272    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-28g65\""
Aug 05 16:22:25.090073 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.090054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:22:25.195971 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.195942    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cnw72\""
Aug 05 16:22:25.203758 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.203729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:22:25.238227 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.237627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fbdc8b4fb-whvkt"]
Aug 05 16:22:25.353160 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.353040    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hz9xq"]
Aug 05 16:22:25.487697 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:25.487662    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ca1d8d_d7c9_4199_9d4f_9a405b4905c7.slice/crio-bdf210fb5284fc2b3c6bf46ab1d312122c09218b541c8392afbe48b81d09ef37 WatchSource:0}: Error finding container bdf210fb5284fc2b3c6bf46ab1d312122c09218b541c8392afbe48b81d09ef37: Status 404 returned error can't find the container with id bdf210fb5284fc2b3c6bf46ab1d312122c09218b541c8392afbe48b81d09ef37
Aug 05 16:22:25.488539 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:25.488512    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a65919_baf3_43b4_a28a_2b9e0a8f85f5.slice/crio-54964b93b92488f1f756d2189469551d69473dc77dc5a041ac5fc5868b085ac1 WatchSource:0}: Error finding container 54964b93b92488f1f756d2189469551d69473dc77dc5a041ac5fc5868b085ac1: Status 404 returned error can't find the container with id 54964b93b92488f1f756d2189469551d69473dc77dc5a041ac5fc5868b085ac1
Aug 05 16:22:25.539250 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.539204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt" event={"ID":"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7","Type":"ContainerStarted","Data":"bdf210fb5284fc2b3c6bf46ab1d312122c09218b541c8392afbe48b81d09ef37"}
Aug 05 16:22:25.541016 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.540990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k69ps" event={"ID":"2523d3de-9ed7-40c4-80f0-d5c331abf9a1","Type":"ContainerStarted","Data":"0a5e4bde87005a9f72587d346bd46b59c8d2a381f54a1838172b57a25a6da317"}
Aug 05 16:22:25.542369 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.542333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz9xq" event={"ID":"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5","Type":"ContainerStarted","Data":"54964b93b92488f1f756d2189469551d69473dc77dc5a041ac5fc5868b085ac1"}
Aug 05 16:22:25.543503 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.543482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:22:25.560738 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:25.560691    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k69ps" podStartSLOduration=66.56067499 podStartE2EDuration="1m6.56067499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:25.559927066 +0000 UTC m=+66.895725011" watchObservedRunningTime="2026-08-05 16:22:25.56067499 +0000 UTC m=+66.896472935"
Aug 05 16:22:26.547062 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.547020    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vztjl" event={"ID":"073ce27a-9484-4be3-9687-18881f4ace00","Type":"ContainerStarted","Data":"30c68eddfeeb43aac0bd3afb1a315c887dc120fd030c3ad6140395d90df584ff"}
Aug 05 16:22:26.547537 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.547084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vztjl" event={"ID":"073ce27a-9484-4be3-9687-18881f4ace00","Type":"ContainerStarted","Data":"995a14320d5524d81bc92195a27acab3a3090af4b43814fd2cde9b36a0c0b689"}
Aug 05 16:22:26.548813 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.548783    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt" event={"ID":"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7","Type":"ContainerStarted","Data":"3e59bbeaf7ce15636e46f7930fba170263e9a21e74c8490a4a221116e85cbea3"}
Aug 05 16:22:26.548974 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.548897    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:22:26.565038 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.564998    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vztjl" podStartSLOduration=66.295984632 podStartE2EDuration="1m7.564984416s" totalImagesPullingTime="1.268999784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:26.563281802 +0000 UTC m=+67.899079747" watchObservedRunningTime="2026-08-05 16:22:26.564984416 +0000 UTC m=+67.900782358"
Aug 05 16:22:26.583968 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.583927    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt" podStartSLOduration=67.583914542 podStartE2EDuration="1m7.583914542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:26.582865572 +0000 UTC m=+67.918663516" watchObservedRunningTime="2026-08-05 16:22:26.583914542 +0000 UTC m=+67.919712485"
Aug 05 16:22:26.807372 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.807273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:26.807372 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.807338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:26.807922 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.807894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:26.809806 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.809786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a77f5879-0acc-4a4f-8202-6f1a0cf29b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpnrc\" (UID: \"a77f5879-0acc-4a4f-8202-6f1a0cf29b88\") " pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:26.928444 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.928407    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rq9ls\""
Aug 05 16:22:26.936015 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:26.935995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bpnrc"
Aug 05 16:22:27.593549 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:27.593528    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bpnrc"]
Aug 05 16:22:27.595810 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:27.595783    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77f5879_0acc_4a4f_8202_6f1a0cf29b88.slice/crio-f8d73e4ff09ad45ee2c7ce9cfbe7b4a5b89d25a9018f95b9121944fe5cde6890 WatchSource:0}: Error finding container f8d73e4ff09ad45ee2c7ce9cfbe7b4a5b89d25a9018f95b9121944fe5cde6890: Status 404 returned error can't find the container with id f8d73e4ff09ad45ee2c7ce9cfbe7b4a5b89d25a9018f95b9121944fe5cde6890
Aug 05 16:22:28.559363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:28.559316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz9xq" event={"ID":"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5","Type":"ContainerStarted","Data":"eea9f0a6d6823cd7ea02c83c3a751e63845e0f841fa7c984f703cc58aea54f01"}
Aug 05 16:22:28.559551 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:28.559397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz9xq" event={"ID":"d0a65919-baf3-43b4-a28a-2b9e0a8f85f5","Type":"ContainerStarted","Data":"de6f6c580277cf0242dc9e61aa11e39db60e4dc892cf79950686ebc273fec7e5"}
Aug 05 16:22:28.559551 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:28.559463    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:22:28.561074 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:28.561048    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bpnrc" event={"ID":"a77f5879-0acc-4a4f-8202-6f1a0cf29b88","Type":"ContainerStarted","Data":"bdca3f9084cbdb591c0ddff7a52db760deeb206515f39d5496beb2977b59637d"}
Aug 05 16:22:28.561192 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:28.561101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bpnrc" event={"ID":"a77f5879-0acc-4a4f-8202-6f1a0cf29b88","Type":"ContainerStarted","Data":"f8d73e4ff09ad45ee2c7ce9cfbe7b4a5b89d25a9018f95b9121944fe5cde6890"}
Aug 05 16:22:28.581436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:28.581381    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hz9xq" podStartSLOduration=33.560397915 podStartE2EDuration="35.581367393s" totalImagesPullingTime="2.020969478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:28.580142409 +0000 UTC m=+69.915940353" watchObservedRunningTime="2026-08-05 16:22:28.581367393 +0000 UTC m=+69.917165337"
Aug 05 16:22:29.565959 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:29.565927    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bpnrc" event={"ID":"a77f5879-0acc-4a4f-8202-6f1a0cf29b88","Type":"ContainerStarted","Data":"2385b93bc3dd6bb43d57903cb0f9968534fff18cd36ab63e878bc36d9c7a68ce"}
Aug 05 16:22:29.567257 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:29.567222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gzhh7" event={"ID":"1f760ce6-beba-4e85-88b4-cd8b33410e66","Type":"ContainerStarted","Data":"03b4a91adc6ae45b918f86cc6f443b7989f9614aeb7004e6e1955ee105c860cc"}
Aug 05 16:22:29.584388 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:29.584329    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gzhh7" podStartSLOduration=65.822133147 podStartE2EDuration="1m10.584315498s" totalImagesPullingTime="4.762182351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:29.583723773 +0000 UTC m=+70.919521733" watchObservedRunningTime="2026-08-05 16:22:29.584315498 +0000 UTC m=+70.920113441"
Aug 05 16:22:31.575101 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:31.575023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bpnrc" event={"ID":"a77f5879-0acc-4a4f-8202-6f1a0cf29b88","Type":"ContainerStarted","Data":"be58d1980655a8dd0eb40b4df3ba8fc29e42ae8d222279ad0d6bb8eef264a134"}
Aug 05 16:22:34.908170 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.908116    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bpnrc" podStartSLOduration=21.313456861 podStartE2EDuration="24.908099278s" totalImagesPullingTime="3.594642417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:31.596157961 +0000 UTC m=+72.931955904" watchObservedRunningTime="2026-08-05 16:22:34.908099278 +0000 UTC m=+76.243897222"
Aug 05 16:22:34.908769 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.908752    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"]
Aug 05 16:22:34.910691 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.910668    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"
Aug 05 16:22:34.921548 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.921526    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 05 16:22:34.921696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.921672    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 05 16:22:34.921784 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.921764    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 05 16:22:34.921846 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.921783    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 05 16:22:34.921904 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.921764    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9j9pj\""
Aug 05 16:22:34.941054 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.941035    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"]
Aug 05 16:22:34.963801 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.963779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02129147-3f9d-455b-b526-3f94295ece13-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856d67474-2k42m\" (UID: \"02129147-3f9d-455b-b526-3f94295ece13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"
Aug 05 16:22:34.963889 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.963808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgq24\" (UniqueName: \"kubernetes.io/projected/02129147-3f9d-455b-b526-3f94295ece13-kube-api-access-kgq24\") pod \"managed-serviceaccount-addon-agent-856d67474-2k42m\" (UID: \"02129147-3f9d-455b-b526-3f94295ece13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"
Aug 05 16:22:34.979270 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.979250    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-hhkgn"]
Aug 05 16:22:34.981204 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.981189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-hhkgn"
Aug 05 16:22:34.985497 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.985481    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 05 16:22:34.985898 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.985880    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8jtqg\""
Aug 05 16:22:34.985982 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:34.985907    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 05 16:22:35.002109 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.002087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-hhkgn"]
Aug 05 16:22:35.065092 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.065069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02129147-3f9d-455b-b526-3f94295ece13-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856d67474-2k42m\" (UID: \"02129147-3f9d-455b-b526-3f94295ece13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"
Aug 05 16:22:35.065197 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.065099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgq24\" (UniqueName: \"kubernetes.io/projected/02129147-3f9d-455b-b526-3f94295ece13-kube-api-access-kgq24\") pod \"managed-serviceaccount-addon-agent-856d67474-2k42m\" (UID: \"02129147-3f9d-455b-b526-3f94295ece13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"
Aug 05 16:22:35.065197 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.065127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wtk6\" (UniqueName: \"kubernetes.io/projected/96d3242f-c007-4890-92de-1a9aa935f287-kube-api-access-7wtk6\") pod \"downloads-77c974ffcf-hhkgn\" (UID: \"96d3242f-c007-4890-92de-1a9aa935f287\") " pod="openshift-console/downloads-77c974ffcf-hhkgn"
Aug 05 16:22:35.067440 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.067415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02129147-3f9d-455b-b526-3f94295ece13-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856d67474-2k42m\" (UID: \"02129147-3f9d-455b-b526-3f94295ece13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"
Aug 05 16:22:35.077818 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.077794    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgq24\" (UniqueName: \"kubernetes.io/projected/02129147-3f9d-455b-b526-3f94295ece13-kube-api-access-kgq24\") pod \"managed-serviceaccount-addon-agent-856d67474-2k42m\" (UID: \"02129147-3f9d-455b-b526-3f94295ece13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"
Aug 05 16:22:35.165422 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.165361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wtk6\" (UniqueName: \"kubernetes.io/projected/96d3242f-c007-4890-92de-1a9aa935f287-kube-api-access-7wtk6\") pod \"downloads-77c974ffcf-hhkgn\" (UID: \"96d3242f-c007-4890-92de-1a9aa935f287\") " pod="openshift-console/downloads-77c974ffcf-hhkgn"
Aug 05 16:22:35.175050 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.175027    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wtk6\" (UniqueName: \"kubernetes.io/projected/96d3242f-c007-4890-92de-1a9aa935f287-kube-api-access-7wtk6\") pod \"downloads-77c974ffcf-hhkgn\" (UID: \"96d3242f-c007-4890-92de-1a9aa935f287\") " pod="openshift-console/downloads-77c974ffcf-hhkgn"
Aug 05 16:22:35.231420 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.231397    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"
Aug 05 16:22:35.288878 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.288840    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-hhkgn"
Aug 05 16:22:35.368139 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.368014    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m"]
Aug 05 16:22:35.370522 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:35.370487    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02129147_3f9d_455b_b526_3f94295ece13.slice/crio-3f2abe9710f9a251ab9aa94ba7685332726a5ce23dd98bed3c92fb823a1fb4d3 WatchSource:0}: Error finding container 3f2abe9710f9a251ab9aa94ba7685332726a5ce23dd98bed3c92fb823a1fb4d3: Status 404 returned error can't find the container with id 3f2abe9710f9a251ab9aa94ba7685332726a5ce23dd98bed3c92fb823a1fb4d3
Aug 05 16:22:35.422662 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.422542    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-hhkgn"]
Aug 05 16:22:35.424907 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:35.424883    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d3242f_c007_4890_92de_1a9aa935f287.slice/crio-284d5e434801abaf72b13dfb2d9784999d4a8d30fa3d6d870cbc45772b5bccb7 WatchSource:0}: Error finding container 284d5e434801abaf72b13dfb2d9784999d4a8d30fa3d6d870cbc45772b5bccb7: Status 404 returned error can't find the container with id 284d5e434801abaf72b13dfb2d9784999d4a8d30fa3d6d870cbc45772b5bccb7
Aug 05 16:22:35.589629 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.589596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m" event={"ID":"02129147-3f9d-455b-b526-3f94295ece13","Type":"ContainerStarted","Data":"3f2abe9710f9a251ab9aa94ba7685332726a5ce23dd98bed3c92fb823a1fb4d3"}
Aug 05 16:22:35.590657 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:35.590636    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-hhkgn" event={"ID":"96d3242f-c007-4890-92de-1a9aa935f287","Type":"ContainerStarted","Data":"284d5e434801abaf72b13dfb2d9784999d4a8d30fa3d6d870cbc45772b5bccb7"}
Aug 05 16:22:38.570107 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:38.570076    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hz9xq"
Aug 05 16:22:39.618499 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:39.618456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m" event={"ID":"02129147-3f9d-455b-b526-3f94295ece13","Type":"ContainerStarted","Data":"87e66a74506098f2ecacde77f28775f2eab3357ebc788581b9d0b5a318a9e9fa"}
Aug 05 16:22:39.637927 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:39.637872    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856d67474-2k42m" podStartSLOduration=2.426281388 podStartE2EDuration="5.637856799s" totalImagesPullingTime="3.211575411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:39.637277387 +0000 UTC m=+80.973075333" watchObservedRunningTime="2026-08-05 16:22:39.637856799 +0000 UTC m=+80.973654742"
Aug 05 16:22:40.636723 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.636695    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f77877d8-24ks4"]
Aug 05 16:22:40.640485 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.640465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.644470 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.644445    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 05 16:22:40.644599 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.644447    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 05 16:22:40.644599 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.644503    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 05 16:22:40.644599 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.644551    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 05 16:22:40.645625 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.645603    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 05 16:22:40.645736 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.645603    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j6m4h\""
Aug 05 16:22:40.651665 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.651644    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f77877d8-24ks4"]
Aug 05 16:22:40.710651 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.710623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-console-config\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.710795 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.710664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xrfk\" (UniqueName: \"kubernetes.io/projected/2f5e727b-04fb-4201-a555-70d9445f7a10-kube-api-access-8xrfk\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.710795 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.710695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-oauth-config\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.710795 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.710728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-oauth-serving-cert\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.710795 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.710766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-service-ca\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.710969 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.710894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-serving-cert\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.811863 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.811836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-oauth-config\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.812009 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.811877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-oauth-serving-cert\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.812009 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.811901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-service-ca\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.812009 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.811961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-serving-cert\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.812009 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.812000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-console-config\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.812210 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.812022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xrfk\" (UniqueName: \"kubernetes.io/projected/2f5e727b-04fb-4201-a555-70d9445f7a10-kube-api-access-8xrfk\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.813267 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.813236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-service-ca\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.815634 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.815605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-oauth-serving-cert\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.817836 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.817657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-serving-cert\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.817836 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.817780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-oauth-config\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.818001 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.817851    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-console-config\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.821919 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.821878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xrfk\" (UniqueName: \"kubernetes.io/projected/2f5e727b-04fb-4201-a555-70d9445f7a10-kube-api-access-8xrfk\") pod \"console-54f77877d8-24ks4\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") " pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:40.951422 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:40.951388    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:41.106881 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:41.106847    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f77877d8-24ks4"]
Aug 05 16:22:41.110812 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:41.110779    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5e727b_04fb_4201_a555_70d9445f7a10.slice/crio-b0e56c58f0248193525466e7a000aa78b6a8e3395821bcad685473b6ff963c84 WatchSource:0}: Error finding container b0e56c58f0248193525466e7a000aa78b6a8e3395821bcad685473b6ff963c84: Status 404 returned error can't find the container with id b0e56c58f0248193525466e7a000aa78b6a8e3395821bcad685473b6ff963c84
Aug 05 16:22:41.628307 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:41.628179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f77877d8-24ks4" event={"ID":"2f5e727b-04fb-4201-a555-70d9445f7a10","Type":"ContainerStarted","Data":"b0e56c58f0248193525466e7a000aa78b6a8e3395821bcad685473b6ff963c84"}
Aug 05 16:22:44.642737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.642650    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f77877d8-24ks4" event={"ID":"2f5e727b-04fb-4201-a555-70d9445f7a10","Type":"ContainerStarted","Data":"1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156"}
Aug 05 16:22:44.668627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.668573    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f77877d8-24ks4" podStartSLOduration=1.52517393 podStartE2EDuration="4.668551642s" totalImagesPullingTime="3.143377712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:44.667362548 +0000 UTC m=+86.003160492" watchObservedRunningTime="2026-08-05 16:22:44.668551642 +0000 UTC m=+86.004349589"
Aug 05 16:22:44.927919 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.927876    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"]
Aug 05 16:22:44.930207 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.930183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:44.935765 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.935743    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 05 16:22:44.935877 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.935746    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 16:22:44.936517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.936354    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 05 16:22:44.936517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.936399    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lk7fw\""
Aug 05 16:22:44.936517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.936432    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 05 16:22:44.955791 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.955767    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p8vjf"]
Aug 05 16:22:44.958215 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.958193    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:44.961137 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.961115    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 16:22:44.961415 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.961325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 16:22:44.964108 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.962865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"]
Aug 05 16:22:44.965942 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.965783    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 16:22:44.965942 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:44.965914    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zxk8h\""
Aug 05 16:22:45.045770 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.045732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-textfile\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.045770 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.045772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/083e4000-6959-4c24-af8c-da79a472185b-metrics-client-ca\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.046002 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.045796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.046002 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.045897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-root\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.046002 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.045934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12277e02-790b-453f-85c9-773191c0207a-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.046002 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.045961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-tls\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.046002 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.045992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.046246 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.046018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72k8c\" (UniqueName: \"kubernetes.io/projected/083e4000-6959-4c24-af8c-da79a472185b-kube-api-access-72k8c\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.046246 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.046045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.046246 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.046070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-wtmp\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.046246 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.046097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.046246 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.046123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/12277e02-790b-453f-85c9-773191c0207a-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.046246 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.046218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsj75\" (UniqueName: \"kubernetes.io/projected/12277e02-790b-453f-85c9-773191c0207a-kube-api-access-vsj75\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.046534 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.046256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.046534 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.046283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-sys\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.096703 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.096671    2579 patch_prober.go:28] interesting pod/image-registry-fbdc8b4fb-whvkt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 05 16:22:45.096864 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.096727    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt" podUID="77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:22:45.147541 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-textfile\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.147713 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/083e4000-6959-4c24-af8c-da79a472185b-metrics-client-ca\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.147713 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.147713 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-root\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.147713 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12277e02-790b-453f-85c9-773191c0207a-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.147926 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-tls\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.147926 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.147926 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72k8c\" (UniqueName: \"kubernetes.io/projected/083e4000-6959-4c24-af8c-da79a472185b-kube-api-access-72k8c\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.147926 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.147926 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-wtmp\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.147926 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.147926 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147877    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-textfile\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.147926 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/12277e02-790b-453f-85c9-773191c0207a-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.148316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsj75\" (UniqueName: \"kubernetes.io/projected/12277e02-790b-453f-85c9-773191c0207a-kube-api-access-vsj75\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.148316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.147992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.148316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.148017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-sys\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.148316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.148117    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-sys\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.148316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.148298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-root\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.149266 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.148873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.149266 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.148880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/083e4000-6959-4c24-af8c-da79a472185b-metrics-client-ca\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.149266 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.149167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/12277e02-790b-453f-85c9-773191c0207a-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.149266 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.149218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12277e02-790b-453f-85c9-773191c0207a-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.149544 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.149302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-wtmp\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.149544 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.149423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.150732 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.150704    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-tls\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.150914 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.150897    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.151362 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.151324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12277e02-790b-453f-85c9-773191c0207a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.152055 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.152029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/083e4000-6959-4c24-af8c-da79a472185b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.158214 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.158190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72k8c\" (UniqueName: \"kubernetes.io/projected/083e4000-6959-4c24-af8c-da79a472185b-kube-api-access-72k8c\") pod \"node-exporter-p8vjf\" (UID: \"083e4000-6959-4c24-af8c-da79a472185b\") " pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.158327 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.158269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsj75\" (UniqueName: \"kubernetes.io/projected/12277e02-790b-453f-85c9-773191c0207a-kube-api-access-vsj75\") pod \"kube-state-metrics-6bd9664c4-s8gdb\" (UID: \"12277e02-790b-453f-85c9-773191c0207a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.240736 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.240666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"
Aug 05 16:22:45.273923 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.273886    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p8vjf"
Aug 05 16:22:45.383861 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.383831    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb"]
Aug 05 16:22:45.385960 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:45.385932    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12277e02_790b_453f_85c9_773191c0207a.slice/crio-14d8f350fac055f4c98cce9a8bc82765018345f05ea9d5d861344c627d0850f2 WatchSource:0}: Error finding container 14d8f350fac055f4c98cce9a8bc82765018345f05ea9d5d861344c627d0850f2: Status 404 returned error can't find the container with id 14d8f350fac055f4c98cce9a8bc82765018345f05ea9d5d861344c627d0850f2
Aug 05 16:22:45.648126 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.648028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb" event={"ID":"12277e02-790b-453f-85c9-773191c0207a","Type":"ContainerStarted","Data":"14d8f350fac055f4c98cce9a8bc82765018345f05ea9d5d861344c627d0850f2"}
Aug 05 16:22:45.649303 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.649278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p8vjf" event={"ID":"083e4000-6959-4c24-af8c-da79a472185b","Type":"ContainerStarted","Data":"4dd991908b6f5e862db2b79ed50760a4403ca7f39d4e3d76d82a7c8432799449"}
Aug 05 16:22:45.930907 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.930873    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:22:45.933907 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.933886    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:45.939445 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.939419    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 05 16:22:45.939445 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.939437    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 05 16:22:45.939792 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.939774    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 05 16:22:45.939911 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.939891    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 05 16:22:45.939977 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.939917    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 05 16:22:45.941298 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.941271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-njtmw\""
Aug 05 16:22:45.941669 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.941445    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 05 16:22:45.941669 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.941512    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 05 16:22:45.942069 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.942038    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 05 16:22:45.947123 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.947100    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 05 16:22:45.958158 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:45.958137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:22:46.054783 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.054752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.054783 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.054787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.054994 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.054862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.054994 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.054903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-out\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.054994 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.054931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.054994 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.054974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.055175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.055004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.055175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.055043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-web-config\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.055175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.055067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.055175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.055091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.055175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.055131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.055175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.055167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.055425 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.055231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgl8v\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-kube-api-access-mgl8v\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156211 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156211 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgl8v\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-kube-api-access-mgl8v\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-out\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156843 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156843 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156843 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156843 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-web-config\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.156843 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.156578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.157126 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.157052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.157188 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.157164    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.157288 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.157263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.157741 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:46.157714    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Aug 05 16:22:46.157840 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:46.157787    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls podName:8aea0c8d-20ab-4ff3-939a-8dd216dff735 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:46.657767952 +0000 UTC m=+87.993565879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735") : secret "alertmanager-main-tls" not found
Aug 05 16:22:46.160800 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.160358    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.160800 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.160485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-out\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.160800 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.160493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.160800 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.160741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.160800 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.160758    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.161130 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.160954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.161872 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.161841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.162439 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.162422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-web-config\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.165117 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.165096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgl8v\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-kube-api-access-mgl8v\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.660975 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.660937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.663655 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.663627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:46.845937 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:46.845900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:22:47.558152 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:47.558127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:22:49.357032 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.356992    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68975f9ffc-9d55f"]
Aug 05 16:22:49.359436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.359418    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.363962 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.363939    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 05 16:22:49.364099 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.363986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 05 16:22:49.364099 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.364067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 05 16:22:49.364099 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.364073    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-91pid6fru6qpf\""
Aug 05 16:22:49.364099 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.363948    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 05 16:22:49.364320 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.364138    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sjtlk\""
Aug 05 16:22:49.372619 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.372600    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68975f9ffc-9d55f"]
Aug 05 16:22:49.486227 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.486195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-secret-metrics-server-client-certs\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.486429 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.486259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-secret-metrics-server-tls\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.486429 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.486313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-audit-log\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.486429 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.486366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.486429 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.486385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-metrics-server-audit-profiles\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.486429 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.486416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wp2d\" (UniqueName: \"kubernetes.io/projected/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-kube-api-access-4wp2d\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.486693 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.486527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-client-ca-bundle\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.587728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.587165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-secret-metrics-server-tls\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.587728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.587217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-audit-log\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.587728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.587264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.587728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.587290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-metrics-server-audit-profiles\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.587728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.587329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp2d\" (UniqueName: \"kubernetes.io/projected/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-kube-api-access-4wp2d\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.587728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.587390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-client-ca-bundle\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.587728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.587428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-secret-metrics-server-client-certs\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.588224 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.587754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-audit-log\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.588297 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.588274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.588498 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.588472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-metrics-server-audit-profiles\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.590166 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.590137    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-secret-metrics-server-tls\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.590274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.590207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-secret-metrics-server-client-certs\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.590553 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.590509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-client-ca-bundle\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.597897 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.597874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wp2d\" (UniqueName: \"kubernetes.io/projected/a03fa4f1-d2fa-4a2a-9aa1-8450184e746b-kube-api-access-4wp2d\") pod \"metrics-server-68975f9ffc-9d55f\" (UID: \"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b\") " pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.641317 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.641253    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"]
Aug 05 16:22:49.643894 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.643875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:49.646877 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.646853    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tdhld\""
Aug 05 16:22:49.646984 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.646857    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 05 16:22:49.658967 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.658946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"]
Aug 05 16:22:49.671373 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.671319    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:22:49.789489 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.789453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjv9s\" (UniqueName: \"kubernetes.io/projected/ae5a402d-47c1-4c74-aa8b-89deff924ac8-kube-api-access-hjv9s\") pod \"monitoring-plugin-6dffbbd67-p78cq\" (UID: \"ae5a402d-47c1-4c74-aa8b-89deff924ac8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:49.789633 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.789500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae5a402d-47c1-4c74-aa8b-89deff924ac8-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-p78cq\" (UID: \"ae5a402d-47c1-4c74-aa8b-89deff924ac8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:49.890814 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.890781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjv9s\" (UniqueName: \"kubernetes.io/projected/ae5a402d-47c1-4c74-aa8b-89deff924ac8-kube-api-access-hjv9s\") pod \"monitoring-plugin-6dffbbd67-p78cq\" (UID: \"ae5a402d-47c1-4c74-aa8b-89deff924ac8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:49.891005 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.890822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae5a402d-47c1-4c74-aa8b-89deff924ac8-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-p78cq\" (UID: \"ae5a402d-47c1-4c74-aa8b-89deff924ac8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:49.891064 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:49.891009    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Aug 05 16:22:49.891115 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:22:49.891092    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5a402d-47c1-4c74-aa8b-89deff924ac8-monitoring-plugin-cert podName:ae5a402d-47c1-4c74-aa8b-89deff924ac8 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:50.39107145 +0000 UTC m=+91.726869390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ae5a402d-47c1-4c74-aa8b-89deff924ac8-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-p78cq" (UID: "ae5a402d-47c1-4c74-aa8b-89deff924ac8") : secret "monitoring-plugin-cert" not found
Aug 05 16:22:49.909098 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:49.909012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjv9s\" (UniqueName: \"kubernetes.io/projected/ae5a402d-47c1-4c74-aa8b-89deff924ac8-kube-api-access-hjv9s\") pod \"monitoring-plugin-6dffbbd67-p78cq\" (UID: \"ae5a402d-47c1-4c74-aa8b-89deff924ac8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:50.396162 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:50.396129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae5a402d-47c1-4c74-aa8b-89deff924ac8-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-p78cq\" (UID: \"ae5a402d-47c1-4c74-aa8b-89deff924ac8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:50.398975 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:50.398945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae5a402d-47c1-4c74-aa8b-89deff924ac8-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-p78cq\" (UID: \"ae5a402d-47c1-4c74-aa8b-89deff924ac8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:50.555468 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:50.555435    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:50.952539 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:50.952501    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:50.952723 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:50.952569    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:50.957848 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:50.957816    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:51.526246 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.526216    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:22:51.529316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.529292    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.537627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.537607    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 05 16:22:51.537873 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.537854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 05 16:22:51.538372 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.538355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 05 16:22:51.538459 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.538339    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 05 16:22:51.538459 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.538360    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6hhjifjmgesr6\""
Aug 05 16:22:51.540646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.540626    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 05 16:22:51.540742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.540636    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-76fjr\""
Aug 05 16:22:51.541677 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.541661    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 05 16:22:51.541846 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.541826    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 05 16:22:51.541951 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.541873    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 05 16:22:51.554825 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.554803    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 05 16:22:51.554922 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.554899    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 05 16:22:51.555900 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.555879    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 05 16:22:51.556682 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.556631    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 05 16:22:51.557252 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.557227    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 05 16:22:51.559751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.559732    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 05 16:22:51.574317 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.574297    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:22:51.606914 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.606890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607033 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.606926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-config\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607033 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.606957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607033 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.606993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607163 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-config-out\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607163 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607163 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607286 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607286 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607286 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-web-config\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607286 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607483 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607483 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607483 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607483 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607483 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fktwp\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-kube-api-access-fktwp\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607483 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607713 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607713 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.607713 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.607544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.677698 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.677670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:22:51.707983 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.707954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-config\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708194 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708244 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708244 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-config-out\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708357 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708357 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708357 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-web-config\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708789 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708789 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.708919 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.708897    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.709273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.709393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fktwp\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-kube-api-access-fktwp\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.709435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.709462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.709488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.709519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.709649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.709788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.710087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.711720    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-config\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.712261    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-web-config\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.712359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.712301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.713300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.713274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.713424 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.713380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.713685 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.713662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.713888 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.713866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.713997 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.713895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.714103 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.714060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.714937 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.714912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-config-out\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.715443 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.715394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.715634 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.715598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.715747 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.715604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.731283 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.731237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fktwp\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-kube-api-access-fktwp\") pod \"prometheus-k8s-0\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:51.840672 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:51.840593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:22:52.904035 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:52.903714    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"]
Aug 05 16:22:52.906149 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:52.906105    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5a402d_47c1_4c74_aa8b_89deff924ac8.slice/crio-f2a878979fd57b9bae5185e55c1cbfab7360438198d32d39b86613ee122e2023 WatchSource:0}: Error finding container f2a878979fd57b9bae5185e55c1cbfab7360438198d32d39b86613ee122e2023: Status 404 returned error can't find the container with id f2a878979fd57b9bae5185e55c1cbfab7360438198d32d39b86613ee122e2023
Aug 05 16:22:53.145824 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.145697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68975f9ffc-9d55f"]
Aug 05 16:22:53.149267 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:53.149225    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03fa4f1_d2fa_4a2a_9aa1_8450184e746b.slice/crio-f574d878e1bea254ca71af1a44d6a3cc4283618039fbf6299b27038c7980d2ad WatchSource:0}: Error finding container f574d878e1bea254ca71af1a44d6a3cc4283618039fbf6299b27038c7980d2ad: Status 404 returned error can't find the container with id f574d878e1bea254ca71af1a44d6a3cc4283618039fbf6299b27038c7980d2ad
Aug 05 16:22:53.165545 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:53.165515    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75639ee_b611_4d0e_914f_3584b198ab06.slice/crio-6bc5cb97c5c3ed2479af7e70fbc898b650ec44112e675848d67eef096b1f8c83 WatchSource:0}: Error finding container 6bc5cb97c5c3ed2479af7e70fbc898b650ec44112e675848d67eef096b1f8c83: Status 404 returned error can't find the container with id 6bc5cb97c5c3ed2479af7e70fbc898b650ec44112e675848d67eef096b1f8c83
Aug 05 16:22:53.166910 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.166887    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:22:53.168210 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.168127    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:22:53.169561 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:22:53.169538    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aea0c8d_20ab_4ff3_939a_8dd216dff735.slice/crio-39533653787e0428cdc5646be1eca257ed3ea9af74849946c337a5a6cea94fde WatchSource:0}: Error finding container 39533653787e0428cdc5646be1eca257ed3ea9af74849946c337a5a6cea94fde: Status 404 returned error can't find the container with id 39533653787e0428cdc5646be1eca257ed3ea9af74849946c337a5a6cea94fde
Aug 05 16:22:53.698900 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.698863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerStarted","Data":"6bc5cb97c5c3ed2479af7e70fbc898b650ec44112e675848d67eef096b1f8c83"}
Aug 05 16:22:53.703636 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.703596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-hhkgn" event={"ID":"96d3242f-c007-4890-92de-1a9aa935f287","Type":"ContainerStarted","Data":"454ffe7992097f615431f59e18e245dce7d6d46c65d77e22eb2a41879f6a4f63"}
Aug 05 16:22:53.704418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.704263    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-hhkgn"
Aug 05 16:22:53.705882 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.705852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq" event={"ID":"ae5a402d-47c1-4c74-aa8b-89deff924ac8","Type":"ContainerStarted","Data":"f2a878979fd57b9bae5185e55c1cbfab7360438198d32d39b86613ee122e2023"}
Aug 05 16:22:53.708109 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.708074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f" event={"ID":"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b","Type":"ContainerStarted","Data":"f574d878e1bea254ca71af1a44d6a3cc4283618039fbf6299b27038c7980d2ad"}
Aug 05 16:22:53.709612 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.709588    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerStarted","Data":"39533653787e0428cdc5646be1eca257ed3ea9af74849946c337a5a6cea94fde"}
Aug 05 16:22:53.719206 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.719181    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-hhkgn"
Aug 05 16:22:53.753111 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:53.752952    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-hhkgn" podStartSLOduration=2.283701337 podStartE2EDuration="19.752931434s" totalImagesPullingTime="17.469230097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:53.731165008 +0000 UTC m=+95.066962945" watchObservedRunningTime="2026-08-05 16:22:53.752931434 +0000 UTC m=+95.088729378"
Aug 05 16:22:55.721568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:55.721523    2579 generic.go:356] "Generic (PLEG): container finished" podID="083e4000-6959-4c24-af8c-da79a472185b" containerID="2db90326ab1a397d2ebe32111ea338d6b4c75bcd9075d395ea094b1871eb3298" exitCode=0
Aug 05 16:22:55.722066 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:55.721661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p8vjf" event={"ID":"083e4000-6959-4c24-af8c-da79a472185b","Type":"ContainerDied","Data":"2db90326ab1a397d2ebe32111ea338d6b4c75bcd9075d395ea094b1871eb3298"}
Aug 05 16:22:55.725170 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:55.725146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb" event={"ID":"12277e02-790b-453f-85c9-773191c0207a","Type":"ContainerStarted","Data":"767a415f1e84746dc2c0b44cdcf325fe2c8a9d91cee784703439236614d1c4bf"}
Aug 05 16:22:55.725275 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:55.725202    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb" event={"ID":"12277e02-790b-453f-85c9-773191c0207a","Type":"ContainerStarted","Data":"1fd956cb46ac5ac1e48310c40fa2c00187c79a71fb50e1ca2dc52eddeb90974e"}
Aug 05 16:22:56.551086 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:56.551054    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k69ps"
Aug 05 16:22:56.732168 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:56.732128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb" event={"ID":"12277e02-790b-453f-85c9-773191c0207a","Type":"ContainerStarted","Data":"25b486222daaddb0be711fda4b4a1b591fd6d4cb1ffc70a750da57d576c8ac1d"}
Aug 05 16:22:56.754218 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:56.754166    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-s8gdb" podStartSLOduration=3.41759985 podStartE2EDuration="12.754144763s" totalImagesPullingTime="9.336544913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:56.752435521 +0000 UTC m=+98.088233468" watchObservedRunningTime="2026-08-05 16:22:56.754144763 +0000 UTC m=+98.089942707"
Aug 05 16:22:57.739829 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.739793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p8vjf" event={"ID":"083e4000-6959-4c24-af8c-da79a472185b","Type":"ContainerStarted","Data":"e5a966fee2851b769a816af6dd63f28a3ef2646cb126c92810014a8fa469d56f"}
Aug 05 16:22:57.741966 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.741934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f" event={"ID":"a03fa4f1-d2fa-4a2a-9aa1-8450184e746b","Type":"ContainerStarted","Data":"c3d7cbe26884a780af34e0e6f9a348fc8ac863ef447f78aa9dadbbd1db6fe0ae"}
Aug 05 16:22:57.744155 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.744077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerStarted","Data":"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22"}
Aug 05 16:22:57.745842 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.745812    2579 generic.go:356] "Generic (PLEG): container finished" podID="c75639ee-b611-4d0e-914f-3584b198ab06" containerID="00a8140d51a26a37ca7459c8e2501e107cd30e6544077615983fb639b1fbf9f9" exitCode=0
Aug 05 16:22:57.745951 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.745921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerDied","Data":"00a8140d51a26a37ca7459c8e2501e107cd30e6544077615983fb639b1fbf9f9"}
Aug 05 16:22:57.748012 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.747984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq" event={"ID":"ae5a402d-47c1-4c74-aa8b-89deff924ac8","Type":"ContainerStarted","Data":"4fbd51bf36fb2fcb321fb6f09243cc1e99e6a516ee5187e78e972d2dced698d9"}
Aug 05 16:22:57.748692 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.748588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:57.755289 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.755250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq"
Aug 05 16:22:57.771708 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.771654    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f" podStartSLOduration=4.425073333 podStartE2EDuration="8.771636292s" totalImagesPullingTime="4.346562959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:57.769853372 +0000 UTC m=+99.105651317" watchObservedRunningTime="2026-08-05 16:22:57.771636292 +0000 UTC m=+99.107434237"
Aug 05 16:22:57.794286 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:57.794230    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-p78cq" podStartSLOduration=4.20372567 podStartE2EDuration="8.794210438s" totalImagesPullingTime="4.590484768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:57.793011092 +0000 UTC m=+99.128809037" watchObservedRunningTime="2026-08-05 16:22:57.794210438 +0000 UTC m=+99.130008383"
Aug 05 16:22:58.735357 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:58.735319    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fbdc8b4fb-whvkt"]
Aug 05 16:22:58.762381 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:58.758372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p8vjf" event={"ID":"083e4000-6959-4c24-af8c-da79a472185b","Type":"ContainerStarted","Data":"6fd4e548b8cd8a5ad605fc4838d61c6e2429dccf690d78eef8dc12eb23dd8684"}
Aug 05 16:22:58.762381 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:58.760822    2579 generic.go:356] "Generic (PLEG): container finished" podID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerID="09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22" exitCode=0
Aug 05 16:22:58.762381 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:58.761956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerDied","Data":"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22"}
Aug 05 16:22:58.835434 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:22:58.835369    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p8vjf" podStartSLOduration=5.293929062 podStartE2EDuration="14.835337029s" totalImagesPullingTime="9.437519204s" totalInitContainerRuntime="103.888763ms" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:58.834117557 +0000 UTC m=+100.169915503" watchObservedRunningTime="2026-08-05 16:22:58.835337029 +0000 UTC m=+100.171134976"
Aug 05 16:23:00.849167 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:00.849132    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f77877d8-24ks4"]
Aug 05 16:23:02.782192 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:02.782164    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerStarted","Data":"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18"}
Aug 05 16:23:02.782691 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:02.782268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerStarted","Data":"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c"}
Aug 05 16:23:02.782691 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:02.782308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerStarted","Data":"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817"}
Aug 05 16:23:02.782691 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:02.782339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerStarted","Data":"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd"}
Aug 05 16:23:02.782691 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:02.782388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerStarted","Data":"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508"}
Aug 05 16:23:02.784254 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:02.784231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerStarted","Data":"d2595e8ecdcf4054a2d3a3e847c7bc72bd3c45c941f2885ff0eaddd976a171b5"}
Aug 05 16:23:02.784339 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:02.784288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerStarted","Data":"a2834a038fc9c4a156b9a8b28a0169c55e345fb0bc75b88cbd5f7dce90ef75e8"}
Aug 05 16:23:04.798115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:04.798075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerStarted","Data":"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf"}
Aug 05 16:23:04.829282 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:04.829225    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.898589872 podStartE2EDuration="19.829204976s" totalImagesPullingTime="8.912971906s" totalInitContainerRuntime="17.643198ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:04.827603759 +0000 UTC m=+106.163401703" watchObservedRunningTime="2026-08-05 16:23:04.829204976 +0000 UTC m=+106.165003220"
Aug 05 16:23:05.805496 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:05.805426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerStarted","Data":"da3be7e4f82f0ad239cdfd19358bdbbda527133d6c27f539e0e99495bbf70471"}
Aug 05 16:23:05.805802 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:05.805513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerStarted","Data":"4c32dfeae2285e4a0e34242203b23cb13fcd2f41ce3a5158be243265644903e8"}
Aug 05 16:23:05.805802 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:05.805548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerStarted","Data":"abcbccccd223199489104e2008a9f098181b13e2538dd3824fab0d9f8fd06c65"}
Aug 05 16:23:05.805802 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:05.805575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerStarted","Data":"f47c1716922014b867bcff1154972d3cff987f551a035e43b6b6b77fda626b3a"}
Aug 05 16:23:05.845569 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:05.845511    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.198381784 podStartE2EDuration="14.84548869s" totalImagesPullingTime="11.606323242s" totalInitContainerRuntime="40.783664ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:05.844389361 +0000 UTC m=+107.180187307" watchObservedRunningTime="2026-08-05 16:23:05.84548869 +0000 UTC m=+107.181286635"
Aug 05 16:23:06.841165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:06.841131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:23:09.672149 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:09.672112    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:23:09.672577 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:09.672198    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:23:23.763560 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:23.763519    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt" podUID="77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" containerName="registry" containerID="cri-o://3e59bbeaf7ce15636e46f7930fba170263e9a21e74c8490a4a221116e85cbea3" gracePeriod=30
Aug 05 16:23:23.894661 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:23.894627    2579 generic.go:356] "Generic (PLEG): container finished" podID="77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" containerID="3e59bbeaf7ce15636e46f7930fba170263e9a21e74c8490a4a221116e85cbea3" exitCode=0
Aug 05 16:23:23.894817 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:23.894681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt" event={"ID":"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7","Type":"ContainerDied","Data":"3e59bbeaf7ce15636e46f7930fba170263e9a21e74c8490a4a221116e85cbea3"}
Aug 05 16:23:24.001513 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.001489    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:23:24.105820 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.105736    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") pod \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") "
Aug 05 16:23:24.105820 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.105771    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-trusted-ca\") pod \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") "
Aug 05 16:23:24.105820 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.105805    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-certificates\") pod \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") "
Aug 05 16:23:24.106038 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.105842    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-bound-sa-token\") pod \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") "
Aug 05 16:23:24.106038 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.105878    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-ca-trust-extracted\") pod \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") "
Aug 05 16:23:24.106038 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.105935    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-installation-pull-secrets\") pod \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") "
Aug 05 16:23:24.106038 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.105969    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc2mn\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-kube-api-access-sc2mn\") pod \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") "
Aug 05 16:23:24.106038 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.106011    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-image-registry-private-configuration\") pod \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\" (UID: \"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7\") "
Aug 05 16:23:24.106295 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.106267    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:23:24.106375 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.106323    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:23:24.108274 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.108245    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:23:24.108487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.108364    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:23:24.108661 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.108630    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-kube-api-access-sc2mn" (OuterVolumeSpecName: "kube-api-access-sc2mn") pod "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7"). InnerVolumeSpecName "kube-api-access-sc2mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:23:24.108737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.108710    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:23:24.108807 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.108789    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:23:24.117328 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.117296    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" (UID: "77ca1d8d-d7c9-4199-9d4f-9a405b4905c7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:23:24.207098 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.207051    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:24.207098 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.207093    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-trusted-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:24.207098 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.207103    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-registry-certificates\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:24.207098 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.207114    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-bound-sa-token\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:24.207389 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.207122    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-ca-trust-extracted\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:24.207389 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.207130    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-installation-pull-secrets\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:24.207389 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.207139    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc2mn\" (UniqueName: \"kubernetes.io/projected/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-kube-api-access-sc2mn\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:24.207389 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.207152    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7-image-registry-private-configuration\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:24.899717 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.899687    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt"
Aug 05 16:23:24.900192 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.899685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fbdc8b4fb-whvkt" event={"ID":"77ca1d8d-d7c9-4199-9d4f-9a405b4905c7","Type":"ContainerDied","Data":"bdf210fb5284fc2b3c6bf46ab1d312122c09218b541c8392afbe48b81d09ef37"}
Aug 05 16:23:24.900192 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.899818    2579 scope.go:117] "RemoveContainer" containerID="3e59bbeaf7ce15636e46f7930fba170263e9a21e74c8490a4a221116e85cbea3"
Aug 05 16:23:24.921782 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.921750    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fbdc8b4fb-whvkt"]
Aug 05 16:23:24.926494 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:24.926472    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fbdc8b4fb-whvkt"]
Aug 05 16:23:25.187666 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:25.187636    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" path="/var/lib/kubelet/pods/77ca1d8d-d7c9-4199-9d4f-9a405b4905c7/volumes"
Aug 05 16:23:25.875210 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:25.875154    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54f77877d8-24ks4" podUID="2f5e727b-04fb-4201-a555-70d9445f7a10" containerName="console" containerID="cri-o://1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156" gracePeriod=15
Aug 05 16:23:26.110406 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.110384    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:23:26.222819 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.222785    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-oauth-config\") pod \"2f5e727b-04fb-4201-a555-70d9445f7a10\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") "
Aug 05 16:23:26.222987 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.222834    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-oauth-serving-cert\") pod \"2f5e727b-04fb-4201-a555-70d9445f7a10\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") "
Aug 05 16:23:26.222987 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.222861    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-console-config\") pod \"2f5e727b-04fb-4201-a555-70d9445f7a10\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") "
Aug 05 16:23:26.222987 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.222890    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-serving-cert\") pod \"2f5e727b-04fb-4201-a555-70d9445f7a10\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") "
Aug 05 16:23:26.222987 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.222911    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xrfk\" (UniqueName: \"kubernetes.io/projected/2f5e727b-04fb-4201-a555-70d9445f7a10-kube-api-access-8xrfk\") pod \"2f5e727b-04fb-4201-a555-70d9445f7a10\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") "
Aug 05 16:23:26.222987 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.222945    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-service-ca\") pod \"2f5e727b-04fb-4201-a555-70d9445f7a10\" (UID: \"2f5e727b-04fb-4201-a555-70d9445f7a10\") "
Aug 05 16:23:26.223447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.223405    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-console-config" (OuterVolumeSpecName: "console-config") pod "2f5e727b-04fb-4201-a555-70d9445f7a10" (UID: "2f5e727b-04fb-4201-a555-70d9445f7a10"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:23:26.223559 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.223422    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f5e727b-04fb-4201-a555-70d9445f7a10" (UID: "2f5e727b-04fb-4201-a555-70d9445f7a10"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:23:26.223559 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.223537    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f5e727b-04fb-4201-a555-70d9445f7a10" (UID: "2f5e727b-04fb-4201-a555-70d9445f7a10"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:23:26.225275 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.225254    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f5e727b-04fb-4201-a555-70d9445f7a10" (UID: "2f5e727b-04fb-4201-a555-70d9445f7a10"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:23:26.225369 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.225299    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f5e727b-04fb-4201-a555-70d9445f7a10" (UID: "2f5e727b-04fb-4201-a555-70d9445f7a10"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:23:26.225369 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.225355    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5e727b-04fb-4201-a555-70d9445f7a10-kube-api-access-8xrfk" (OuterVolumeSpecName: "kube-api-access-8xrfk") pod "2f5e727b-04fb-4201-a555-70d9445f7a10" (UID: "2f5e727b-04fb-4201-a555-70d9445f7a10"). InnerVolumeSpecName "kube-api-access-8xrfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:23:26.323893 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.323852    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-serving-cert\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:26.323893 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.323890    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xrfk\" (UniqueName: \"kubernetes.io/projected/2f5e727b-04fb-4201-a555-70d9445f7a10-kube-api-access-8xrfk\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:26.323893 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.323902    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:26.324132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.323914    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f5e727b-04fb-4201-a555-70d9445f7a10-console-oauth-config\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:26.324132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.323925    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-oauth-serving-cert\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:26.324132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.323936    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f5e727b-04fb-4201-a555-70d9445f7a10-console-config\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:23:26.910275 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.910240    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f5e727b-04fb-4201-a555-70d9445f7a10" containerID="1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156" exitCode=0
Aug 05 16:23:26.910462 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.910289    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f77877d8-24ks4"
Aug 05 16:23:26.910462 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.910294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f77877d8-24ks4" event={"ID":"2f5e727b-04fb-4201-a555-70d9445f7a10","Type":"ContainerDied","Data":"1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156"}
Aug 05 16:23:26.910462 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.910363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f77877d8-24ks4" event={"ID":"2f5e727b-04fb-4201-a555-70d9445f7a10","Type":"ContainerDied","Data":"b0e56c58f0248193525466e7a000aa78b6a8e3395821bcad685473b6ff963c84"}
Aug 05 16:23:26.910462 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.910369    2579 scope.go:117] "RemoveContainer" containerID="1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156"
Aug 05 16:23:26.918638 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.918624    2579 scope.go:117] "RemoveContainer" containerID="1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156"
Aug 05 16:23:26.918899 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:23:26.918877    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156\": container with ID starting with 1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156 not found: ID does not exist" containerID="1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156"
Aug 05 16:23:26.918941 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.918908    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156"} err="failed to get container status \"1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156\": rpc error: code = NotFound desc = could not find container \"1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156\": container with ID starting with 1083f03513a3b6bd5d43d7ae5bed227bf4d6f53662a35f1c3789fb19b2b41156 not found: ID does not exist"
Aug 05 16:23:26.933202 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.933181    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f77877d8-24ks4"]
Aug 05 16:23:26.939083 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:26.939059    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f77877d8-24ks4"]
Aug 05 16:23:27.188533 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:27.188496    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f5e727b-04fb-4201-a555-70d9445f7a10" path="/var/lib/kubelet/pods/2f5e727b-04fb-4201-a555-70d9445f7a10/volumes"
Aug 05 16:23:29.676806 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:29.676771    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:23:29.680679 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:29.680587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68975f9ffc-9d55f"
Aug 05 16:23:51.841747 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:51.841711    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:23:51.861514 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:51.861486    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:23:52.021153 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:23:52.021123    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:05.536180 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:05.536144    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:24:05.536723 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:05.536589    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="alertmanager" containerID="cri-o://07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508" gracePeriod=120
Aug 05 16:24:05.536723 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:05.536631    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy-metric" containerID="cri-o://8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18" gracePeriod=120
Aug 05 16:24:05.536833 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:05.536768    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy" containerID="cri-o://e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c" gracePeriod=120
Aug 05 16:24:05.536889 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:05.536874    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy-web" containerID="cri-o://e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817" gracePeriod=120
Aug 05 16:24:05.537010 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:05.536953    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="prom-label-proxy" containerID="cri-o://0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf" gracePeriod=120
Aug 05 16:24:05.537098 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:05.536961    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="config-reloader" containerID="cri-o://b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd" gracePeriod=120
Aug 05 16:24:06.065943 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.065909    2579 generic.go:356] "Generic (PLEG): container finished" podID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerID="0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf" exitCode=0
Aug 05 16:24:06.065943 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.065933    2579 generic.go:356] "Generic (PLEG): container finished" podID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerID="e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c" exitCode=0
Aug 05 16:24:06.065943 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.065939    2579 generic.go:356] "Generic (PLEG): container finished" podID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerID="b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd" exitCode=0
Aug 05 16:24:06.065943 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.065944    2579 generic.go:356] "Generic (PLEG): container finished" podID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerID="07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508" exitCode=0
Aug 05 16:24:06.066191 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.065978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerDied","Data":"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf"}
Aug 05 16:24:06.066191 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.066040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerDied","Data":"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c"}
Aug 05 16:24:06.066191 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.066068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerDied","Data":"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd"}
Aug 05 16:24:06.066191 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.066093    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerDied","Data":"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508"}
Aug 05 16:24:06.785302 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.785277    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:06.852037 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.851939    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgl8v\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-kube-api-access-mgl8v\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852037 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.851983    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-web-config\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852037 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852011    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852048    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-web\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852068    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852091    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-tls-assets\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852128    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-volume\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852164    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-cluster-tls-config\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852197    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-main-db\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852229    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-metrics-client-ca\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-trusted-ca-bundle\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-out\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.852762 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.852332    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls\") pod \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\" (UID: \"8aea0c8d-20ab-4ff3-939a-8dd216dff735\") "
Aug 05 16:24:06.853184 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.853153    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:06.853734 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.853702    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:24:06.853921 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.853898    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:06.855836 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.855771    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:06.855939 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.855849    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-kube-api-access-mgl8v" (OuterVolumeSpecName: "kube-api-access-mgl8v") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "kube-api-access-mgl8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:24:06.856397 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.856367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:06.857261 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.857224    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-volume" (OuterVolumeSpecName: "config-volume") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:06.857338 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.857262    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:06.857622 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.857601    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-out" (OuterVolumeSpecName: "config-out") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:24:06.858337 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.858311    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:24:06.858681 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.858659    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:06.861863 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.861840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:06.868481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.868452    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-web-config" (OuterVolumeSpecName: "web-config") pod "8aea0c8d-20ab-4ff3-939a-8dd216dff735" (UID: "8aea0c8d-20ab-4ff3-939a-8dd216dff735"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:06.953165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953129    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgl8v\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-kube-api-access-mgl8v\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953155    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-web-config\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953167    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953177    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953187    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953196    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aea0c8d-20ab-4ff3-939a-8dd216dff735-tls-assets\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953205    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953213    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-cluster-tls-config\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953223    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-main-db\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953231    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-metrics-client-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953239    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aea0c8d-20ab-4ff3-939a-8dd216dff735-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953247    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aea0c8d-20ab-4ff3-939a-8dd216dff735-config-out\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:06.953394 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:06.953255    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aea0c8d-20ab-4ff3-939a-8dd216dff735-secret-alertmanager-main-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:07.072946 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.072907    2579 generic.go:356] "Generic (PLEG): container finished" podID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerID="8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18" exitCode=0
Aug 05 16:24:07.072946 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.072939    2579 generic.go:356] "Generic (PLEG): container finished" podID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerID="e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817" exitCode=0
Aug 05 16:24:07.073136 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.072970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerDied","Data":"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18"}
Aug 05 16:24:07.073136 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.072999    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.073136 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.073037    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerDied","Data":"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817"}
Aug 05 16:24:07.073136 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.073066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aea0c8d-20ab-4ff3-939a-8dd216dff735","Type":"ContainerDied","Data":"39533653787e0428cdc5646be1eca257ed3ea9af74849946c337a5a6cea94fde"}
Aug 05 16:24:07.073136 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.073098    2579 scope.go:117] "RemoveContainer" containerID="0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf"
Aug 05 16:24:07.080693 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.080643    2579 scope.go:117] "RemoveContainer" containerID="8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18"
Aug 05 16:24:07.087739 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.087724    2579 scope.go:117] "RemoveContainer" containerID="e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c"
Aug 05 16:24:07.094305 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.094287    2579 scope.go:117] "RemoveContainer" containerID="e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817"
Aug 05 16:24:07.099202 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.099179    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:24:07.102440 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.102299    2579 scope.go:117] "RemoveContainer" containerID="b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd"
Aug 05 16:24:07.104746 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.104728    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:24:07.109960 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.109943    2579 scope.go:117] "RemoveContainer" containerID="07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508"
Aug 05 16:24:07.118214 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.118197    2579 scope.go:117] "RemoveContainer" containerID="09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22"
Aug 05 16:24:07.125634 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.125613    2579 scope.go:117] "RemoveContainer" containerID="0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf"
Aug 05 16:24:07.125904 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:24:07.125882    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf\": container with ID starting with 0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf not found: ID does not exist" containerID="0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf"
Aug 05 16:24:07.125976 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.125911    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf"} err="failed to get container status \"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf\": rpc error: code = NotFound desc = could not find container \"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf\": container with ID starting with 0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf not found: ID does not exist"
Aug 05 16:24:07.125976 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.125928    2579 scope.go:117] "RemoveContainer" containerID="8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18"
Aug 05 16:24:07.126162 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:24:07.126143    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18\": container with ID starting with 8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18 not found: ID does not exist" containerID="8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18"
Aug 05 16:24:07.126199 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.126169    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18"} err="failed to get container status \"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18\": rpc error: code = NotFound desc = could not find container \"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18\": container with ID starting with 8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18 not found: ID does not exist"
Aug 05 16:24:07.126199 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.126188    2579 scope.go:117] "RemoveContainer" containerID="e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c"
Aug 05 16:24:07.126489 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:24:07.126473    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c\": container with ID starting with e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c not found: ID does not exist" containerID="e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c"
Aug 05 16:24:07.126541 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.126492    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c"} err="failed to get container status \"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c\": rpc error: code = NotFound desc = could not find container \"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c\": container with ID starting with e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c not found: ID does not exist"
Aug 05 16:24:07.126541 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.126506    2579 scope.go:117] "RemoveContainer" containerID="e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817"
Aug 05 16:24:07.126727 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:24:07.126708    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817\": container with ID starting with e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817 not found: ID does not exist" containerID="e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817"
Aug 05 16:24:07.126777 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.126732    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817"} err="failed to get container status \"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817\": rpc error: code = NotFound desc = could not find container \"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817\": container with ID starting with e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817 not found: ID does not exist"
Aug 05 16:24:07.126777 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.126746    2579 scope.go:117] "RemoveContainer" containerID="b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd"
Aug 05 16:24:07.126993 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:24:07.126976    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd\": container with ID starting with b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd not found: ID does not exist" containerID="b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd"
Aug 05 16:24:07.127031 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.126995    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd"} err="failed to get container status \"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd\": rpc error: code = NotFound desc = could not find container \"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd\": container with ID starting with b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd not found: ID does not exist"
Aug 05 16:24:07.127031 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127008    2579 scope.go:117] "RemoveContainer" containerID="07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508"
Aug 05 16:24:07.127232 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:24:07.127216    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508\": container with ID starting with 07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508 not found: ID does not exist" containerID="07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508"
Aug 05 16:24:07.127278 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127235    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508"} err="failed to get container status \"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508\": rpc error: code = NotFound desc = could not find container \"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508\": container with ID starting with 07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508 not found: ID does not exist"
Aug 05 16:24:07.127278 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127248    2579 scope.go:117] "RemoveContainer" containerID="09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22"
Aug 05 16:24:07.127467 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:24:07.127452    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22\": container with ID starting with 09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22 not found: ID does not exist" containerID="09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22"
Aug 05 16:24:07.127510 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127471    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22"} err="failed to get container status \"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22\": rpc error: code = NotFound desc = could not find container \"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22\": container with ID starting with 09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22 not found: ID does not exist"
Aug 05 16:24:07.127510 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127483    2579 scope.go:117] "RemoveContainer" containerID="0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf"
Aug 05 16:24:07.127696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127680    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf"} err="failed to get container status \"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf\": rpc error: code = NotFound desc = could not find container \"0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf\": container with ID starting with 0269bc0d9e3ec1167e61b160b93b58d54fadac827592455954c1bf1c9aa077bf not found: ID does not exist"
Aug 05 16:24:07.127696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127695    2579 scope.go:117] "RemoveContainer" containerID="8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18"
Aug 05 16:24:07.127906 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127891    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18"} err="failed to get container status \"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18\": rpc error: code = NotFound desc = could not find container \"8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18\": container with ID starting with 8e1d237bc9804c4516e3872ff2f4c5ff8bc7d0107532bb1c18fe61586fe75d18 not found: ID does not exist"
Aug 05 16:24:07.127947 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.127906    2579 scope.go:117] "RemoveContainer" containerID="e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c"
Aug 05 16:24:07.128094 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128077    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c"} err="failed to get container status \"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c\": rpc error: code = NotFound desc = could not find container \"e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c\": container with ID starting with e371d8e65fcbecbcb736696948aabbdc267506edb4aa1080806ddfb5621cb30c not found: ID does not exist"
Aug 05 16:24:07.128135 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128095    2579 scope.go:117] "RemoveContainer" containerID="e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817"
Aug 05 16:24:07.128302 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128287    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817"} err="failed to get container status \"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817\": rpc error: code = NotFound desc = could not find container \"e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817\": container with ID starting with e8145b560bd516ad839a52da0922bf7c9dd8dc4660c89d63bb133028a1143817 not found: ID does not exist"
Aug 05 16:24:07.128302 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128301    2579 scope.go:117] "RemoveContainer" containerID="b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd"
Aug 05 16:24:07.128555 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128538    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd"} err="failed to get container status \"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd\": rpc error: code = NotFound desc = could not find container \"b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd\": container with ID starting with b4afba86ba6f29f5dfd7c8c382ae160a4b4c978755fec5fdbc8baf861882c9fd not found: ID does not exist"
Aug 05 16:24:07.128607 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128556    2579 scope.go:117] "RemoveContainer" containerID="07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508"
Aug 05 16:24:07.128760 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128742    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508"} err="failed to get container status \"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508\": rpc error: code = NotFound desc = could not find container \"07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508\": container with ID starting with 07aa5c1aa00f8b31c43006a8c014953deb6d54fa7ae53af9a14e5c2745eba508 not found: ID does not exist"
Aug 05 16:24:07.128760 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128757    2579 scope.go:117] "RemoveContainer" containerID="09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22"
Aug 05 16:24:07.128945 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.128926    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22"} err="failed to get container status \"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22\": rpc error: code = NotFound desc = could not find container \"09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22\": container with ID starting with 09c756ce40a2a0e1ed0f7ff90155450309705aca0b107cd178a681b44ef95d22 not found: ID does not exist"
Aug 05 16:24:07.132864 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.132842    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:24:07.133148 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133134    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="config-reloader"
Aug 05 16:24:07.133225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133151    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="config-reloader"
Aug 05 16:24:07.133225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133167    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy"
Aug 05 16:24:07.133225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133176    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy"
Aug 05 16:24:07.133225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133189    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="alertmanager"
Aug 05 16:24:07.133225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133200    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="alertmanager"
Aug 05 16:24:07.133225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133217    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy-metric"
Aug 05 16:24:07.133225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133226    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy-metric"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133239    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" containerName="registry"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133247    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" containerName="registry"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133261    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f5e727b-04fb-4201-a555-70d9445f7a10" containerName="console"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133270    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f5e727b-04fb-4201-a555-70d9445f7a10" containerName="console"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133279    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="prom-label-proxy"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133287    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="prom-label-proxy"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133299    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="init-config-reloader"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133309    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="init-config-reloader"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133319    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy-web"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133327    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy-web"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133420    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy-metric"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133434    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="alertmanager"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133444    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="config-reloader"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133453    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy-web"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133462    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="prom-label-proxy"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133473    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="77ca1d8d-d7c9-4199-9d4f-9a405b4905c7" containerName="registry"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133482    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f5e727b-04fb-4201-a555-70d9445f7a10" containerName="console"
Aug 05 16:24:07.133574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.133490    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" containerName="kube-rbac-proxy"
Aug 05 16:24:07.137353 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.137319    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.140431 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.140413    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 05 16:24:07.140559 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.140542    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 05 16:24:07.140623 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.140571    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 05 16:24:07.141708 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.141687    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 05 16:24:07.142782 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.142467    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 05 16:24:07.142782 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.142481    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 05 16:24:07.142956 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.142937    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 05 16:24:07.143087 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.143069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 05 16:24:07.145502 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.143673    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-njtmw\""
Aug 05 16:24:07.149878 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.149859    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 05 16:24:07.153619 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.153600    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:24:07.187935 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.187901    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aea0c8d-20ab-4ff3-939a-8dd216dff735" path="/var/lib/kubelet/pods/8aea0c8d-20ab-4ff3-939a-8dd216dff735/volumes"
Aug 05 16:24:07.254959 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.254923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.254966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.254988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwg5t\" (UniqueName: \"kubernetes.io/projected/96888ca6-cada-4716-b00f-2e332b838a79-kube-api-access-mwg5t\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96888ca6-cada-4716-b00f-2e332b838a79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96888ca6-cada-4716-b00f-2e332b838a79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96888ca6-cada-4716-b00f-2e332b838a79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96888ca6-cada-4716-b00f-2e332b838a79-config-out\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-web-config\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-config-volume\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.255447 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.255419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96888ca6-cada-4716-b00f-2e332b838a79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.355891 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.355804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-config-volume\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.355891 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.355856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96888ca6-cada-4716-b00f-2e332b838a79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356078 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.355969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356078 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356078 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwg5t\" (UniqueName: \"kubernetes.io/projected/96888ca6-cada-4716-b00f-2e332b838a79-kube-api-access-mwg5t\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356078 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96888ca6-cada-4716-b00f-2e332b838a79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356254 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356254 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96888ca6-cada-4716-b00f-2e332b838a79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356254 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96888ca6-cada-4716-b00f-2e332b838a79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356254 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96888ca6-cada-4716-b00f-2e332b838a79-config-out\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356254 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-web-config\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356524 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.356524 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.357104 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96888ca6-cada-4716-b00f-2e332b838a79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.357104 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.356822    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96888ca6-cada-4716-b00f-2e332b838a79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.357104 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.357093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96888ca6-cada-4716-b00f-2e332b838a79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.358923 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.358890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.359026 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.358936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96888ca6-cada-4716-b00f-2e332b838a79-config-out\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.359026 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.358972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.359026 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.358976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-config-volume\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.359466 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.359443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.359561 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.359450    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-web-config\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.359671 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.359653    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.359706 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.359668    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96888ca6-cada-4716-b00f-2e332b838a79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.360719 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.360702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96888ca6-cada-4716-b00f-2e332b838a79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.365125 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.365102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwg5t\" (UniqueName: \"kubernetes.io/projected/96888ca6-cada-4716-b00f-2e332b838a79-kube-api-access-mwg5t\") pod \"alertmanager-main-0\" (UID: \"96888ca6-cada-4716-b00f-2e332b838a79\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.449423 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.449393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:24:07.581285 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:07.581253    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:24:07.584279 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:24:07.584257    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96888ca6_cada_4716_b00f_2e332b838a79.slice/crio-2f23dabdbb4afd977b3e018a4e1b9a0786d9452f7e9790f096ecc9c9fb4520ed WatchSource:0}: Error finding container 2f23dabdbb4afd977b3e018a4e1b9a0786d9452f7e9790f096ecc9c9fb4520ed: Status 404 returned error can't find the container with id 2f23dabdbb4afd977b3e018a4e1b9a0786d9452f7e9790f096ecc9c9fb4520ed
Aug 05 16:24:08.079201 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:08.079170    2579 generic.go:356] "Generic (PLEG): container finished" podID="96888ca6-cada-4716-b00f-2e332b838a79" containerID="570bed932f1ecad9590a6176e942271d160f15159f3036a02b9d0d7948a885d3" exitCode=0
Aug 05 16:24:08.079594 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:08.079266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96888ca6-cada-4716-b00f-2e332b838a79","Type":"ContainerDied","Data":"570bed932f1ecad9590a6176e942271d160f15159f3036a02b9d0d7948a885d3"}
Aug 05 16:24:08.079594 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:08.079333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96888ca6-cada-4716-b00f-2e332b838a79","Type":"ContainerStarted","Data":"2f23dabdbb4afd977b3e018a4e1b9a0786d9452f7e9790f096ecc9c9fb4520ed"}
Aug 05 16:24:09.086764 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.086728    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96888ca6-cada-4716-b00f-2e332b838a79","Type":"ContainerStarted","Data":"89d22e96ab6319476d8a82779369703a0fa02e24a77cf0ab7e0c79f2a038aba9"}
Aug 05 16:24:09.087209 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.086792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96888ca6-cada-4716-b00f-2e332b838a79","Type":"ContainerStarted","Data":"ae42daa520054837cc50160bcc7ea031b9ebda99113a246e45a0a91c0a365395"}
Aug 05 16:24:09.087209 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.086837    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96888ca6-cada-4716-b00f-2e332b838a79","Type":"ContainerStarted","Data":"c8745bcca917e29035a63cfa4642aca6fe3f28f299f3d03ea159d54ab5658a4e"}
Aug 05 16:24:09.087209 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.086865    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96888ca6-cada-4716-b00f-2e332b838a79","Type":"ContainerStarted","Data":"bad3c8806f89069f7933f29c136d71cd18919c64af65671a71d5ba0514a7ed7c"}
Aug 05 16:24:09.087209 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.086888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96888ca6-cada-4716-b00f-2e332b838a79","Type":"ContainerStarted","Data":"85bfef2a63a36673fdca5b75db67c0772d01f750fa61676a8280c04aca8fa261"}
Aug 05 16:24:09.087209 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.086919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96888ca6-cada-4716-b00f-2e332b838a79","Type":"ContainerStarted","Data":"4db97d89bb453e140a612a569d3f60f07048a09cbb0bfb2ac66a9472625582b0"}
Aug 05 16:24:09.118510 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.118451    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.102465101 podStartE2EDuration="2.118429353s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.964252ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:09.117260179 +0000 UTC m=+170.453058144" watchObservedRunningTime="2026-08-05 16:24:09.118429353 +0000 UTC m=+170.454227297"
Aug 05 16:24:09.602520 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.602486    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-f796fc9f9-75ccq"]
Aug 05 16:24:09.605022 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.605002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.608556 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.608531    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 05 16:24:09.608663 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.608531    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 05 16:24:09.608663 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.608532    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 05 16:24:09.608663 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.608531    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 05 16:24:09.608819 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.608531    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 05 16:24:09.608819 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.608579    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kl7n7\""
Aug 05 16:24:09.613481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.613463    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 05 16:24:09.619307 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.619289    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f796fc9f9-75ccq"]
Aug 05 16:24:09.677792 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.677762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.677976 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.677802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-secret-telemeter-client\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.677976 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.677822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4sj9\" (UniqueName: \"kubernetes.io/projected/01565972-f35a-4332-8408-34ff199fa5d7-kube-api-access-m4sj9\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.677976 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.677880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-serving-certs-ca-bundle\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.678122 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.677993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.678122 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.678044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-metrics-client-ca\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.678122 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.678075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-telemeter-client-tls\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.678248 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.678136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-federate-client-tls\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.778570 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.778525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-serving-certs-ca-bundle\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.778759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.778587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.778759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.778610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-metrics-client-ca\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.778759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.778635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-telemeter-client-tls\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.778759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.778665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-federate-client-tls\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.778759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.778705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.778759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.778750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-secret-telemeter-client\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.779074 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.778775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4sj9\" (UniqueName: \"kubernetes.io/projected/01565972-f35a-4332-8408-34ff199fa5d7-kube-api-access-m4sj9\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.779445 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.779391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-metrics-client-ca\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.779445 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.779400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-serving-certs-ca-bundle\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.779787 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.779768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01565972-f35a-4332-8408-34ff199fa5d7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.781664 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.781632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-secret-telemeter-client\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.781745 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.781728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.781811 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.781749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-federate-client-tls\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.781811 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.781778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01565972-f35a-4332-8408-34ff199fa5d7-telemeter-client-tls\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.787982 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.787957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4sj9\" (UniqueName: \"kubernetes.io/projected/01565972-f35a-4332-8408-34ff199fa5d7-kube-api-access-m4sj9\") pod \"telemeter-client-f796fc9f9-75ccq\" (UID: \"01565972-f35a-4332-8408-34ff199fa5d7\") " pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:09.881202 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.881122    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:09.881434 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.881404    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="prometheus" containerID="cri-o://a2834a038fc9c4a156b9a8b28a0169c55e345fb0bc75b88cbd5f7dce90ef75e8" gracePeriod=600
Aug 05 16:24:09.881434 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.881417    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy" containerID="cri-o://4c32dfeae2285e4a0e34242203b23cb13fcd2f41ce3a5158be243265644903e8" gracePeriod=600
Aug 05 16:24:09.881621 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.881450    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy-web" containerID="cri-o://abcbccccd223199489104e2008a9f098181b13e2538dd3824fab0d9f8fd06c65" gracePeriod=600
Aug 05 16:24:09.881621 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.881470    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="config-reloader" containerID="cri-o://d2595e8ecdcf4054a2d3a3e847c7bc72bd3c45c941f2885ff0eaddd976a171b5" gracePeriod=600
Aug 05 16:24:09.881621 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.881483    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy-thanos" containerID="cri-o://da3be7e4f82f0ad239cdfd19358bdbbda527133d6c27f539e0e99495bbf70471" gracePeriod=600
Aug 05 16:24:09.881621 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.881430    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="thanos-sidecar" containerID="cri-o://f47c1716922014b867bcff1154972d3cff987f551a035e43b6b6b77fda626b3a" gracePeriod=600
Aug 05 16:24:09.915171 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:09.915144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq"
Aug 05 16:24:10.055299 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.055275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f796fc9f9-75ccq"]
Aug 05 16:24:10.057214 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:24:10.057186    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01565972_f35a_4332_8408_34ff199fa5d7.slice/crio-b53a3031be20fad77671ecea48b5729609f8faab80724f94b451dadca332dbd6 WatchSource:0}: Error finding container b53a3031be20fad77671ecea48b5729609f8faab80724f94b451dadca332dbd6: Status 404 returned error can't find the container with id b53a3031be20fad77671ecea48b5729609f8faab80724f94b451dadca332dbd6
Aug 05 16:24:10.092520 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.092491    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq" event={"ID":"01565972-f35a-4332-8408-34ff199fa5d7","Type":"ContainerStarted","Data":"b53a3031be20fad77671ecea48b5729609f8faab80724f94b451dadca332dbd6"}
Aug 05 16:24:10.095981 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.095956    2579 generic.go:356] "Generic (PLEG): container finished" podID="c75639ee-b611-4d0e-914f-3584b198ab06" containerID="da3be7e4f82f0ad239cdfd19358bdbbda527133d6c27f539e0e99495bbf70471" exitCode=0
Aug 05 16:24:10.095981 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.095977    2579 generic.go:356] "Generic (PLEG): container finished" podID="c75639ee-b611-4d0e-914f-3584b198ab06" containerID="4c32dfeae2285e4a0e34242203b23cb13fcd2f41ce3a5158be243265644903e8" exitCode=0
Aug 05 16:24:10.095981 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.095985    2579 generic.go:356] "Generic (PLEG): container finished" podID="c75639ee-b611-4d0e-914f-3584b198ab06" containerID="f47c1716922014b867bcff1154972d3cff987f551a035e43b6b6b77fda626b3a" exitCode=0
Aug 05 16:24:10.096146 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.095991    2579 generic.go:356] "Generic (PLEG): container finished" podID="c75639ee-b611-4d0e-914f-3584b198ab06" containerID="d2595e8ecdcf4054a2d3a3e847c7bc72bd3c45c941f2885ff0eaddd976a171b5" exitCode=0
Aug 05 16:24:10.096146 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.095998    2579 generic.go:356] "Generic (PLEG): container finished" podID="c75639ee-b611-4d0e-914f-3584b198ab06" containerID="a2834a038fc9c4a156b9a8b28a0169c55e345fb0bc75b88cbd5f7dce90ef75e8" exitCode=0
Aug 05 16:24:10.096146 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.096017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerDied","Data":"da3be7e4f82f0ad239cdfd19358bdbbda527133d6c27f539e0e99495bbf70471"}
Aug 05 16:24:10.096146 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.096074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerDied","Data":"4c32dfeae2285e4a0e34242203b23cb13fcd2f41ce3a5158be243265644903e8"}
Aug 05 16:24:10.096146 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.096110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerDied","Data":"f47c1716922014b867bcff1154972d3cff987f551a035e43b6b6b77fda626b3a"}
Aug 05 16:24:10.096146 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.096137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerDied","Data":"d2595e8ecdcf4054a2d3a3e847c7bc72bd3c45c941f2885ff0eaddd976a171b5"}
Aug 05 16:24:10.096316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:10.096163    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerDied","Data":"a2834a038fc9c4a156b9a8b28a0169c55e345fb0bc75b88cbd5f7dce90ef75e8"}
Aug 05 16:24:11.104386 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.104328    2579 generic.go:356] "Generic (PLEG): container finished" podID="c75639ee-b611-4d0e-914f-3584b198ab06" containerID="abcbccccd223199489104e2008a9f098181b13e2538dd3824fab0d9f8fd06c65" exitCode=0
Aug 05 16:24:11.104748 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.104411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerDied","Data":"abcbccccd223199489104e2008a9f098181b13e2538dd3824fab0d9f8fd06c65"}
Aug 05 16:24:11.133326 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.133300    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:11.197485 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197456    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-kube-rbac-proxy\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.197658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197509    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-kubelet-serving-ca-bundle\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.197658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197534    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-2\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.197658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197551    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-metrics-client-certs\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.197658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197579    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-db\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.197658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197599    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-trusted-ca-bundle\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.197658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197628    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-serving-certs-ca-bundle\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.197658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197654    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-web-config\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198017 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.197678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198147 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198119    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:11.198213 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-tls\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198289 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198273    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fktwp\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-kube-api-access-fktwp\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198354 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-config\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198415 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198371    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-thanos-prometheus-http-client-file\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198415 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198404    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198522 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198435    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-grpc-tls\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198522 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198470    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-metrics-client-ca\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198522 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198495    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-tls-assets\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198668 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198533    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-config-out\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.198668 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:11.198668 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-0\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.198919    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.199259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.199298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-1\") pod \"c75639ee-b611-4d0e-914f-3584b198ab06\" (UID: \"c75639ee-b611-4d0e-914f-3584b198ab06\") "
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.199600    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.199602    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.199622    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-db\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.199638    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.199652    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.199988    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:11.201231 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.200328    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:11.201859 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.201747    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:11.202184 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.202157    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.204069 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.204039    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-kube-api-access-fktwp" (OuterVolumeSpecName: "kube-api-access-fktwp") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "kube-api-access-fktwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:24:11.204354 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.204297    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.204724 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.204687    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.205494 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.205465    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.206451 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.206412    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.206694 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.206652    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.206802 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.206704    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.206802 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.206787    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-config" (OuterVolumeSpecName: "config") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.206946 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.206929    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:24:11.207013 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.206994    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-config-out" (OuterVolumeSpecName: "config-out") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:24:11.213725 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.213691    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-web-config" (OuterVolumeSpecName: "web-config") pod "c75639ee-b611-4d0e-914f-3584b198ab06" (UID: "c75639ee-b611-4d0e-914f-3584b198ab06"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:11.300696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300611    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c75639ee-b611-4d0e-914f-3584b198ab06-config-out\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.300696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300648    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.300696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300663    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.300696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300676    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-kube-rbac-proxy\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.300696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300686    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.300696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300695    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-metrics-client-certs\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300706    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-web-config\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300720    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300730    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300738    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fktwp\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-kube-api-access-fktwp\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300745    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-config\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300754    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300764    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300772    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c75639ee-b611-4d0e-914f-3584b198ab06-secret-grpc-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300780    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75639ee-b611-4d0e-914f-3584b198ab06-configmap-metrics-client-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:11.301129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:11.300788    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c75639ee-b611-4d0e-914f-3584b198ab06-tls-assets\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:24:12.113647 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.113556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c75639ee-b611-4d0e-914f-3584b198ab06","Type":"ContainerDied","Data":"6bc5cb97c5c3ed2479af7e70fbc898b650ec44112e675848d67eef096b1f8c83"}
Aug 05 16:24:12.113647 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.113570    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.114119 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.113657    2579 scope.go:117] "RemoveContainer" containerID="da3be7e4f82f0ad239cdfd19358bdbbda527133d6c27f539e0e99495bbf70471"
Aug 05 16:24:12.143675 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.143637    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:12.148415 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.148381    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:12.167048 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.166999    2579 scope.go:117] "RemoveContainer" containerID="4c32dfeae2285e4a0e34242203b23cb13fcd2f41ce3a5158be243265644903e8"
Aug 05 16:24:12.177852 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.177822    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:12.178134 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178122    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="prometheus"
Aug 05 16:24:12.178179 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178136    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="prometheus"
Aug 05 16:24:12.178179 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178147    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="thanos-sidecar"
Aug 05 16:24:12.178179 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178152    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="thanos-sidecar"
Aug 05 16:24:12.178179 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178161    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="init-config-reloader"
Aug 05 16:24:12.178179 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178167    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="init-config-reloader"
Aug 05 16:24:12.178179 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178178    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178183    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178193    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy-web"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178199    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy-web"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178206    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="config-reloader"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178212    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="config-reloader"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178219    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy-thanos"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178224    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy-thanos"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178273    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178280    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="config-reloader"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178286    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="thanos-sidecar"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178292    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy-thanos"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178300    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="kube-rbac-proxy-web"
Aug 05 16:24:12.178363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.178305    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" containerName="prometheus"
Aug 05 16:24:12.180778 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.180760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.184336 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.184293    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 05 16:24:12.184336 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.184334    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 05 16:24:12.184336 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.184340    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 05 16:24:12.184655 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.184607    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 05 16:24:12.184764 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.184657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 05 16:24:12.184764 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.184693    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 05 16:24:12.184764 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.184701    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 05 16:24:12.184891 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.184825    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6hhjifjmgesr6\""
Aug 05 16:24:12.185157 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.185142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-76fjr\""
Aug 05 16:24:12.185244 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.185228    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 05 16:24:12.185319 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.185294    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 05 16:24:12.185391 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.185318    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 05 16:24:12.185391 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.185338    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 05 16:24:12.185493 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.185426    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 05 16:24:12.187981 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.187961    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 05 16:24:12.190011 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.189994    2579 scope.go:117] "RemoveContainer" containerID="abcbccccd223199489104e2008a9f098181b13e2538dd3824fab0d9f8fd06c65"
Aug 05 16:24:12.191197 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.191103    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 05 16:24:12.202711 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.202687    2579 scope.go:117] "RemoveContainer" containerID="f47c1716922014b867bcff1154972d3cff987f551a035e43b6b6b77fda626b3a"
Aug 05 16:24:12.209520 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.209498    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:12.214850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.214832    2579 scope.go:117] "RemoveContainer" containerID="d2595e8ecdcf4054a2d3a3e847c7bc72bd3c45c941f2885ff0eaddd976a171b5"
Aug 05 16:24:12.223286 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.223265    2579 scope.go:117] "RemoveContainer" containerID="a2834a038fc9c4a156b9a8b28a0169c55e345fb0bc75b88cbd5f7dce90ef75e8"
Aug 05 16:24:12.235286 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.235267    2579 scope.go:117] "RemoveContainer" containerID="00a8140d51a26a37ca7459c8e2501e107cd30e6544077615983fb639b1fbf9f9"
Aug 05 16:24:12.309762 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.309731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.309893 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.309783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-config\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.309893 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.309808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6ab1825-4475-4acb-b329-1a9e592463c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.309893 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.309846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.309893 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.309870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.309894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2k8d\" (UniqueName: \"kubernetes.io/projected/c6ab1825-4475-4acb-b329-1a9e592463c1-kube-api-access-p2k8d\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.309919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.309983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6ab1825-4475-4acb-b329-1a9e592463c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310253 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310253 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310310 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310310 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310310 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310426 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310314    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.310426 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.310334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411731 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-config\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411731 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6ab1825-4475-4acb-b329-1a9e592463c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411934 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411934 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411934 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2k8d\" (UniqueName: \"kubernetes.io/projected/c6ab1825-4475-4acb-b329-1a9e592463c1-kube-api-access-p2k8d\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411934 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411934 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6ab1825-4475-4acb-b329-1a9e592463c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411934 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.411934 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.411999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412269 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.412851 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.412821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.413304 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.413173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.413533 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.413434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.414112 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.414088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.414669 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.414643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.414751 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.414727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.416279 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.416238    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.417038 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.416985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.417508 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.417460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.417651 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.417598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.417723 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.417646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6ab1825-4475-4acb-b329-1a9e592463c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.418124 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.418102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.418543 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.418523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6ab1825-4475-4acb-b329-1a9e592463c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.418617 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.418562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.418774 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.418756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6ab1825-4475-4acb-b329-1a9e592463c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.418872 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.418859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.419118 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.419092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-config\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.419452 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.419427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6ab1825-4475-4acb-b329-1a9e592463c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.421067 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.421048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2k8d\" (UniqueName: \"kubernetes.io/projected/c6ab1825-4475-4acb-b329-1a9e592463c1-kube-api-access-p2k8d\") pod \"prometheus-k8s-0\" (UID: \"c6ab1825-4475-4acb-b329-1a9e592463c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.491238 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.491195    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.632026 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:12.631934    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:12.634929 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:24:12.634902    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ab1825_4475_4acb_b329_1a9e592463c1.slice/crio-c563ab0e0a47ec9d695791d6d56a5493b4eb4928485aea6e1b3c3c6fdf6d2f3a WatchSource:0}: Error finding container c563ab0e0a47ec9d695791d6d56a5493b4eb4928485aea6e1b3c3c6fdf6d2f3a: Status 404 returned error can't find the container with id c563ab0e0a47ec9d695791d6d56a5493b4eb4928485aea6e1b3c3c6fdf6d2f3a
Aug 05 16:24:13.119564 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:13.119527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq" event={"ID":"01565972-f35a-4332-8408-34ff199fa5d7","Type":"ContainerStarted","Data":"a8faea00382132084aef6cc07bb149264b6b99cc81766ae1e1caaa5a285695a6"}
Aug 05 16:24:13.120017 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:13.119582    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq" event={"ID":"01565972-f35a-4332-8408-34ff199fa5d7","Type":"ContainerStarted","Data":"5c2c737d930b080e9cd674d330c5291863f060cc71d459ce438f6787db978814"}
Aug 05 16:24:13.120017 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:13.119600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq" event={"ID":"01565972-f35a-4332-8408-34ff199fa5d7","Type":"ContainerStarted","Data":"4a21064b336c679b55a63694a826c443a858ad30526968cb9f0cbf2568529d8e"}
Aug 05 16:24:13.121141 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:13.121118    2579 generic.go:356] "Generic (PLEG): container finished" podID="c6ab1825-4475-4acb-b329-1a9e592463c1" containerID="0bdde7c24a539f0073f42c3b773a6719a91e4ece2836c59be997866a6eda23c8" exitCode=0
Aug 05 16:24:13.121234 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:13.121205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6ab1825-4475-4acb-b329-1a9e592463c1","Type":"ContainerDied","Data":"0bdde7c24a539f0073f42c3b773a6719a91e4ece2836c59be997866a6eda23c8"}
Aug 05 16:24:13.121383 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:13.121267    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6ab1825-4475-4acb-b329-1a9e592463c1","Type":"ContainerStarted","Data":"c563ab0e0a47ec9d695791d6d56a5493b4eb4928485aea6e1b3c3c6fdf6d2f3a"}
Aug 05 16:24:13.150803 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:13.150749    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-f796fc9f9-75ccq" podStartSLOduration=2.002364032 podStartE2EDuration="4.150730076s" totalImagesPullingTime="2.148366044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:13.148408659 +0000 UTC m=+174.484206604" watchObservedRunningTime="2026-08-05 16:24:13.150730076 +0000 UTC m=+174.486528021"
Aug 05 16:24:13.188777 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:13.188749    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75639ee-b611-4d0e-914f-3584b198ab06" path="/var/lib/kubelet/pods/c75639ee-b611-4d0e-914f-3584b198ab06/volumes"
Aug 05 16:24:14.129898 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:14.129857    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6ab1825-4475-4acb-b329-1a9e592463c1","Type":"ContainerStarted","Data":"d72ce2aefcb9c9e1f1efaffe21d8a798ddbd80b12b53e949804d2450b19907d0"}
Aug 05 16:24:14.130261 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:14.129955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6ab1825-4475-4acb-b329-1a9e592463c1","Type":"ContainerStarted","Data":"68f64765a93e16e47691cd025b9199e232c7e3bacc60ada3f315b886ed3d8fe4"}
Aug 05 16:24:14.130261 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:14.129981    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6ab1825-4475-4acb-b329-1a9e592463c1","Type":"ContainerStarted","Data":"abcb2c7e4f138a4c244db7a4fe410ac891e57de360b81cee2581cbdf14d23aaf"}
Aug 05 16:24:14.130261 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:14.130015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6ab1825-4475-4acb-b329-1a9e592463c1","Type":"ContainerStarted","Data":"24770e0289282d426aa86e9ba23395cec5422b1521d5a3165a01025002ce4e08"}
Aug 05 16:24:14.130261 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:14.130038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6ab1825-4475-4acb-b329-1a9e592463c1","Type":"ContainerStarted","Data":"e2e86cc9dec3ee1df2d45512511334d34d27efc9f5bcbc3bb92814a6819a1a99"}
Aug 05 16:24:14.130261 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:14.130061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6ab1825-4475-4acb-b329-1a9e592463c1","Type":"ContainerStarted","Data":"0bb8b678da3947af985e9872d6a042550ed5543a2442e5beea69eb843c2f8246"}
Aug 05 16:24:14.160738 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:14.160687    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.1415423909999998 podStartE2EDuration="2.160668147s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.125756ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:14.158629846 +0000 UTC m=+175.494427802" watchObservedRunningTime="2026-08-05 16:24:14.160668147 +0000 UTC m=+175.496466091"
Aug 05 16:24:17.492015 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:24:17.491974    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:12.491961 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:25:12.491922    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:12.507289 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:25:12.507264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:13.370051 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:25:13.370028    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:26:19.093960 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:26:19.093934    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:26:19.098736 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:26:19.098715    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:26:19.100492 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:26:19.100472    2579 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 16:27:35.751428 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:35.751328    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"]
Aug 05 16:27:35.755053 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:35.755032    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"
Aug 05 16:27:35.758090 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:35.758070    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 05 16:27:35.758213 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:35.758138    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 05 16:27:35.758213 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:35.758166    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jr59n\""
Aug 05 16:27:35.764986 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:35.764965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"]
Aug 05 16:27:35.928513 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:35.928482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b91d49fb-1614-4df1-80bc-ee995b0c6b57-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9k26v\" (UID: \"b91d49fb-1614-4df1-80bc-ee995b0c6b57\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"
Aug 05 16:27:35.928699 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:35.928534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k52j9\" (UniqueName: \"kubernetes.io/projected/b91d49fb-1614-4df1-80bc-ee995b0c6b57-kube-api-access-k52j9\") pod \"cert-manager-cainjector-559cdd8c87-9k26v\" (UID: \"b91d49fb-1614-4df1-80bc-ee995b0c6b57\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"
Aug 05 16:27:36.029562 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:36.029492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k52j9\" (UniqueName: \"kubernetes.io/projected/b91d49fb-1614-4df1-80bc-ee995b0c6b57-kube-api-access-k52j9\") pod \"cert-manager-cainjector-559cdd8c87-9k26v\" (UID: \"b91d49fb-1614-4df1-80bc-ee995b0c6b57\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"
Aug 05 16:27:36.029562 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:36.029553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b91d49fb-1614-4df1-80bc-ee995b0c6b57-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9k26v\" (UID: \"b91d49fb-1614-4df1-80bc-ee995b0c6b57\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"
Aug 05 16:27:36.043237 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:36.043217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b91d49fb-1614-4df1-80bc-ee995b0c6b57-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9k26v\" (UID: \"b91d49fb-1614-4df1-80bc-ee995b0c6b57\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"
Aug 05 16:27:36.043432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:36.043412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k52j9\" (UniqueName: \"kubernetes.io/projected/b91d49fb-1614-4df1-80bc-ee995b0c6b57-kube-api-access-k52j9\") pod \"cert-manager-cainjector-559cdd8c87-9k26v\" (UID: \"b91d49fb-1614-4df1-80bc-ee995b0c6b57\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"
Aug 05 16:27:36.064393 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:36.064369    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"
Aug 05 16:27:36.191440 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:36.191418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9k26v"]
Aug 05 16:27:36.193687 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:27:36.193654    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb91d49fb_1614_4df1_80bc_ee995b0c6b57.slice/crio-48d0c0488aecb53187f4c7004e552f43ee2e56b0934312e3c7ab36687042aaad WatchSource:0}: Error finding container 48d0c0488aecb53187f4c7004e552f43ee2e56b0934312e3c7ab36687042aaad: Status 404 returned error can't find the container with id 48d0c0488aecb53187f4c7004e552f43ee2e56b0934312e3c7ab36687042aaad
Aug 05 16:27:36.195626 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:36.195608    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:27:36.912398 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:36.912355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v" event={"ID":"b91d49fb-1614-4df1-80bc-ee995b0c6b57","Type":"ContainerStarted","Data":"48d0c0488aecb53187f4c7004e552f43ee2e56b0934312e3c7ab36687042aaad"}
Aug 05 16:27:41.934145 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:41.934107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v" event={"ID":"b91d49fb-1614-4df1-80bc-ee995b0c6b57","Type":"ContainerStarted","Data":"3d46536306b3f6cfc9ef761e0cf62fbf97b4ef1ec612d24dcec6f0446dd62ad6"}
Aug 05 16:27:41.954332 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:27:41.954278    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9k26v" podStartSLOduration=2.151426481 podStartE2EDuration="6.954236691s" totalImagesPullingTime="4.80281021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:27:41.952119414 +0000 UTC m=+383.287917358" watchObservedRunningTime="2026-08-05 16:27:41.954236691 +0000 UTC m=+383.290034634"
Aug 05 16:28:06.380831 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.380796    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"]
Aug 05 16:28:06.385295 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.385275    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.390858 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.390837    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 16:28:06.391016 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.390999    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 16:28:06.391073 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.391058    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 16:28:06.391127 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.391109    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 16:28:06.392181 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.392161    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jcslj\""
Aug 05 16:28:06.406186 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.406164    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"]
Aug 05 16:28:06.463037 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.463010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb18316d-cafd-4441-bbdb-b7aa719a4d44-tmp\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.463156 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.463052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7tsx\" (UniqueName: \"kubernetes.io/projected/cb18316d-cafd-4441-bbdb-b7aa719a4d44-kube-api-access-c7tsx\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.463156 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.463078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb18316d-cafd-4441-bbdb-b7aa719a4d44-webhook-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.463226 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.463152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb18316d-cafd-4441-bbdb-b7aa719a4d44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.463226 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.463183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb18316d-cafd-4441-bbdb-b7aa719a4d44-manifests\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.564268 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.564236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7tsx\" (UniqueName: \"kubernetes.io/projected/cb18316d-cafd-4441-bbdb-b7aa719a4d44-kube-api-access-c7tsx\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.564525 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.564278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb18316d-cafd-4441-bbdb-b7aa719a4d44-webhook-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.564525 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.564318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb18316d-cafd-4441-bbdb-b7aa719a4d44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.564525 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.564337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb18316d-cafd-4441-bbdb-b7aa719a4d44-manifests\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.564525 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.564403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb18316d-cafd-4441-bbdb-b7aa719a4d44-tmp\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.564845 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.564824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb18316d-cafd-4441-bbdb-b7aa719a4d44-manifests\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.566738 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.566719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb18316d-cafd-4441-bbdb-b7aa719a4d44-tmp\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.566826 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.566805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb18316d-cafd-4441-bbdb-b7aa719a4d44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.566993 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.566973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb18316d-cafd-4441-bbdb-b7aa719a4d44-webhook-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.594355 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.594312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7tsx\" (UniqueName: \"kubernetes.io/projected/cb18316d-cafd-4441-bbdb-b7aa719a4d44-kube-api-access-c7tsx\") pod \"opendatahub-operator-controller-manager-9778877d8-rdz48\" (UID: \"cb18316d-cafd-4441-bbdb-b7aa719a4d44\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.695362 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.695308    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:06.861285 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:06.861258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"]
Aug 05 16:28:06.863794 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:28:06.863763    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb18316d_cafd_4441_bbdb_b7aa719a4d44.slice/crio-c1a52ce98fd58791c9cf1e0a984ed673cb1f4c8cd2a3c6543dbd8d8cd5d72fe5 WatchSource:0}: Error finding container c1a52ce98fd58791c9cf1e0a984ed673cb1f4c8cd2a3c6543dbd8d8cd5d72fe5: Status 404 returned error can't find the container with id c1a52ce98fd58791c9cf1e0a984ed673cb1f4c8cd2a3c6543dbd8d8cd5d72fe5
Aug 05 16:28:07.035062 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:07.034900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48" event={"ID":"cb18316d-cafd-4441-bbdb-b7aa719a4d44","Type":"ContainerStarted","Data":"c1a52ce98fd58791c9cf1e0a984ed673cb1f4c8cd2a3c6543dbd8d8cd5d72fe5"}
Aug 05 16:28:10.057956 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:10.057875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48" event={"ID":"cb18316d-cafd-4441-bbdb-b7aa719a4d44","Type":"ContainerStarted","Data":"5d479f6d8d71f80678aa149daccdb82f28366d9024f1380c2f9706fde2d9d322"}
Aug 05 16:28:11.063834 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:11.063796    2579 generic.go:356] "Generic (PLEG): container finished" podID="cb18316d-cafd-4441-bbdb-b7aa719a4d44" containerID="5d479f6d8d71f80678aa149daccdb82f28366d9024f1380c2f9706fde2d9d322" exitCode=0
Aug 05 16:28:11.064223 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:11.063881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48" event={"ID":"cb18316d-cafd-4441-bbdb-b7aa719a4d44","Type":"ContainerDied","Data":"5d479f6d8d71f80678aa149daccdb82f28366d9024f1380c2f9706fde2d9d322"}
Aug 05 16:28:12.072288 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:12.072252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48" event={"ID":"cb18316d-cafd-4441-bbdb-b7aa719a4d44","Type":"ContainerStarted","Data":"71531ccf52b376ab1f0dc66975f427f8e49fbfd8b3ef25cde28906f5f4361f82"}
Aug 05 16:28:12.072677 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:12.072389    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:12.113054 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:12.113007    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48" podStartSLOduration=1.9413075389999999 podStartE2EDuration="6.112993183s" totalImagesPullingTime="3.161454465s" totalInitContainerRuntime="1.010231179s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:12.112926807 +0000 UTC m=+413.448724754" watchObservedRunningTime="2026-08-05 16:28:12.112993183 +0000 UTC m=+413.448791186"
Aug 05 16:28:23.078931 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:23.078894    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-rdz48"
Aug 05 16:28:25.485674 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.485637    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"]
Aug 05 16:28:25.494207 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.494185    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.497241 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.497214    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 05 16:28:25.498478 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.498217    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 05 16:28:25.498478 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.498217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 05 16:28:25.498478 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.498372    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 05 16:28:25.498771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.498560    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:28:25.498771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.498707    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xdl5l\""
Aug 05 16:28:25.505588 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.505567    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"]
Aug 05 16:28:25.638682 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.638648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-metrics-cert\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.638833 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.638753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtf7x\" (UniqueName: \"kubernetes.io/projected/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-kube-api-access-vtf7x\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.638833 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.638804    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-manager-config\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.638833 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.638821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-cert\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.740238 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.740158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtf7x\" (UniqueName: \"kubernetes.io/projected/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-kube-api-access-vtf7x\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.740238 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.740209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-manager-config\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.740238 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.740230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-cert\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.740559 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.740259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-metrics-cert\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.741010 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.740976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-manager-config\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.742719 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.742692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-metrics-cert\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.742936 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.742914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-cert\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.760365 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.760321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtf7x\" (UniqueName: \"kubernetes.io/projected/5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab-kube-api-access-vtf7x\") pod \"lws-controller-manager-6677bbd944-6fns9\" (UID: \"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab\") " pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.806078 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.806045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:25.954761 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:25.954717    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"]
Aug 05 16:28:25.962724 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:28:25.962698    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1e34e4_d7bd_4ee6_8976_dcb8636f2bab.slice/crio-92cac42c6e51960d690d468ad18790ff648a281444f0cb87978557095a7972a3 WatchSource:0}: Error finding container 92cac42c6e51960d690d468ad18790ff648a281444f0cb87978557095a7972a3: Status 404 returned error can't find the container with id 92cac42c6e51960d690d468ad18790ff648a281444f0cb87978557095a7972a3
Aug 05 16:28:26.135305 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:26.135223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9" event={"ID":"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab","Type":"ContainerStarted","Data":"92cac42c6e51960d690d468ad18790ff648a281444f0cb87978557095a7972a3"}
Aug 05 16:28:30.164365 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:30.164265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9" event={"ID":"5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab","Type":"ContainerStarted","Data":"a7a34f03df75dcc67b6cbb067a12500f59b9366fb44898bb6e2657d0b8413f09"}
Aug 05 16:28:30.164728 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:30.164398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:30.185490 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:30.185437    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9" podStartSLOduration=1.463685953 podStartE2EDuration="5.185422484s" totalImagesPullingTime="3.721736531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:30.184817261 +0000 UTC m=+431.520615205" watchObservedRunningTime="2026-08-05 16:28:30.185422484 +0000 UTC m=+431.521220427"
Aug 05 16:28:36.866287 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:36.866242    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"]
Aug 05 16:28:36.869967 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:36.869944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:36.873736 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:28:36.873704    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-8f6d6f675-rqjgd\" is forbidden: User \"system:node:ip-10-0-133-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-70.ec2.internal' and this object" podUID="3476ed57-c461-47e2-b3c4-82526b6aa45b" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:36.875921 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:28:36.875898    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Aug 05 16:28:36.877500 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:28:36.877469    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-133-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret"
Aug 05 16:28:36.878494 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:28:36.878470    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Aug 05 16:28:36.880374 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:28:36.880337    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-fnpqh\" is forbidden: User \"system:node:ip-10-0-133-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fnpqh\"" type="*v1.Secret"
Aug 05 16:28:36.881425 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:36.881410    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 05 16:28:36.889046 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:36.889026    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"]
Aug 05 16:28:36.930768 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:36.930726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3476ed57-c461-47e2-b3c4-82526b6aa45b-tmp\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:36.931088 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:36.931050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3476ed57-c461-47e2-b3c4-82526b6aa45b-tls-certs\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:36.931088 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:36.931086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qvf\" (UniqueName: \"kubernetes.io/projected/3476ed57-c461-47e2-b3c4-82526b6aa45b-kube-api-access-k6qvf\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:37.032575 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:37.032540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3476ed57-c461-47e2-b3c4-82526b6aa45b-tmp\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:37.032765 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:37.032705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3476ed57-c461-47e2-b3c4-82526b6aa45b-tls-certs\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:37.032765 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:37.032736    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qvf\" (UniqueName: \"kubernetes.io/projected/3476ed57-c461-47e2-b3c4-82526b6aa45b-kube-api-access-k6qvf\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:37.035134 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:37.035110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3476ed57-c461-47e2-b3c4-82526b6aa45b-tmp\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:37.754217 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:37.754183    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fnpqh\""
Aug 05 16:28:37.770495 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:37.770465    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 16:28:38.026834 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:38.026753    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 16:28:38.033535 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:28:38.033514    2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition
Aug 05 16:28:38.033673 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:28:38.033572    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476ed57-c461-47e2-b3c4-82526b6aa45b-tls-certs podName:3476ed57-c461-47e2-b3c4-82526b6aa45b nodeName:}" failed. No retries permitted until 2026-08-05 16:28:38.533557597 +0000 UTC m=+439.869355519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3476ed57-c461-47e2-b3c4-82526b6aa45b-tls-certs") pod "kube-auth-proxy-8f6d6f675-rqjgd" (UID: "3476ed57-c461-47e2-b3c4-82526b6aa45b") : failed to sync secret cache: timed out waiting for the condition
Aug 05 16:28:38.037948 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:38.037924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qvf\" (UniqueName: \"kubernetes.io/projected/3476ed57-c461-47e2-b3c4-82526b6aa45b-kube-api-access-k6qvf\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:38.185818 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:38.185789    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 05 16:28:38.546039 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:38.546007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3476ed57-c461-47e2-b3c4-82526b6aa45b-tls-certs\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:38.548514 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:38.548481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3476ed57-c461-47e2-b3c4-82526b6aa45b-tls-certs\") pod \"kube-auth-proxy-8f6d6f675-rqjgd\" (UID: \"3476ed57-c461-47e2-b3c4-82526b6aa45b\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:38.680169 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:38.680136    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"
Aug 05 16:28:38.818326 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:38.818264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd"]
Aug 05 16:28:38.821691 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:28:38.821658    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3476ed57_c461_47e2_b3c4_82526b6aa45b.slice/crio-6c55566da3dbc950258096757fcc6dcb0d48106f1ffab2e8013f347b175369dc WatchSource:0}: Error finding container 6c55566da3dbc950258096757fcc6dcb0d48106f1ffab2e8013f347b175369dc: Status 404 returned error can't find the container with id 6c55566da3dbc950258096757fcc6dcb0d48106f1ffab2e8013f347b175369dc
Aug 05 16:28:39.202905 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:39.202872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd" event={"ID":"3476ed57-c461-47e2-b3c4-82526b6aa45b","Type":"ContainerStarted","Data":"6c55566da3dbc950258096757fcc6dcb0d48106f1ffab2e8013f347b175369dc"}
Aug 05 16:28:41.170766 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:41.170733    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6677bbd944-6fns9"
Aug 05 16:28:42.218760 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:42.218728    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd" event={"ID":"3476ed57-c461-47e2-b3c4-82526b6aa45b","Type":"ContainerStarted","Data":"d19811223c04656aaf81308b3a221a272f42995fd6f309780356c587d3ea1353"}
Aug 05 16:28:42.249990 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:28:42.249938    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd" podStartSLOduration=3.227435866 podStartE2EDuration="6.249924383s" totalImagesPullingTime="3.022488517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:42.249259095 +0000 UTC m=+443.585057039" watchObservedRunningTime="2026-08-05 16:28:42.249924383 +0000 UTC m=+443.585722372"
Aug 05 16:30:22.416044 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.415968    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"]
Aug 05 16:30:22.419312 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.419288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.422043 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.422019    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-snx4g\""
Aug 05 16:30:22.422165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.422024    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 05 16:30:22.422165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.422105    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 05 16:30:22.422305 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.422293    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 16:30:22.423134 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.423112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 16:30:22.428210 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.428191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"]
Aug 05 16:30:22.610989 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.610952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwhwg\" (UniqueName: \"kubernetes.io/projected/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-kube-api-access-xwhwg\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.610989 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.610995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.611195 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.611019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.711735 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.711708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwhwg\" (UniqueName: \"kubernetes.io/projected/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-kube-api-access-xwhwg\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.711912 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.711739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.711912 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.711765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.712332 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.712312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.714052 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.714030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.723357 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.723321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwhwg\" (UniqueName: \"kubernetes.io/projected/24b6f1ac-59d0-4d3e-bf78-da21387bdc33-kube-api-access-xwhwg\") pod \"kuadrant-console-plugin-598f86468b-vlq99\" (UID: \"24b6f1ac-59d0-4d3e-bf78-da21387bdc33\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.729202 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.729180    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"
Aug 05 16:30:22.860448 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:22.860423    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99"]
Aug 05 16:30:22.862021 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:30:22.861993    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24b6f1ac_59d0_4d3e_bf78_da21387bdc33.slice/crio-6c354b69f2769d7ef5338d581fae63b3c19731c6c0c7ed42e957c35d4cedca64 WatchSource:0}: Error finding container 6c354b69f2769d7ef5338d581fae63b3c19731c6c0c7ed42e957c35d4cedca64: Status 404 returned error can't find the container with id 6c354b69f2769d7ef5338d581fae63b3c19731c6c0c7ed42e957c35d4cedca64
Aug 05 16:30:23.650418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:23.650383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99" event={"ID":"24b6f1ac-59d0-4d3e-bf78-da21387bdc33","Type":"ContainerStarted","Data":"6c354b69f2769d7ef5338d581fae63b3c19731c6c0c7ed42e957c35d4cedca64"}
Aug 05 16:30:28.683164 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:28.683128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99" event={"ID":"24b6f1ac-59d0-4d3e-bf78-da21387bdc33","Type":"ContainerStarted","Data":"ad60029683aaa2d38240441f00a87956bf20d02761cab9dcafbd7a230251a6c8"}
Aug 05 16:30:28.717108 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:30:28.717053    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-vlq99" podStartSLOduration=1.775076507 podStartE2EDuration="6.717037615s" totalImagesPullingTime="4.941961108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:30:28.715997531 +0000 UTC m=+550.051795476" watchObservedRunningTime="2026-08-05 16:30:28.717037615 +0000 UTC m=+550.052835576"
Aug 05 16:31:03.573132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.573098    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"]
Aug 05 16:31:03.588712 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.588691    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:03.589265 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.589244    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"]
Aug 05 16:31:03.596403 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.596386    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 05 16:31:03.667223 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.667193    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"]
Aug 05 16:31:03.667572 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.667555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92nr8\" (UniqueName: \"kubernetes.io/projected/f0d68605-c407-428b-946a-6d6d6081dcfe-kube-api-access-92nr8\") pod \"limitador-limitador-859c4d96d6-qjrwp\" (UID: \"f0d68605-c407-428b-946a-6d6d6081dcfe\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:03.667694 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.667674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0d68605-c407-428b-946a-6d6d6081dcfe-config-file\") pod \"limitador-limitador-859c4d96d6-qjrwp\" (UID: \"f0d68605-c407-428b-946a-6d6d6081dcfe\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:03.768854 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.768823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0d68605-c407-428b-946a-6d6d6081dcfe-config-file\") pod \"limitador-limitador-859c4d96d6-qjrwp\" (UID: \"f0d68605-c407-428b-946a-6d6d6081dcfe\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:03.768981 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.768881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92nr8\" (UniqueName: \"kubernetes.io/projected/f0d68605-c407-428b-946a-6d6d6081dcfe-kube-api-access-92nr8\") pod \"limitador-limitador-859c4d96d6-qjrwp\" (UID: \"f0d68605-c407-428b-946a-6d6d6081dcfe\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:03.769452 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.769432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0d68605-c407-428b-946a-6d6d6081dcfe-config-file\") pod \"limitador-limitador-859c4d96d6-qjrwp\" (UID: \"f0d68605-c407-428b-946a-6d6d6081dcfe\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:03.780824 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.780800    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92nr8\" (UniqueName: \"kubernetes.io/projected/f0d68605-c407-428b-946a-6d6d6081dcfe-kube-api-access-92nr8\") pod \"limitador-limitador-859c4d96d6-qjrwp\" (UID: \"f0d68605-c407-428b-946a-6d6d6081dcfe\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:03.898765 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:03.898695    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:04.033908 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:04.033881    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"]
Aug 05 16:31:04.035705 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:31:04.035677    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d68605_c407_428b_946a_6d6d6081dcfe.slice/crio-eb3abd41eea0934dfd7e90ac10fccfa30210ce199837aeda0ccc1f50f229a3b1 WatchSource:0}: Error finding container eb3abd41eea0934dfd7e90ac10fccfa30210ce199837aeda0ccc1f50f229a3b1: Status 404 returned error can't find the container with id eb3abd41eea0934dfd7e90ac10fccfa30210ce199837aeda0ccc1f50f229a3b1
Aug 05 16:31:04.847150 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:04.847113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp" event={"ID":"f0d68605-c407-428b-946a-6d6d6081dcfe","Type":"ContainerStarted","Data":"eb3abd41eea0934dfd7e90ac10fccfa30210ce199837aeda0ccc1f50f229a3b1"}
Aug 05 16:31:06.857302 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:06.857263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp" event={"ID":"f0d68605-c407-428b-946a-6d6d6081dcfe","Type":"ContainerStarted","Data":"00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c"}
Aug 05 16:31:06.857706 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:06.857383    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:06.878540 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:06.878499    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp" podStartSLOduration=1.23982803 podStartE2EDuration="3.878485426s" totalImagesPullingTime="2.638657396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:06.877402914 +0000 UTC m=+588.213200862" watchObservedRunningTime="2026-08-05 16:31:06.878485426 +0000 UTC m=+588.214283369"
Aug 05 16:31:17.096912 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.096877    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"]
Aug 05 16:31:17.097327 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.097062    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp" podUID="f0d68605-c407-428b-946a-6d6d6081dcfe" containerName="limitador" containerID="cri-o://00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c" gracePeriod=30
Aug 05 16:31:17.097803 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.097785    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:17.646736 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.646717    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:17.687732 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.687706    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0d68605-c407-428b-946a-6d6d6081dcfe-config-file\") pod \"f0d68605-c407-428b-946a-6d6d6081dcfe\" (UID: \"f0d68605-c407-428b-946a-6d6d6081dcfe\") "
Aug 05 16:31:17.687848 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.687801    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92nr8\" (UniqueName: \"kubernetes.io/projected/f0d68605-c407-428b-946a-6d6d6081dcfe-kube-api-access-92nr8\") pod \"f0d68605-c407-428b-946a-6d6d6081dcfe\" (UID: \"f0d68605-c407-428b-946a-6d6d6081dcfe\") "
Aug 05 16:31:17.688087 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.688066    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0d68605-c407-428b-946a-6d6d6081dcfe-config-file" (OuterVolumeSpecName: "config-file") pod "f0d68605-c407-428b-946a-6d6d6081dcfe" (UID: "f0d68605-c407-428b-946a-6d6d6081dcfe"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:31:17.689866 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.689842    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0d68605-c407-428b-946a-6d6d6081dcfe-kube-api-access-92nr8" (OuterVolumeSpecName: "kube-api-access-92nr8") pod "f0d68605-c407-428b-946a-6d6d6081dcfe" (UID: "f0d68605-c407-428b-946a-6d6d6081dcfe"). InnerVolumeSpecName "kube-api-access-92nr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:31:17.788809 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.788779    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0d68605-c407-428b-946a-6d6d6081dcfe-config-file\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:31:17.788809 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.788801    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92nr8\" (UniqueName: \"kubernetes.io/projected/f0d68605-c407-428b-946a-6d6d6081dcfe-kube-api-access-92nr8\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:31:17.905975 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.905940    2579 generic.go:356] "Generic (PLEG): container finished" podID="f0d68605-c407-428b-946a-6d6d6081dcfe" containerID="00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c" exitCode=0
Aug 05 16:31:17.906119 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.905991    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"
Aug 05 16:31:17.906119 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.905997    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp" event={"ID":"f0d68605-c407-428b-946a-6d6d6081dcfe","Type":"ContainerDied","Data":"00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c"}
Aug 05 16:31:17.906119 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.906116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qjrwp" event={"ID":"f0d68605-c407-428b-946a-6d6d6081dcfe","Type":"ContainerDied","Data":"eb3abd41eea0934dfd7e90ac10fccfa30210ce199837aeda0ccc1f50f229a3b1"}
Aug 05 16:31:17.906217 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.906138    2579 scope.go:117] "RemoveContainer" containerID="00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c"
Aug 05 16:31:17.914452 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.914425    2579 scope.go:117] "RemoveContainer" containerID="00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c"
Aug 05 16:31:17.914689 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:31:17.914668    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c\": container with ID starting with 00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c not found: ID does not exist" containerID="00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c"
Aug 05 16:31:17.914752 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.914700    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c"} err="failed to get container status \"00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c\": rpc error: code = NotFound desc = could not find container \"00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c\": container with ID starting with 00a2c7c09eb8bacd1dd237c2e5d0127d299e831a97daa87c7d5cc83361276f5c not found: ID does not exist"
Aug 05 16:31:17.928399 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.928377    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"]
Aug 05 16:31:17.934538 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:17.934519    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qjrwp"]
Aug 05 16:31:19.123282 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:19.123259    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:31:19.125167 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:19.125146    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:31:19.189397 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:19.189372    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0d68605-c407-428b-946a-6d6d6081dcfe" path="/var/lib/kubelet/pods/f0d68605-c407-428b-946a-6d6d6081dcfe/volumes"
Aug 05 16:31:20.082822 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.082786    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"]
Aug 05 16:31:20.083300 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.083285    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0d68605-c407-428b-946a-6d6d6081dcfe" containerName="limitador"
Aug 05 16:31:20.083356 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.083303    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0d68605-c407-428b-946a-6d6d6081dcfe" containerName="limitador"
Aug 05 16:31:20.083413 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.083402    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0d68605-c407-428b-946a-6d6d6081dcfe" containerName="limitador"
Aug 05 16:31:20.087802 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.087775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:20.090817 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.090796    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-8rp2p\""
Aug 05 16:31:20.090953 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.090831    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 05 16:31:20.091015 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.090969    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 16:31:20.091998 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.091984    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 16:31:20.098717 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.098697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"]
Aug 05 16:31:20.209909 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.209883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04afc8d1-0e08-4128-ac59-18d36484c2f5-data\") pod \"postgres-69fb4594cf-7vcxp\" (UID: \"04afc8d1-0e08-4128-ac59-18d36484c2f5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:20.209909 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.209909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccxm\" (UniqueName: \"kubernetes.io/projected/04afc8d1-0e08-4128-ac59-18d36484c2f5-kube-api-access-lccxm\") pod \"postgres-69fb4594cf-7vcxp\" (UID: \"04afc8d1-0e08-4128-ac59-18d36484c2f5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:20.310599 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.310569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04afc8d1-0e08-4128-ac59-18d36484c2f5-data\") pod \"postgres-69fb4594cf-7vcxp\" (UID: \"04afc8d1-0e08-4128-ac59-18d36484c2f5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:20.310731 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.310607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccxm\" (UniqueName: \"kubernetes.io/projected/04afc8d1-0e08-4128-ac59-18d36484c2f5-kube-api-access-lccxm\") pod \"postgres-69fb4594cf-7vcxp\" (UID: \"04afc8d1-0e08-4128-ac59-18d36484c2f5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:20.310936 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.310912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04afc8d1-0e08-4128-ac59-18d36484c2f5-data\") pod \"postgres-69fb4594cf-7vcxp\" (UID: \"04afc8d1-0e08-4128-ac59-18d36484c2f5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:20.322217 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.322191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccxm\" (UniqueName: \"kubernetes.io/projected/04afc8d1-0e08-4128-ac59-18d36484c2f5-kube-api-access-lccxm\") pod \"postgres-69fb4594cf-7vcxp\" (UID: \"04afc8d1-0e08-4128-ac59-18d36484c2f5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:20.398113 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.398059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:20.533916 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.533884    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"]
Aug 05 16:31:20.537505 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:31:20.537478    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04afc8d1_0e08_4128_ac59_18d36484c2f5.slice/crio-007d6fbc4ba99837c78f6b0acad16b53946d5f404f3aa3f3101d2307262354c1 WatchSource:0}: Error finding container 007d6fbc4ba99837c78f6b0acad16b53946d5f404f3aa3f3101d2307262354c1: Status 404 returned error can't find the container with id 007d6fbc4ba99837c78f6b0acad16b53946d5f404f3aa3f3101d2307262354c1
Aug 05 16:31:20.921289 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:20.921251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp" event={"ID":"04afc8d1-0e08-4128-ac59-18d36484c2f5","Type":"ContainerStarted","Data":"007d6fbc4ba99837c78f6b0acad16b53946d5f404f3aa3f3101d2307262354c1"}
Aug 05 16:31:25.953637 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:25.953603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp" event={"ID":"04afc8d1-0e08-4128-ac59-18d36484c2f5","Type":"ContainerStarted","Data":"c5d66180686bccf2521f93aaca75eeaaebc8e22b8ce96c51fd90ff06c726320c"}
Aug 05 16:31:25.954073 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:25.953667    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:25.978046 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:25.977996    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp" podStartSLOduration=0.992164811 podStartE2EDuration="5.97798176s" totalImagesPullingTime="4.985816949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:25.975403388 +0000 UTC m=+607.311201333" watchObservedRunningTime="2026-08-05 16:31:25.97798176 +0000 UTC m=+607.313779704"
Aug 05 16:31:31.987359 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:31.987312    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7vcxp"
Aug 05 16:31:39.480498 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.480463    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9b9f5c5c7-gtk9d"]
Aug 05 16:31:39.503505 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.503477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:39.507614 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.507591    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:31:39.507821 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.507804    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2xqq\""
Aug 05 16:31:39.508935 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.508908    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:31:39.513322 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.513302    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b9f5c5c7-gtk9d"]
Aug 05 16:31:39.583210 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.583179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzt75\" (UniqueName: \"kubernetes.io/projected/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-kube-api-access-zzt75\") pod \"maas-controller-9b9f5c5c7-gtk9d\" (UID: \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\") " pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:39.583382 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.583227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-webhook-cert\") pod \"maas-controller-9b9f5c5c7-gtk9d\" (UID: \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\") " pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:39.664442 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.664416    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-76ctg"]
Aug 05 16:31:39.667933 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.667911    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:39.680388 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.680336    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-76ctg"]
Aug 05 16:31:39.683747 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.683724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-webhook-cert\") pod \"maas-controller-9b9f5c5c7-gtk9d\" (UID: \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\") " pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:39.683854 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.683837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzt75\" (UniqueName: \"kubernetes.io/projected/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-kube-api-access-zzt75\") pod \"maas-controller-9b9f5c5c7-gtk9d\" (UID: \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\") " pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:39.686149 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.686127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-webhook-cert\") pod \"maas-controller-9b9f5c5c7-gtk9d\" (UID: \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\") " pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:39.694515 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.694491    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzt75\" (UniqueName: \"kubernetes.io/projected/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-kube-api-access-zzt75\") pod \"maas-controller-9b9f5c5c7-gtk9d\" (UID: \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\") " pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:39.784591 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.784502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/726a0928-9a4e-478a-ac56-00083dc9c658-webhook-cert\") pod \"maas-controller-7764f5fb7b-76ctg\" (UID: \"726a0928-9a4e-478a-ac56-00083dc9c658\") " pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:39.784591 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.784552    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvrn8\" (UniqueName: \"kubernetes.io/projected/726a0928-9a4e-478a-ac56-00083dc9c658-kube-api-access-vvrn8\") pod \"maas-controller-7764f5fb7b-76ctg\" (UID: \"726a0928-9a4e-478a-ac56-00083dc9c658\") " pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:39.814805 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.814778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:39.885228 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.885189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/726a0928-9a4e-478a-ac56-00083dc9c658-webhook-cert\") pod \"maas-controller-7764f5fb7b-76ctg\" (UID: \"726a0928-9a4e-478a-ac56-00083dc9c658\") " pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:39.885386 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.885233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvrn8\" (UniqueName: \"kubernetes.io/projected/726a0928-9a4e-478a-ac56-00083dc9c658-kube-api-access-vvrn8\") pod \"maas-controller-7764f5fb7b-76ctg\" (UID: \"726a0928-9a4e-478a-ac56-00083dc9c658\") " pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:39.887438 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.887411    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/726a0928-9a4e-478a-ac56-00083dc9c658-webhook-cert\") pod \"maas-controller-7764f5fb7b-76ctg\" (UID: \"726a0928-9a4e-478a-ac56-00083dc9c658\") " pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:39.895658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.895501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvrn8\" (UniqueName: \"kubernetes.io/projected/726a0928-9a4e-478a-ac56-00083dc9c658-kube-api-access-vvrn8\") pod \"maas-controller-7764f5fb7b-76ctg\" (UID: \"726a0928-9a4e-478a-ac56-00083dc9c658\") " pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:39.951951 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:31:39.951911    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c9f9bc_47ac_4170_a3ac_5fffd35d12cf.slice/crio-0bb8c288337bc207f33fcd5a740983cf63ebbd9ec611b10c35d052f967c9fd46 WatchSource:0}: Error finding container 0bb8c288337bc207f33fcd5a740983cf63ebbd9ec611b10c35d052f967c9fd46: Status 404 returned error can't find the container with id 0bb8c288337bc207f33fcd5a740983cf63ebbd9ec611b10c35d052f967c9fd46
Aug 05 16:31:39.953419 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.953397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b9f5c5c7-gtk9d"]
Aug 05 16:31:39.979406 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:39.979382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:40.015031 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:40.015000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d" event={"ID":"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf","Type":"ContainerStarted","Data":"0bb8c288337bc207f33fcd5a740983cf63ebbd9ec611b10c35d052f967c9fd46"}
Aug 05 16:31:40.110872 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:40.110845    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-76ctg"]
Aug 05 16:31:40.112874 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:31:40.112847    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726a0928_9a4e_478a_ac56_00083dc9c658.slice/crio-f0d0951ee99f3b5c208da5e28e90c2928d5ee62b5d0424f7623cb9ce780d99e5 WatchSource:0}: Error finding container f0d0951ee99f3b5c208da5e28e90c2928d5ee62b5d0424f7623cb9ce780d99e5: Status 404 returned error can't find the container with id f0d0951ee99f3b5c208da5e28e90c2928d5ee62b5d0424f7623cb9ce780d99e5
Aug 05 16:31:41.024692 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:41.024583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-76ctg" event={"ID":"726a0928-9a4e-478a-ac56-00083dc9c658","Type":"ContainerStarted","Data":"f0d0951ee99f3b5c208da5e28e90c2928d5ee62b5d0424f7623cb9ce780d99e5"}
Aug 05 16:31:43.035165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:43.035128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d" event={"ID":"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf","Type":"ContainerStarted","Data":"3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf"}
Aug 05 16:31:43.035632 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:43.035241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:43.036871 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:43.036850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-76ctg" event={"ID":"726a0928-9a4e-478a-ac56-00083dc9c658","Type":"ContainerStarted","Data":"bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309"}
Aug 05 16:31:43.036993 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:43.036895    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:43.056114 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:43.056069    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d" podStartSLOduration=1.5180274150000002 podStartE2EDuration="4.056055783s" totalImagesPullingTime="2.538028368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:43.054730437 +0000 UTC m=+624.390528381" watchObservedRunningTime="2026-08-05 16:31:43.056055783 +0000 UTC m=+624.391853727"
Aug 05 16:31:43.074921 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:43.074871    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7764f5fb7b-76ctg" podStartSLOduration=1.6902634349999999 podStartE2EDuration="4.074858558s" totalImagesPullingTime="2.384595123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:43.07458216 +0000 UTC m=+624.410380106" watchObservedRunningTime="2026-08-05 16:31:43.074858558 +0000 UTC m=+624.410656502"
Aug 05 16:31:54.042699 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.042670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:31:54.043091 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.042737    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:54.122339 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.122310    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9b9f5c5c7-gtk9d"]
Aug 05 16:31:54.122546 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.122508    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d" podUID="d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf" containerName="manager" containerID="cri-o://3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf" gracePeriod=30
Aug 05 16:31:54.366081 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.366057    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:54.419524 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.419494    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzt75\" (UniqueName: \"kubernetes.io/projected/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-kube-api-access-zzt75\") pod \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\" (UID: \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\") "
Aug 05 16:31:54.419672 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.419544    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-webhook-cert\") pod \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\" (UID: \"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf\") "
Aug 05 16:31:54.421785 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.421754    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf" (UID: "d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:31:54.421929 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.421901    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-kube-api-access-zzt75" (OuterVolumeSpecName: "kube-api-access-zzt75") pod "d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf" (UID: "d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf"). InnerVolumeSpecName "kube-api-access-zzt75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:31:54.520671 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.520631    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzt75\" (UniqueName: \"kubernetes.io/projected/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-kube-api-access-zzt75\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:31:54.520671 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:54.520667    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf-webhook-cert\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:31:55.094903 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.094868    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf" containerID="3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf" exitCode=0
Aug 05 16:31:55.095311 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.094920    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d"
Aug 05 16:31:55.095311 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.094964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d" event={"ID":"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf","Type":"ContainerDied","Data":"3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf"}
Aug 05 16:31:55.095311 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.095016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b9f5c5c7-gtk9d" event={"ID":"d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf","Type":"ContainerDied","Data":"0bb8c288337bc207f33fcd5a740983cf63ebbd9ec611b10c35d052f967c9fd46"}
Aug 05 16:31:55.095311 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.095045    2579 scope.go:117] "RemoveContainer" containerID="3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf"
Aug 05 16:31:55.103872 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.103856    2579 scope.go:117] "RemoveContainer" containerID="3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf"
Aug 05 16:31:55.104135 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:31:55.104119    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf\": container with ID starting with 3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf not found: ID does not exist" containerID="3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf"
Aug 05 16:31:55.104178 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.104143    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf"} err="failed to get container status \"3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf\": rpc error: code = NotFound desc = could not find container \"3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf\": container with ID starting with 3e5f2076b36c3853e088ec75049457d57cd5b343ebdcac0f8224c73c400ce8cf not found: ID does not exist"
Aug 05 16:31:55.118756 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.118732    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9b9f5c5c7-gtk9d"]
Aug 05 16:31:55.123046 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.123025    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9b9f5c5c7-gtk9d"]
Aug 05 16:31:55.192763 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:31:55.189417    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf" path="/var/lib/kubelet/pods/d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf/volumes"
Aug 05 16:32:16.274080 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.274041    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"]
Aug 05 16:32:16.282381 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.274432    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf" containerName="manager"
Aug 05 16:32:16.282381 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.274446    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf" containerName="manager"
Aug 05 16:32:16.282381 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.274507    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c9f9bc-47ac-4170-a3ac-5fffd35d12cf" containerName="manager"
Aug 05 16:32:16.282608 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.282588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.288188 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.288147    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 05 16:32:16.288360 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.288228    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pqmst\""
Aug 05 16:32:16.294501 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.294479    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"]
Aug 05 16:32:16.421026 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.420993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9r2g\" (UniqueName: \"kubernetes.io/projected/ac190872-b17a-4648-9b2e-998344221a91-kube-api-access-k9r2g\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.421195 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.421046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac190872-b17a-4648-9b2e-998344221a91-openshift-service-ca\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.421195 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.421150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac190872-b17a-4648-9b2e-998344221a91-maas-api-tls\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.522361 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.522320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac190872-b17a-4648-9b2e-998344221a91-openshift-service-ca\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.522531 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.522392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac190872-b17a-4648-9b2e-998344221a91-maas-api-tls\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.522531 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.522434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9r2g\" (UniqueName: \"kubernetes.io/projected/ac190872-b17a-4648-9b2e-998344221a91-kube-api-access-k9r2g\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.522973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.522950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac190872-b17a-4648-9b2e-998344221a91-openshift-service-ca\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.524736 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.524686    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac190872-b17a-4648-9b2e-998344221a91-maas-api-tls\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.531419 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.531400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9r2g\" (UniqueName: \"kubernetes.io/projected/ac190872-b17a-4648-9b2e-998344221a91-kube-api-access-k9r2g\") pod \"maas-api-7c9cd88448-cg9g2\" (UID: \"ac190872-b17a-4648-9b2e-998344221a91\") " pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.593036 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.593013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:16.755229 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:16.755188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"]
Aug 05 16:32:16.761208 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:32:16.761181    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac190872_b17a_4648_9b2e_998344221a91.slice/crio-2571fca963048173ac7dc208879a7785c4b71f7289d4d5d37870e10d129b7e67 WatchSource:0}: Error finding container 2571fca963048173ac7dc208879a7785c4b71f7289d4d5d37870e10d129b7e67: Status 404 returned error can't find the container with id 2571fca963048173ac7dc208879a7785c4b71f7289d4d5d37870e10d129b7e67
Aug 05 16:32:17.204504 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.204467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2" event={"ID":"ac190872-b17a-4648-9b2e-998344221a91","Type":"ContainerStarted","Data":"2571fca963048173ac7dc208879a7785c4b71f7289d4d5d37870e10d129b7e67"}
Aug 05 16:32:17.347226 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.347186    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-x5xxr"]
Aug 05 16:32:17.352571 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.352548    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"]
Aug 05 16:32:17.352711 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.352681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:17.356319 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.356295    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:17.358983 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.358967    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 05 16:32:17.359119 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.359101    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g96xc\""
Aug 05 16:32:17.373913 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.373875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-x5xxr"]
Aug 05 16:32:17.375530 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.375510    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"]
Aug 05 16:32:17.530842 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.530766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fceeaf1f-afc2-4488-9b8e-da65f5d7c100-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-g467b\" (UID: \"fceeaf1f-afc2-4488-9b8e-da65f5d7c100\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:17.530842 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.530813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c133297-2e88-47bb-9524-b3d6fd175987-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-x5xxr\" (UID: \"8c133297-2e88-47bb-9524-b3d6fd175987\") " pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:17.531008 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.530900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdvht\" (UniqueName: \"kubernetes.io/projected/fceeaf1f-afc2-4488-9b8e-da65f5d7c100-kube-api-access-fdvht\") pod \"payload-pre-processing-687dbb6cf6-g467b\" (UID: \"fceeaf1f-afc2-4488-9b8e-da65f5d7c100\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:17.531008 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.530943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5vjl\" (UniqueName: \"kubernetes.io/projected/8c133297-2e88-47bb-9524-b3d6fd175987-kube-api-access-q5vjl\") pod \"payload-processing-5cc6cd444b-x5xxr\" (UID: \"8c133297-2e88-47bb-9524-b3d6fd175987\") " pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:17.632472 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.632432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c133297-2e88-47bb-9524-b3d6fd175987-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-x5xxr\" (UID: \"8c133297-2e88-47bb-9524-b3d6fd175987\") " pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:17.632687 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.632541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdvht\" (UniqueName: \"kubernetes.io/projected/fceeaf1f-afc2-4488-9b8e-da65f5d7c100-kube-api-access-fdvht\") pod \"payload-pre-processing-687dbb6cf6-g467b\" (UID: \"fceeaf1f-afc2-4488-9b8e-da65f5d7c100\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:17.632687 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.632590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5vjl\" (UniqueName: \"kubernetes.io/projected/8c133297-2e88-47bb-9524-b3d6fd175987-kube-api-access-q5vjl\") pod \"payload-processing-5cc6cd444b-x5xxr\" (UID: \"8c133297-2e88-47bb-9524-b3d6fd175987\") " pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:17.632865 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.632687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fceeaf1f-afc2-4488-9b8e-da65f5d7c100-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-g467b\" (UID: \"fceeaf1f-afc2-4488-9b8e-da65f5d7c100\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:17.633244 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.633219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c133297-2e88-47bb-9524-b3d6fd175987-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-x5xxr\" (UID: \"8c133297-2e88-47bb-9524-b3d6fd175987\") " pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:17.633465 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.633445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fceeaf1f-afc2-4488-9b8e-da65f5d7c100-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-g467b\" (UID: \"fceeaf1f-afc2-4488-9b8e-da65f5d7c100\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:17.650422 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.650368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5vjl\" (UniqueName: \"kubernetes.io/projected/8c133297-2e88-47bb-9524-b3d6fd175987-kube-api-access-q5vjl\") pod \"payload-processing-5cc6cd444b-x5xxr\" (UID: \"8c133297-2e88-47bb-9524-b3d6fd175987\") " pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:17.653375 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.653306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdvht\" (UniqueName: \"kubernetes.io/projected/fceeaf1f-afc2-4488-9b8e-da65f5d7c100-kube-api-access-fdvht\") pod \"payload-pre-processing-687dbb6cf6-g467b\" (UID: \"fceeaf1f-afc2-4488-9b8e-da65f5d7c100\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:17.664753 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.664730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:17.672208 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.672186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:17.849259 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:17.845293    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-x5xxr"]
Aug 05 16:32:17.855937 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:32:17.855882    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c133297_2e88_47bb_9524_b3d6fd175987.slice/crio-d1b4dcec2e69d97f4e1437f184fbc0cfbedd58b270292b588895c137afe008e1 WatchSource:0}: Error finding container d1b4dcec2e69d97f4e1437f184fbc0cfbedd58b270292b588895c137afe008e1: Status 404 returned error can't find the container with id d1b4dcec2e69d97f4e1437f184fbc0cfbedd58b270292b588895c137afe008e1
Aug 05 16:32:18.099688 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:18.097259    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"]
Aug 05 16:32:18.103480 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:32:18.103439    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfceeaf1f_afc2_4488_9b8e_da65f5d7c100.slice/crio-34772813b303453178a6aeee5dc04db9ecc09a40ad89bb46ef5b1234ff2f4da6 WatchSource:0}: Error finding container 34772813b303453178a6aeee5dc04db9ecc09a40ad89bb46ef5b1234ff2f4da6: Status 404 returned error can't find the container with id 34772813b303453178a6aeee5dc04db9ecc09a40ad89bb46ef5b1234ff2f4da6
Aug 05 16:32:18.210543 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:18.210509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr" event={"ID":"8c133297-2e88-47bb-9524-b3d6fd175987","Type":"ContainerStarted","Data":"d1b4dcec2e69d97f4e1437f184fbc0cfbedd58b270292b588895c137afe008e1"}
Aug 05 16:32:18.211634 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:18.211608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b" event={"ID":"fceeaf1f-afc2-4488-9b8e-da65f5d7c100","Type":"ContainerStarted","Data":"34772813b303453178a6aeee5dc04db9ecc09a40ad89bb46ef5b1234ff2f4da6"}
Aug 05 16:32:19.220737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:19.220594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2" event={"ID":"ac190872-b17a-4648-9b2e-998344221a91","Type":"ContainerStarted","Data":"f9522c61fbb303f6dff8b6b76c1fb82dd755c813188f9de13f338c97a7aeffd0"}
Aug 05 16:32:19.220737 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:19.220694    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:19.243326 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:19.243195    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2" podStartSLOduration=1.268111619 podStartE2EDuration="3.243175344s" totalImagesPullingTime="1.975063725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:19.242645829 +0000 UTC m=+660.578443777" watchObservedRunningTime="2026-08-05 16:32:19.243175344 +0000 UTC m=+660.578973289"
Aug 05 16:32:20.226888 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:20.226852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr" event={"ID":"8c133297-2e88-47bb-9524-b3d6fd175987","Type":"ContainerStarted","Data":"d6e81264e347af3780c4112a761270a2f62414a25fc508beb5f23b48a077a787"}
Aug 05 16:32:20.227367 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:20.227020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:20.228418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:20.228390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b" event={"ID":"fceeaf1f-afc2-4488-9b8e-da65f5d7c100","Type":"ContainerStarted","Data":"50f4ff1620a9c01226917b0928de45eff2430eb1c51c1a4a56bec6dd536fd91f"}
Aug 05 16:32:20.251626 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:20.251572    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr" podStartSLOduration=1.384605327 podStartE2EDuration="3.2515585s" totalImagesPullingTime="1.866953173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:20.249895606 +0000 UTC m=+661.585693551" watchObservedRunningTime="2026-08-05 16:32:20.2515585 +0000 UTC m=+661.587356444"
Aug 05 16:32:20.270965 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:20.270913    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b" podStartSLOduration=1.644872768 podStartE2EDuration="3.270898618s" totalImagesPullingTime="1.62602585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:20.269466245 +0000 UTC m=+661.605264189" watchObservedRunningTime="2026-08-05 16:32:20.270898618 +0000 UTC m=+661.606696586"
Aug 05 16:32:21.232525 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:21.232496    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:25.233980 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:25.233954    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7c9cd88448-cg9g2"
Aug 05 16:32:31.234295 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:31.234262    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-x5xxr"
Aug 05 16:32:32.241292 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:32.241254    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-g467b"
Aug 05 16:32:34.310272 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.310238    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"]
Aug 05 16:32:34.315241 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.315217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.319181 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.319155    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dck4v\""
Aug 05 16:32:34.319601 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.319577    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 16:32:34.319722 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.319704    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 16:32:34.320817 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.320644    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 05 16:32:34.324001 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.323977    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"]
Aug 05 16:32:34.389170 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.389137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185fd475-274f-4fee-981a-b3ded3954d6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.389170 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.389176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.389479 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.389204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.389479 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.389316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmnhr\" (UniqueName: \"kubernetes.io/projected/185fd475-274f-4fee-981a-b3ded3954d6a-kube-api-access-gmnhr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.389479 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.389380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.389479 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.389426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.490524 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.490487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.490770 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.490549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmnhr\" (UniqueName: \"kubernetes.io/projected/185fd475-274f-4fee-981a-b3ded3954d6a-kube-api-access-gmnhr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.490770 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.490585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.490770 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.490621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.490770 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.490711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185fd475-274f-4fee-981a-b3ded3954d6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.490770 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.490741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.491047 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.490997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.491047 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.491013    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.491146 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.491081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.492701 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.492681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185fd475-274f-4fee-981a-b3ded3954d6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.493131 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.493114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185fd475-274f-4fee-981a-b3ded3954d6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.501722 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.501696    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmnhr\" (UniqueName: \"kubernetes.io/projected/185fd475-274f-4fee-981a-b3ded3954d6a-kube-api-access-gmnhr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt\" (UID: \"185fd475-274f-4fee-981a-b3ded3954d6a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.629793 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.629718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:34.764708 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:34.764682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"]
Aug 05 16:32:34.766616 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:32:34.766589    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185fd475_274f_4fee_981a_b3ded3954d6a.slice/crio-0a339bca20594af9d38b4c90383f096f17ed81b0bc7a91c4b8bbd87d89fe1f13 WatchSource:0}: Error finding container 0a339bca20594af9d38b4c90383f096f17ed81b0bc7a91c4b8bbd87d89fe1f13: Status 404 returned error can't find the container with id 0a339bca20594af9d38b4c90383f096f17ed81b0bc7a91c4b8bbd87d89fe1f13
Aug 05 16:32:35.305222 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:35.305148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt" event={"ID":"185fd475-274f-4fee-981a-b3ded3954d6a","Type":"ContainerStarted","Data":"0a339bca20594af9d38b4c90383f096f17ed81b0bc7a91c4b8bbd87d89fe1f13"}
Aug 05 16:32:36.311268 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:36.311177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt" event={"ID":"185fd475-274f-4fee-981a-b3ded3954d6a","Type":"ContainerStarted","Data":"54ec3fb8c9b1d1ca469f8b83fb9dd425d8ece79ae2eafaf1e12248aab660fcc9"}
Aug 05 16:32:36.332085 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:36.332028    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt" podStartSLOduration=1.084470628 podStartE2EDuration="2.332013437s" totalImagesPullingTime="1.247542809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:36.330963598 +0000 UTC m=+677.666761541" watchObservedRunningTime="2026-08-05 16:32:36.332013437 +0000 UTC m=+677.667811362"
Aug 05 16:32:44.630500 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:44.630459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:44.630928 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:44.630526    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:44.643646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:44.643621    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:32:45.370662 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:32:45.370632    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt"
Aug 05 16:33:50.002149 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.002059    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"]
Aug 05 16:33:50.005590 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.005574    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.011646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.011622    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 05 16:33:50.027397 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.027373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"]
Aug 05 16:33:50.151147 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.151115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.151322 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.151166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpgfd\" (UniqueName: \"kubernetes.io/projected/c91dec94-2c59-40df-afb0-72120ff5a7e7-kube-api-access-bpgfd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.151322 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.151188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91dec94-2c59-40df-afb0-72120ff5a7e7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.151322 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.151252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.151322 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.151288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.151542 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.151386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.252374 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.252277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.252374 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.252333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.252572 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.252394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpgfd\" (UniqueName: \"kubernetes.io/projected/c91dec94-2c59-40df-afb0-72120ff5a7e7-kube-api-access-bpgfd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.252572 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.252411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91dec94-2c59-40df-afb0-72120ff5a7e7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.252572 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.252430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.252572 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.252445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.252788 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.252746    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.252845 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.252789    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.253067 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.253044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.254588 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.254560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91dec94-2c59-40df-afb0-72120ff5a7e7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.254828 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.254810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91dec94-2c59-40df-afb0-72120ff5a7e7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.261621 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.261599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpgfd\" (UniqueName: \"kubernetes.io/projected/c91dec94-2c59-40df-afb0-72120ff5a7e7-kube-api-access-bpgfd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7kwfl\" (UID: \"c91dec94-2c59-40df-afb0-72120ff5a7e7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.316316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.316288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:33:50.448676 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.448647    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"]
Aug 05 16:33:50.450905 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:33:50.450873    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91dec94_2c59_40df_afb0_72120ff5a7e7.slice/crio-bde2466ee6c3233996db8840c8af5d0e442eaef2673c55fad8ea55f225036f7f WatchSource:0}: Error finding container bde2466ee6c3233996db8840c8af5d0e442eaef2673c55fad8ea55f225036f7f: Status 404 returned error can't find the container with id bde2466ee6c3233996db8840c8af5d0e442eaef2673c55fad8ea55f225036f7f
Aug 05 16:33:50.452186 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.452166    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:33:50.655212 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:50.655136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl" event={"ID":"c91dec94-2c59-40df-afb0-72120ff5a7e7","Type":"ContainerStarted","Data":"bde2466ee6c3233996db8840c8af5d0e442eaef2673c55fad8ea55f225036f7f"}
Aug 05 16:33:51.661123 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:51.661087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl" event={"ID":"c91dec94-2c59-40df-afb0-72120ff5a7e7","Type":"ContainerStarted","Data":"9fa5308d0c94b5cc189f6201b616a0e35e10c2f0b039dfec0a61874445ffc4ad"}
Aug 05 16:33:51.683158 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:33:51.683115    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl" podStartSLOduration=2.479006987 podStartE2EDuration="2.683099923s" totalImagesPullingTime="204.092936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:33:51.68176725 +0000 UTC m=+753.017565196" watchObservedRunningTime="2026-08-05 16:33:51.683099923 +0000 UTC m=+753.018897867"
Aug 05 16:34:00.317210 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:34:00.317177    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:34:00.317632 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:34:00.317235    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:34:00.329863 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:34:00.329838    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:34:00.725548 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:34:00.725521    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7kwfl"
Aug 05 16:35:41.536872 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.536839    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-76ctg"]
Aug 05 16:35:41.537433 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.537013    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7764f5fb7b-76ctg" podUID="726a0928-9a4e-478a-ac56-00083dc9c658" containerName="manager" containerID="cri-o://bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309" gracePeriod=30
Aug 05 16:35:41.783136 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.783113    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:35:41.839281 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.839216    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvrn8\" (UniqueName: \"kubernetes.io/projected/726a0928-9a4e-478a-ac56-00083dc9c658-kube-api-access-vvrn8\") pod \"726a0928-9a4e-478a-ac56-00083dc9c658\" (UID: \"726a0928-9a4e-478a-ac56-00083dc9c658\") "
Aug 05 16:35:41.839281 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.839259    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/726a0928-9a4e-478a-ac56-00083dc9c658-webhook-cert\") pod \"726a0928-9a4e-478a-ac56-00083dc9c658\" (UID: \"726a0928-9a4e-478a-ac56-00083dc9c658\") "
Aug 05 16:35:41.841285 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.841252    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726a0928-9a4e-478a-ac56-00083dc9c658-kube-api-access-vvrn8" (OuterVolumeSpecName: "kube-api-access-vvrn8") pod "726a0928-9a4e-478a-ac56-00083dc9c658" (UID: "726a0928-9a4e-478a-ac56-00083dc9c658"). InnerVolumeSpecName "kube-api-access-vvrn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:35:41.841432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.841327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/726a0928-9a4e-478a-ac56-00083dc9c658-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "726a0928-9a4e-478a-ac56-00083dc9c658" (UID: "726a0928-9a4e-478a-ac56-00083dc9c658"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:35:41.940646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.940617    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvrn8\" (UniqueName: \"kubernetes.io/projected/726a0928-9a4e-478a-ac56-00083dc9c658-kube-api-access-vvrn8\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:35:41.940646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:41.940642    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/726a0928-9a4e-478a-ac56-00083dc9c658-webhook-cert\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:35:42.178599 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.178567    2579 generic.go:356] "Generic (PLEG): container finished" podID="726a0928-9a4e-478a-ac56-00083dc9c658" containerID="bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309" exitCode=0
Aug 05 16:35:42.178748 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.178613    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-76ctg"
Aug 05 16:35:42.178748 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.178657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-76ctg" event={"ID":"726a0928-9a4e-478a-ac56-00083dc9c658","Type":"ContainerDied","Data":"bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309"}
Aug 05 16:35:42.178748 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.178705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-76ctg" event={"ID":"726a0928-9a4e-478a-ac56-00083dc9c658","Type":"ContainerDied","Data":"f0d0951ee99f3b5c208da5e28e90c2928d5ee62b5d0424f7623cb9ce780d99e5"}
Aug 05 16:35:42.178748 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.178731    2579 scope.go:117] "RemoveContainer" containerID="bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309"
Aug 05 16:35:42.187899 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.187881    2579 scope.go:117] "RemoveContainer" containerID="bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309"
Aug 05 16:35:42.188151 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:35:42.188133    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309\": container with ID starting with bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309 not found: ID does not exist" containerID="bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309"
Aug 05 16:35:42.188189 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.188159    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309"} err="failed to get container status \"bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309\": rpc error: code = NotFound desc = could not find container \"bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309\": container with ID starting with bd04915d7ca3deec72cc1c50089429895ea8721b94a97ae0e1e3b9c7eb6f8309 not found: ID does not exist"
Aug 05 16:35:42.202461 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.202441    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-76ctg"]
Aug 05 16:35:42.208225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:42.208200    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-76ctg"]
Aug 05 16:35:43.188665 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:35:43.188624    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="726a0928-9a4e-478a-ac56-00083dc9c658" path="/var/lib/kubelet/pods/726a0928-9a4e-478a-ac56-00083dc9c658/volumes"
Aug 05 16:36:19.153310 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:19.153231    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:36:19.154111 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:19.154083    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:36:42.985927 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.985893    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-46ftf"]
Aug 05 16:36:42.986391 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.986287    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726a0928-9a4e-478a-ac56-00083dc9c658" containerName="manager"
Aug 05 16:36:42.986391 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.986299    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="726a0928-9a4e-478a-ac56-00083dc9c658" containerName="manager"
Aug 05 16:36:42.986468 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.986392    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="726a0928-9a4e-478a-ac56-00083dc9c658" containerName="manager"
Aug 05 16:36:42.989482 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.989466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:42.993760 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.993739    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:36:42.993853 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.993738    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2xqq\""
Aug 05 16:36:42.993853 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.993740    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:36:42.998990 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:42.998969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-46ftf"]
Aug 05 16:36:43.075009 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.074981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22224cf2-ceaa-400c-b32d-5b3ec0073397-webhook-cert\") pod \"maas-controller-7764f5fb7b-46ftf\" (UID: \"22224cf2-ceaa-400c-b32d-5b3ec0073397\") " pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:43.075118 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.075016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ppr\" (UniqueName: \"kubernetes.io/projected/22224cf2-ceaa-400c-b32d-5b3ec0073397-kube-api-access-j9ppr\") pod \"maas-controller-7764f5fb7b-46ftf\" (UID: \"22224cf2-ceaa-400c-b32d-5b3ec0073397\") " pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:43.175902 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.175872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22224cf2-ceaa-400c-b32d-5b3ec0073397-webhook-cert\") pod \"maas-controller-7764f5fb7b-46ftf\" (UID: \"22224cf2-ceaa-400c-b32d-5b3ec0073397\") " pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:43.176014 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.175907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ppr\" (UniqueName: \"kubernetes.io/projected/22224cf2-ceaa-400c-b32d-5b3ec0073397-kube-api-access-j9ppr\") pod \"maas-controller-7764f5fb7b-46ftf\" (UID: \"22224cf2-ceaa-400c-b32d-5b3ec0073397\") " pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:43.178257 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.178239    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22224cf2-ceaa-400c-b32d-5b3ec0073397-webhook-cert\") pod \"maas-controller-7764f5fb7b-46ftf\" (UID: \"22224cf2-ceaa-400c-b32d-5b3ec0073397\") " pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:43.185418 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.185390    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ppr\" (UniqueName: \"kubernetes.io/projected/22224cf2-ceaa-400c-b32d-5b3ec0073397-kube-api-access-j9ppr\") pod \"maas-controller-7764f5fb7b-46ftf\" (UID: \"22224cf2-ceaa-400c-b32d-5b3ec0073397\") " pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:43.300748 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.300679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:43.432911 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.432886    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-46ftf"]
Aug 05 16:36:43.434370 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:36:43.434327    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22224cf2_ceaa_400c_b32d_5b3ec0073397.slice/crio-094db1e0c0cccc0f9955de518b7f3ee457f49d6d7c38473ec8cdc9db5fcf402a WatchSource:0}: Error finding container 094db1e0c0cccc0f9955de518b7f3ee457f49d6d7c38473ec8cdc9db5fcf402a: Status 404 returned error can't find the container with id 094db1e0c0cccc0f9955de518b7f3ee457f49d6d7c38473ec8cdc9db5fcf402a
Aug 05 16:36:43.470080 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:43.470044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-46ftf" event={"ID":"22224cf2-ceaa-400c-b32d-5b3ec0073397","Type":"ContainerStarted","Data":"094db1e0c0cccc0f9955de518b7f3ee457f49d6d7c38473ec8cdc9db5fcf402a"}
Aug 05 16:36:44.476173 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:44.476133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-46ftf" event={"ID":"22224cf2-ceaa-400c-b32d-5b3ec0073397","Type":"ContainerStarted","Data":"3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2"}
Aug 05 16:36:44.476576 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:44.476197    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:36:44.497353 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:44.497303    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7764f5fb7b-46ftf" podStartSLOduration=2.027072239 podStartE2EDuration="2.497289312s" totalImagesPullingTime="470.217073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:36:44.49616135 +0000 UTC m=+925.831959295" watchObservedRunningTime="2026-08-05 16:36:44.497289312 +0000 UTC m=+925.833087285"
Aug 05 16:36:55.482964 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:36:55.482933    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:37:00.126555 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.126519    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-46ftf"]
Aug 05 16:37:00.126972 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.126711    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7764f5fb7b-46ftf" podUID="22224cf2-ceaa-400c-b32d-5b3ec0073397" containerName="manager" containerID="cri-o://3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2" gracePeriod=30
Aug 05 16:37:00.375233 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.375209    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:37:00.529779 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.529747    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9ppr\" (UniqueName: \"kubernetes.io/projected/22224cf2-ceaa-400c-b32d-5b3ec0073397-kube-api-access-j9ppr\") pod \"22224cf2-ceaa-400c-b32d-5b3ec0073397\" (UID: \"22224cf2-ceaa-400c-b32d-5b3ec0073397\") "
Aug 05 16:37:00.529942 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.529785    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22224cf2-ceaa-400c-b32d-5b3ec0073397-webhook-cert\") pod \"22224cf2-ceaa-400c-b32d-5b3ec0073397\" (UID: \"22224cf2-ceaa-400c-b32d-5b3ec0073397\") "
Aug 05 16:37:00.531805 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.531775    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22224cf2-ceaa-400c-b32d-5b3ec0073397-kube-api-access-j9ppr" (OuterVolumeSpecName: "kube-api-access-j9ppr") pod "22224cf2-ceaa-400c-b32d-5b3ec0073397" (UID: "22224cf2-ceaa-400c-b32d-5b3ec0073397"). InnerVolumeSpecName "kube-api-access-j9ppr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:37:00.532080 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.531888    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22224cf2-ceaa-400c-b32d-5b3ec0073397-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "22224cf2-ceaa-400c-b32d-5b3ec0073397" (UID: "22224cf2-ceaa-400c-b32d-5b3ec0073397"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:37:00.550261 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.550235    2579 generic.go:356] "Generic (PLEG): container finished" podID="22224cf2-ceaa-400c-b32d-5b3ec0073397" containerID="3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2" exitCode=0
Aug 05 16:37:00.550401 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.550279    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-46ftf"
Aug 05 16:37:00.550401 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.550322    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-46ftf" event={"ID":"22224cf2-ceaa-400c-b32d-5b3ec0073397","Type":"ContainerDied","Data":"3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2"}
Aug 05 16:37:00.550401 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.550384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-46ftf" event={"ID":"22224cf2-ceaa-400c-b32d-5b3ec0073397","Type":"ContainerDied","Data":"094db1e0c0cccc0f9955de518b7f3ee457f49d6d7c38473ec8cdc9db5fcf402a"}
Aug 05 16:37:00.550553 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.550415    2579 scope.go:117] "RemoveContainer" containerID="3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2"
Aug 05 16:37:00.558617 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.558598    2579 scope.go:117] "RemoveContainer" containerID="3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2"
Aug 05 16:37:00.558889 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:37:00.558867    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2\": container with ID starting with 3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2 not found: ID does not exist" containerID="3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2"
Aug 05 16:37:00.558961 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.558896    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2"} err="failed to get container status \"3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2\": rpc error: code = NotFound desc = could not find container \"3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2\": container with ID starting with 3c6eb1799617925c6f596b06f1d3c9a2dfdb8ebb6f865562f4ed528dd64987f2 not found: ID does not exist"
Aug 05 16:37:00.573833 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.573813    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-46ftf"]
Aug 05 16:37:00.580304 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.578054    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-46ftf"]
Aug 05 16:37:00.630585 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.630561    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9ppr\" (UniqueName: \"kubernetes.io/projected/22224cf2-ceaa-400c-b32d-5b3ec0073397-kube-api-access-j9ppr\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:37:00.630585 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:00.630583    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22224cf2-ceaa-400c-b32d-5b3ec0073397-webhook-cert\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:37:01.188016 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.187979    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22224cf2-ceaa-400c-b32d-5b3ec0073397" path="/var/lib/kubelet/pods/22224cf2-ceaa-400c-b32d-5b3ec0073397/volumes"
Aug 05 16:37:01.327696 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.327668    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-mppdg"]
Aug 05 16:37:01.328046 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.328034    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22224cf2-ceaa-400c-b32d-5b3ec0073397" containerName="manager"
Aug 05 16:37:01.328092 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.328048    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22224cf2-ceaa-400c-b32d-5b3ec0073397" containerName="manager"
Aug 05 16:37:01.328129 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.328111    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22224cf2-ceaa-400c-b32d-5b3ec0073397" containerName="manager"
Aug 05 16:37:01.332534 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.332511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:01.336722 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.336695    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2xqq\""
Aug 05 16:37:01.336722 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.336703    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:37:01.336887 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.336742    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:37:01.342381 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.342359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-mppdg"]
Aug 05 16:37:01.438505 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.438485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r4qx\" (UniqueName: \"kubernetes.io/projected/8328252f-6ff8-4b4b-8524-f6d08d4520c8-kube-api-access-8r4qx\") pod \"maas-controller-7764f5fb7b-mppdg\" (UID: \"8328252f-6ff8-4b4b-8524-f6d08d4520c8\") " pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:01.438615 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.438549    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8328252f-6ff8-4b4b-8524-f6d08d4520c8-webhook-cert\") pod \"maas-controller-7764f5fb7b-mppdg\" (UID: \"8328252f-6ff8-4b4b-8524-f6d08d4520c8\") " pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:01.539459 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.539436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8328252f-6ff8-4b4b-8524-f6d08d4520c8-webhook-cert\") pod \"maas-controller-7764f5fb7b-mppdg\" (UID: \"8328252f-6ff8-4b4b-8524-f6d08d4520c8\") " pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:01.539574 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.539492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r4qx\" (UniqueName: \"kubernetes.io/projected/8328252f-6ff8-4b4b-8524-f6d08d4520c8-kube-api-access-8r4qx\") pod \"maas-controller-7764f5fb7b-mppdg\" (UID: \"8328252f-6ff8-4b4b-8524-f6d08d4520c8\") " pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:01.541744 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.541723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8328252f-6ff8-4b4b-8524-f6d08d4520c8-webhook-cert\") pod \"maas-controller-7764f5fb7b-mppdg\" (UID: \"8328252f-6ff8-4b4b-8524-f6d08d4520c8\") " pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:01.549511 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.549486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r4qx\" (UniqueName: \"kubernetes.io/projected/8328252f-6ff8-4b4b-8524-f6d08d4520c8-kube-api-access-8r4qx\") pod \"maas-controller-7764f5fb7b-mppdg\" (UID: \"8328252f-6ff8-4b4b-8524-f6d08d4520c8\") " pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:01.644317 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.644292    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:01.773768 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:01.773737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7764f5fb7b-mppdg"]
Aug 05 16:37:01.774613 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:37:01.774587    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8328252f_6ff8_4b4b_8524_f6d08d4520c8.slice/crio-05d7b746a1d366c102df0398881d91d9fe940e56f01e76f5f14c862aaa4a203c WatchSource:0}: Error finding container 05d7b746a1d366c102df0398881d91d9fe940e56f01e76f5f14c862aaa4a203c: Status 404 returned error can't find the container with id 05d7b746a1d366c102df0398881d91d9fe940e56f01e76f5f14c862aaa4a203c
Aug 05 16:37:02.562363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:02.562257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-mppdg" event={"ID":"8328252f-6ff8-4b4b-8524-f6d08d4520c8","Type":"ContainerStarted","Data":"b2513241e95c14c3468405bf4165b0d6056d0b793643d88d0fefea24fea29151"}
Aug 05 16:37:02.562363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:02.562324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7764f5fb7b-mppdg" event={"ID":"8328252f-6ff8-4b4b-8524-f6d08d4520c8","Type":"ContainerStarted","Data":"05d7b746a1d366c102df0398881d91d9fe940e56f01e76f5f14c862aaa4a203c"}
Aug 05 16:37:02.562833 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:02.562372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:37:02.582031 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:02.581980    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7764f5fb7b-mppdg" podStartSLOduration=1.150722187 podStartE2EDuration="1.581965174s" totalImagesPullingTime="431.242987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:37:02.580317262 +0000 UTC m=+943.916115226" watchObservedRunningTime="2026-08-05 16:37:02.581965174 +0000 UTC m=+943.917763118"
Aug 05 16:37:13.569396 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:37:13.569338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7764f5fb7b-mppdg"
Aug 05 16:41:19.190585 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:41:19.190554    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:41:19.193006 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:41:19.192982    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:46:19.218744 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:46:19.218713    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:46:19.222621 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:46:19.222597    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:51:19.248128 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:51:19.248100    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:51:19.252792 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:51:19.252770    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:53:16.047090 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.047060    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"]
Aug 05 16:53:16.050635 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.050620    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.057764 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.057743    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ffdafb25-serving-cert\""
Aug 05 16:53:16.083214 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.083187    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"]
Aug 05 16:53:16.137979 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.137944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/522293a9-d712-4a18-bab7-7c8483040b6a-openshift-service-ca\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.138187 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.137986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgp68\" (UniqueName: \"kubernetes.io/projected/522293a9-d712-4a18-bab7-7c8483040b6a-kube-api-access-mgp68\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.138312 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.138249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/522293a9-d712-4a18-bab7-7c8483040b6a-maas-api-tls\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.239646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.239615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/522293a9-d712-4a18-bab7-7c8483040b6a-maas-api-tls\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.239859 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.239714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/522293a9-d712-4a18-bab7-7c8483040b6a-openshift-service-ca\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.239859 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.239732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgp68\" (UniqueName: \"kubernetes.io/projected/522293a9-d712-4a18-bab7-7c8483040b6a-kube-api-access-mgp68\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.240384 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.240363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/522293a9-d712-4a18-bab7-7c8483040b6a-openshift-service-ca\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.242001 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.241981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/522293a9-d712-4a18-bab7-7c8483040b6a-maas-api-tls\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.268601 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.268574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgp68\" (UniqueName: \"kubernetes.io/projected/522293a9-d712-4a18-bab7-7c8483040b6a-kube-api-access-mgp68\") pod \"maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.361115 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.361038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:16.502937 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.502910    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"]
Aug 05 16:53:16.505224 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:53:16.505194    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522293a9_d712_4a18_bab7_7c8483040b6a.slice/crio-5b6411b22aeb824900920a2c7287ea23f4f6eb94bdacf39ef70148029548c1dd WatchSource:0}: Error finding container 5b6411b22aeb824900920a2c7287ea23f4f6eb94bdacf39ef70148029548c1dd: Status 404 returned error can't find the container with id 5b6411b22aeb824900920a2c7287ea23f4f6eb94bdacf39ef70148029548c1dd
Aug 05 16:53:16.506608 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:16.506588    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:53:17.090032 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.089998    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"]
Aug 05 16:53:17.095434 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.095407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:17.102646 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.102621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ffdafb25-dockercfg-998zl\""
Aug 05 16:53:17.106427 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.106407    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ffdafb25\""
Aug 05 16:53:17.120178 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.120146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9" event={"ID":"522293a9-d712-4a18-bab7-7c8483040b6a","Type":"ContainerStarted","Data":"5b6411b22aeb824900920a2c7287ea23f4f6eb94bdacf39ef70148029548c1dd"}
Aug 05 16:53:17.122545 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.122520    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"]
Aug 05 16:53:17.140607 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.140580    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"]
Aug 05 16:53:17.144067 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.144051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:17.176006 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.175974    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"]
Aug 05 16:53:17.248213 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.248181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x486\" (UniqueName: \"kubernetes.io/projected/d07e4979-e284-433e-9713-3b64c4d26524-kube-api-access-9x486\") pod \"payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c\" (UID: \"d07e4979-e284-433e-9713-3b64c4d26524\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:17.248427 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.248279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073e3752-18ba-4776-9937-73f81850b10b-plugins-config-volume\") pod \"payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p\" (UID: \"073e3752-18ba-4776-9937-73f81850b10b\") " pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:17.248427 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.248322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2kp2\" (UniqueName: \"kubernetes.io/projected/073e3752-18ba-4776-9937-73f81850b10b-kube-api-access-k2kp2\") pod \"payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p\" (UID: \"073e3752-18ba-4776-9937-73f81850b10b\") " pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:17.248562 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.248445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07e4979-e284-433e-9713-3b64c4d26524-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c\" (UID: \"d07e4979-e284-433e-9713-3b64c4d26524\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:17.349326 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.349296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07e4979-e284-433e-9713-3b64c4d26524-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c\" (UID: \"d07e4979-e284-433e-9713-3b64c4d26524\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:17.349462 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.349406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x486\" (UniqueName: \"kubernetes.io/projected/d07e4979-e284-433e-9713-3b64c4d26524-kube-api-access-9x486\") pod \"payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c\" (UID: \"d07e4979-e284-433e-9713-3b64c4d26524\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:17.349462 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.349435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073e3752-18ba-4776-9937-73f81850b10b-plugins-config-volume\") pod \"payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p\" (UID: \"073e3752-18ba-4776-9937-73f81850b10b\") " pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:17.349596 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.349473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2kp2\" (UniqueName: \"kubernetes.io/projected/073e3752-18ba-4776-9937-73f81850b10b-kube-api-access-k2kp2\") pod \"payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p\" (UID: \"073e3752-18ba-4776-9937-73f81850b10b\") " pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:17.350202 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.350178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07e4979-e284-433e-9713-3b64c4d26524-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c\" (UID: \"d07e4979-e284-433e-9713-3b64c4d26524\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:17.350321 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.350302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073e3752-18ba-4776-9937-73f81850b10b-plugins-config-volume\") pod \"payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p\" (UID: \"073e3752-18ba-4776-9937-73f81850b10b\") " pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:17.364463 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.364438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2kp2\" (UniqueName: \"kubernetes.io/projected/073e3752-18ba-4776-9937-73f81850b10b-kube-api-access-k2kp2\") pod \"payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p\" (UID: \"073e3752-18ba-4776-9937-73f81850b10b\") " pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:17.364833 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.364815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x486\" (UniqueName: \"kubernetes.io/projected/d07e4979-e284-433e-9713-3b64c4d26524-kube-api-access-9x486\") pod \"payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c\" (UID: \"d07e4979-e284-433e-9713-3b64c4d26524\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:17.406539 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.406514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:17.454701 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.454672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:17.571028 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.571000    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"]
Aug 05 16:53:17.573385 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:53:17.573356    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07e4979_e284_433e_9713_3b64c4d26524.slice/crio-644c338e4a6a15ef728fd635000878dc96515446f43360fa142796f2757dc99d WatchSource:0}: Error finding container 644c338e4a6a15ef728fd635000878dc96515446f43360fa142796f2757dc99d: Status 404 returned error can't find the container with id 644c338e4a6a15ef728fd635000878dc96515446f43360fa142796f2757dc99d
Aug 05 16:53:17.625911 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:17.621731    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"]
Aug 05 16:53:17.646894 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:53:17.646867    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073e3752_18ba_4776_9937_73f81850b10b.slice/crio-5090c9a8b9d6be63f2bd81610962848bab97e401b50d4f3caa6c523f08ebde32 WatchSource:0}: Error finding container 5090c9a8b9d6be63f2bd81610962848bab97e401b50d4f3caa6c523f08ebde32: Status 404 returned error can't find the container with id 5090c9a8b9d6be63f2bd81610962848bab97e401b50d4f3caa6c523f08ebde32
Aug 05 16:53:18.128645 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.128607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9" event={"ID":"522293a9-d712-4a18-bab7-7c8483040b6a","Type":"ContainerStarted","Data":"f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06"}
Aug 05 16:53:18.129125 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.128678    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:18.130213 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.130185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c" event={"ID":"d07e4979-e284-433e-9713-3b64c4d26524","Type":"ContainerStarted","Data":"0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148"}
Aug 05 16:53:18.130371 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.130242    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:18.130371 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.130266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c" event={"ID":"d07e4979-e284-433e-9713-3b64c4d26524","Type":"ContainerStarted","Data":"644c338e4a6a15ef728fd635000878dc96515446f43360fa142796f2757dc99d"}
Aug 05 16:53:18.131759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.131730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p" event={"ID":"073e3752-18ba-4776-9937-73f81850b10b","Type":"ContainerStarted","Data":"25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba"}
Aug 05 16:53:18.131865 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.131780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p" event={"ID":"073e3752-18ba-4776-9937-73f81850b10b","Type":"ContainerStarted","Data":"5090c9a8b9d6be63f2bd81610962848bab97e401b50d4f3caa6c523f08ebde32"}
Aug 05 16:53:18.131865 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.131813    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:18.157399 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.157325    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9" podStartSLOduration=2.353460806 podStartE2EDuration="3.157312001s" totalImagesPullingTime="803.851195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:53:18.156125874 +0000 UTC m=+1919.491923818" watchObservedRunningTime="2026-08-05 16:53:18.157312001 +0000 UTC m=+1919.493109984"
Aug 05 16:53:18.179748 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.179707    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c" podStartSLOduration=1.179692649 podStartE2EDuration="1.179692649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:53:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:53:18.179390913 +0000 UTC m=+1919.515188856" watchObservedRunningTime="2026-08-05 16:53:18.179692649 +0000 UTC m=+1919.515490594"
Aug 05 16:53:18.202648 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:18.202605    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p" podStartSLOduration=1.202593267 podStartE2EDuration="1.202593267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:53:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:53:18.202189293 +0000 UTC m=+1919.537987236" watchObservedRunningTime="2026-08-05 16:53:18.202593267 +0000 UTC m=+1919.538391210"
Aug 05 16:53:24.143764 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:24.143738    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:29.140433 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:29.140395    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:29.140868 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:29.140563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:46.786091 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:46.786058    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"]
Aug 05 16:53:46.786540 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:46.786261    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9" podUID="522293a9-d712-4a18-bab7-7c8483040b6a" containerName="maas-api" containerID="cri-o://f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06" gracePeriod=30
Aug 05 16:53:46.873855 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:46.873824    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"]
Aug 05 16:53:46.874084 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:46.874057    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p" podUID="073e3752-18ba-4776-9937-73f81850b10b" containerName="payload-processing" containerID="cri-o://25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba" gracePeriod=30
Aug 05 16:53:46.879128 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:46.877946    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"]
Aug 05 16:53:46.879128 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:46.878142    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c" podUID="d07e4979-e284-433e-9713-3b64c4d26524" containerName="payload-pre-processing" containerID="cri-o://0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148" gracePeriod=30
Aug 05 16:53:47.140962 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.140928    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:47.156828 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.156802    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:47.166648 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.166628    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:47.229989 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.229960    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/522293a9-d712-4a18-bab7-7c8483040b6a-openshift-service-ca\") pod \"522293a9-d712-4a18-bab7-7c8483040b6a\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") "
Aug 05 16:53:47.230239 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.230003    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x486\" (UniqueName: \"kubernetes.io/projected/d07e4979-e284-433e-9713-3b64c4d26524-kube-api-access-9x486\") pod \"d07e4979-e284-433e-9713-3b64c4d26524\" (UID: \"d07e4979-e284-433e-9713-3b64c4d26524\") "
Aug 05 16:53:47.230239 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.230101    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2kp2\" (UniqueName: \"kubernetes.io/projected/073e3752-18ba-4776-9937-73f81850b10b-kube-api-access-k2kp2\") pod \"073e3752-18ba-4776-9937-73f81850b10b\" (UID: \"073e3752-18ba-4776-9937-73f81850b10b\") "
Aug 05 16:53:47.230329 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.230308    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07e4979-e284-433e-9713-3b64c4d26524-plugins-config-volume\") pod \"d07e4979-e284-433e-9713-3b64c4d26524\" (UID: \"d07e4979-e284-433e-9713-3b64c4d26524\") "
Aug 05 16:53:47.230419 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.230397    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/522293a9-d712-4a18-bab7-7c8483040b6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "522293a9-d712-4a18-bab7-7c8483040b6a" (UID: "522293a9-d712-4a18-bab7-7c8483040b6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:53:47.230491 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.230468    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073e3752-18ba-4776-9937-73f81850b10b-plugins-config-volume\") pod \"073e3752-18ba-4776-9937-73f81850b10b\" (UID: \"073e3752-18ba-4776-9937-73f81850b10b\") "
Aug 05 16:53:47.230543 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.230501    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgp68\" (UniqueName: \"kubernetes.io/projected/522293a9-d712-4a18-bab7-7c8483040b6a-kube-api-access-mgp68\") pod \"522293a9-d712-4a18-bab7-7c8483040b6a\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") "
Aug 05 16:53:47.230543 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.230526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/522293a9-d712-4a18-bab7-7c8483040b6a-maas-api-tls\") pod \"522293a9-d712-4a18-bab7-7c8483040b6a\" (UID: \"522293a9-d712-4a18-bab7-7c8483040b6a\") "
Aug 05 16:53:47.231951 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.231923    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/073e3752-18ba-4776-9937-73f81850b10b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "073e3752-18ba-4776-9937-73f81850b10b" (UID: "073e3752-18ba-4776-9937-73f81850b10b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:53:47.233872 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.233847    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/522293a9-d712-4a18-bab7-7c8483040b6a-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:53:47.234144 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.234120    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/522293a9-d712-4a18-bab7-7c8483040b6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "522293a9-d712-4a18-bab7-7c8483040b6a" (UID: "522293a9-d712-4a18-bab7-7c8483040b6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:53:47.234239 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.234172    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d07e4979-e284-433e-9713-3b64c4d26524-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d07e4979-e284-433e-9713-3b64c4d26524" (UID: "d07e4979-e284-433e-9713-3b64c4d26524"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:53:47.236029 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.235990    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522293a9-d712-4a18-bab7-7c8483040b6a-kube-api-access-mgp68" (OuterVolumeSpecName: "kube-api-access-mgp68") pod "522293a9-d712-4a18-bab7-7c8483040b6a" (UID: "522293a9-d712-4a18-bab7-7c8483040b6a"). InnerVolumeSpecName "kube-api-access-mgp68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:53:47.236029 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.236004    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073e3752-18ba-4776-9937-73f81850b10b-kube-api-access-k2kp2" (OuterVolumeSpecName: "kube-api-access-k2kp2") pod "073e3752-18ba-4776-9937-73f81850b10b" (UID: "073e3752-18ba-4776-9937-73f81850b10b"). InnerVolumeSpecName "kube-api-access-k2kp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:53:47.236144 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.236042    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d07e4979-e284-433e-9713-3b64c4d26524-kube-api-access-9x486" (OuterVolumeSpecName: "kube-api-access-9x486") pod "d07e4979-e284-433e-9713-3b64c4d26524" (UID: "d07e4979-e284-433e-9713-3b64c4d26524"). InnerVolumeSpecName "kube-api-access-9x486". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:53:47.271244 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.271206    2579 generic.go:356] "Generic (PLEG): container finished" podID="522293a9-d712-4a18-bab7-7c8483040b6a" containerID="f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06" exitCode=0
Aug 05 16:53:47.271420 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.271269    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"
Aug 05 16:53:47.271420 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.271293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9" event={"ID":"522293a9-d712-4a18-bab7-7c8483040b6a","Type":"ContainerDied","Data":"f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06"}
Aug 05 16:53:47.271420 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.271374    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9" event={"ID":"522293a9-d712-4a18-bab7-7c8483040b6a","Type":"ContainerDied","Data":"5b6411b22aeb824900920a2c7287ea23f4f6eb94bdacf39ef70148029548c1dd"}
Aug 05 16:53:47.271420 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.271407    2579 scope.go:117] "RemoveContainer" containerID="f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06"
Aug 05 16:53:47.272977 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.272939    2579 generic.go:356] "Generic (PLEG): container finished" podID="d07e4979-e284-433e-9713-3b64c4d26524" containerID="0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148" exitCode=0
Aug 05 16:53:47.273088 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.272997    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"
Aug 05 16:53:47.273088 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.273044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c" event={"ID":"d07e4979-e284-433e-9713-3b64c4d26524","Type":"ContainerDied","Data":"0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148"}
Aug 05 16:53:47.273191 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.273100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c" event={"ID":"d07e4979-e284-433e-9713-3b64c4d26524","Type":"ContainerDied","Data":"644c338e4a6a15ef728fd635000878dc96515446f43360fa142796f2757dc99d"}
Aug 05 16:53:47.274601 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.274576    2579 generic.go:356] "Generic (PLEG): container finished" podID="073e3752-18ba-4776-9937-73f81850b10b" containerID="25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba" exitCode=0
Aug 05 16:53:47.274710 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.274639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p" event={"ID":"073e3752-18ba-4776-9937-73f81850b10b","Type":"ContainerDied","Data":"25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba"}
Aug 05 16:53:47.274710 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.274677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p" event={"ID":"073e3752-18ba-4776-9937-73f81850b10b","Type":"ContainerDied","Data":"5090c9a8b9d6be63f2bd81610962848bab97e401b50d4f3caa6c523f08ebde32"}
Aug 05 16:53:47.274710 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.274642    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"
Aug 05 16:53:47.281862 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.281844    2579 scope.go:117] "RemoveContainer" containerID="f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06"
Aug 05 16:53:47.282134 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:53:47.282113    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06\": container with ID starting with f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06 not found: ID does not exist" containerID="f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06"
Aug 05 16:53:47.282212 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.282142    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06"} err="failed to get container status \"f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06\": rpc error: code = NotFound desc = could not find container \"f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06\": container with ID starting with f6032f539ebf67204512fbebdbdfb93374539a36108aa751616c6ce59832aa06 not found: ID does not exist"
Aug 05 16:53:47.282212 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.282158    2579 scope.go:117] "RemoveContainer" containerID="0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148"
Aug 05 16:53:47.291529 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.291510    2579 scope.go:117] "RemoveContainer" containerID="0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148"
Aug 05 16:53:47.291778 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:53:47.291759    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148\": container with ID starting with 0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148 not found: ID does not exist" containerID="0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148"
Aug 05 16:53:47.291822 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.291785    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148"} err="failed to get container status \"0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148\": rpc error: code = NotFound desc = could not find container \"0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148\": container with ID starting with 0bdde199c7a488dd448efec3f317dfa30b4c7213e43665696fc6d8634597a148 not found: ID does not exist"
Aug 05 16:53:47.291822 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.291802    2579 scope.go:117] "RemoveContainer" containerID="25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba"
Aug 05 16:53:47.299185 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.299167    2579 scope.go:117] "RemoveContainer" containerID="25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba"
Aug 05 16:53:47.299451 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:53:47.299433    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba\": container with ID starting with 25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba not found: ID does not exist" containerID="25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba"
Aug 05 16:53:47.299511 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.299457    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba"} err="failed to get container status \"25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba\": rpc error: code = NotFound desc = could not find container \"25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba\": container with ID starting with 25d26d20d7ac425c9821ed6aacd126397ef8bdb008db6f1f80782b381c14d0ba not found: ID does not exist"
Aug 05 16:53:47.313388 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.313369    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"]
Aug 05 16:53:47.332579 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.332560    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c"]
Aug 05 16:53:47.334436 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.334414    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073e3752-18ba-4776-9937-73f81850b10b-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:53:47.334542 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.334439    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgp68\" (UniqueName: \"kubernetes.io/projected/522293a9-d712-4a18-bab7-7c8483040b6a-kube-api-access-mgp68\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:53:47.334542 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.334455    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/522293a9-d712-4a18-bab7-7c8483040b6a-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:53:47.334542 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.334471    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x486\" (UniqueName: \"kubernetes.io/projected/d07e4979-e284-433e-9713-3b64c4d26524-kube-api-access-9x486\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:53:47.334542 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.334486    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2kp2\" (UniqueName: \"kubernetes.io/projected/073e3752-18ba-4776-9937-73f81850b10b-kube-api-access-k2kp2\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:53:47.334542 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.334501    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07e4979-e284-433e-9713-3b64c4d26524-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:53:47.352976 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.352957    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"]
Aug 05 16:53:47.358357 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.358327    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffdafb25-d7d65bc7c-b5bl9"]
Aug 05 16:53:47.374787 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.374766    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"]
Aug 05 16:53:47.379037 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:47.379019    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p"]
Aug 05 16:53:49.188845 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:49.188815    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="073e3752-18ba-4776-9937-73f81850b10b" path="/var/lib/kubelet/pods/073e3752-18ba-4776-9937-73f81850b10b/volumes"
Aug 05 16:53:49.189205 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:49.189178    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="522293a9-d712-4a18-bab7-7c8483040b6a" path="/var/lib/kubelet/pods/522293a9-d712-4a18-bab7-7c8483040b6a/volumes"
Aug 05 16:53:49.189510 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:49.189496    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d07e4979-e284-433e-9713-3b64c4d26524" path="/var/lib/kubelet/pods/d07e4979-e284-433e-9713-3b64c4d26524/volumes"
Aug 05 16:53:51.128670 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.128642    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"]
Aug 05 16:53:51.129058 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129028    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07e4979-e284-433e-9713-3b64c4d26524" containerName="payload-pre-processing"
Aug 05 16:53:51.129058 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129040    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07e4979-e284-433e-9713-3b64c4d26524" containerName="payload-pre-processing"
Aug 05 16:53:51.129058 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129053    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522293a9-d712-4a18-bab7-7c8483040b6a" containerName="maas-api"
Aug 05 16:53:51.129161 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129072    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="522293a9-d712-4a18-bab7-7c8483040b6a" containerName="maas-api"
Aug 05 16:53:51.129161 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129089    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073e3752-18ba-4776-9937-73f81850b10b" containerName="payload-processing"
Aug 05 16:53:51.129161 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129096    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="073e3752-18ba-4776-9937-73f81850b10b" containerName="payload-processing"
Aug 05 16:53:51.129161 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129156    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="522293a9-d712-4a18-bab7-7c8483040b6a" containerName="maas-api"
Aug 05 16:53:51.129282 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129163    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d07e4979-e284-433e-9713-3b64c4d26524" containerName="payload-pre-processing"
Aug 05 16:53:51.129282 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.129171    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="073e3752-18ba-4776-9937-73f81850b10b" containerName="payload-processing"
Aug 05 16:53:51.133964 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.133940    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.137472 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.137449    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-bb276d9d-serving-cert\""
Aug 05 16:53:51.157363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.157325    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"]
Aug 05 16:53:51.270082 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.270053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.270232 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.270121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.270232 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.270165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5w9b\" (UniqueName: \"kubernetes.io/projected/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-kube-api-access-k5w9b\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.370909 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.370870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.371086 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.370917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5w9b\" (UniqueName: \"kubernetes.io/projected/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-kube-api-access-k5w9b\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.371086 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.370974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.371086 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:53:51.371070    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-serving-cert: secret "maas-api-e2e-migrate-bb276d9d-serving-cert" not found
Aug 05 16:53:51.371189 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:53:51.371133    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls podName:47d7eff8-c551-4ed2-a7b3-9c147629b4ba nodeName:}" failed. No retries permitted until 2026-08-05 16:53:51.871116304 +0000 UTC m=+1953.206914226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls") pod "maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6" (UID: "47d7eff8-c551-4ed2-a7b3-9c147629b4ba") : secret "maas-api-e2e-migrate-bb276d9d-serving-cert" not found
Aug 05 16:53:51.371584 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.371565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.384588 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.384532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5w9b\" (UniqueName: \"kubernetes.io/projected/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-kube-api-access-k5w9b\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.875508 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.875473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:51.877929 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:51.877910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls\") pod \"maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:52.045141 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.045097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:52.066860 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.066830    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"]
Aug 05 16:53:52.070686 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.070657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:52.074227 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.074188    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-bb276d9d\""
Aug 05 16:53:52.074377 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.074289    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-bb276d9d-dockercfg-brcfc\""
Aug 05 16:53:52.086608 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.086582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"]
Aug 05 16:53:52.137558 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.137425    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"]
Aug 05 16:53:52.141487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.141464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:52.160517 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.160493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"]
Aug 05 16:53:52.178397 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.178306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwng\" (UniqueName: \"kubernetes.io/projected/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-kube-api-access-5qwng\") pod \"payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp\" (UID: \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:52.179100 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.179073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp\" (UID: \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:52.210070 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.210048    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"]
Aug 05 16:53:52.213193 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:53:52.213170    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d7eff8_c551_4ed2_a7b3_9c147629b4ba.slice/crio-3b8ec0958cb4138f4f617cec5db1af2deccc8982179dd95c2cda863b09ba7cc6 WatchSource:0}: Error finding container 3b8ec0958cb4138f4f617cec5db1af2deccc8982179dd95c2cda863b09ba7cc6: Status 404 returned error can't find the container with id 3b8ec0958cb4138f4f617cec5db1af2deccc8982179dd95c2cda863b09ba7cc6
Aug 05 16:53:52.280444 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.280416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp\" (UID: \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:52.280570 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.280458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7408b7-daea-4b32-a3f9-22ce43664978-plugins-config-volume\") pod \"payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz\" (UID: \"7b7408b7-daea-4b32-a3f9-22ce43664978\") " pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:52.280570 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.280547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgv9d\" (UniqueName: \"kubernetes.io/projected/7b7408b7-daea-4b32-a3f9-22ce43664978-kube-api-access-kgv9d\") pod \"payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz\" (UID: \"7b7408b7-daea-4b32-a3f9-22ce43664978\") " pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:52.280644 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.280592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwng\" (UniqueName: \"kubernetes.io/projected/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-kube-api-access-5qwng\") pod \"payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp\" (UID: \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:52.281150 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.281128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp\" (UID: \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:52.290175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.290151    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwng\" (UniqueName: \"kubernetes.io/projected/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-kube-api-access-5qwng\") pod \"payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp\" (UID: \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:52.306339 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.306311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6" event={"ID":"47d7eff8-c551-4ed2-a7b3-9c147629b4ba","Type":"ContainerStarted","Data":"3b8ec0958cb4138f4f617cec5db1af2deccc8982179dd95c2cda863b09ba7cc6"}
Aug 05 16:53:52.381054 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.381027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgv9d\" (UniqueName: \"kubernetes.io/projected/7b7408b7-daea-4b32-a3f9-22ce43664978-kube-api-access-kgv9d\") pod \"payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz\" (UID: \"7b7408b7-daea-4b32-a3f9-22ce43664978\") " pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:52.381165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.381073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7408b7-daea-4b32-a3f9-22ce43664978-plugins-config-volume\") pod \"payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz\" (UID: \"7b7408b7-daea-4b32-a3f9-22ce43664978\") " pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:52.381427 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.381407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:52.381759 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.381741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7408b7-daea-4b32-a3f9-22ce43664978-plugins-config-volume\") pod \"payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz\" (UID: \"7b7408b7-daea-4b32-a3f9-22ce43664978\") " pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:52.390937 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.390885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgv9d\" (UniqueName: \"kubernetes.io/projected/7b7408b7-daea-4b32-a3f9-22ce43664978-kube-api-access-kgv9d\") pod \"payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz\" (UID: \"7b7408b7-daea-4b32-a3f9-22ce43664978\") " pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:52.454540 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.454511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:52.524813 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.524785    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"]
Aug 05 16:53:52.528887 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:53:52.528819    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a7ecc5_934c_46e1_9e95_13047ebe8d1d.slice/crio-7f16875a037ff1b40819b31678702f75426825b3ef005ffb3a4adcb39e4f596b WatchSource:0}: Error finding container 7f16875a037ff1b40819b31678702f75426825b3ef005ffb3a4adcb39e4f596b: Status 404 returned error can't find the container with id 7f16875a037ff1b40819b31678702f75426825b3ef005ffb3a4adcb39e4f596b
Aug 05 16:53:52.611610 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:52.611537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"]
Aug 05 16:53:52.613828 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:53:52.613807    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7408b7_daea_4b32_a3f9_22ce43664978.slice/crio-49932bebedd5ec4e15cd0ae777e7406c1a8703206ea62f24231b93807c5e1306 WatchSource:0}: Error finding container 49932bebedd5ec4e15cd0ae777e7406c1a8703206ea62f24231b93807c5e1306: Status 404 returned error can't find the container with id 49932bebedd5ec4e15cd0ae777e7406c1a8703206ea62f24231b93807c5e1306
Aug 05 16:53:53.314174 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.314149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp" event={"ID":"62a7ecc5-934c-46e1-9e95-13047ebe8d1d","Type":"ContainerStarted","Data":"37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3"}
Aug 05 16:53:53.314509 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.314314    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:53:53.314509 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.314373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp" event={"ID":"62a7ecc5-934c-46e1-9e95-13047ebe8d1d","Type":"ContainerStarted","Data":"7f16875a037ff1b40819b31678702f75426825b3ef005ffb3a4adcb39e4f596b"}
Aug 05 16:53:53.315758 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.315735    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6" event={"ID":"47d7eff8-c551-4ed2-a7b3-9c147629b4ba","Type":"ContainerStarted","Data":"ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c"}
Aug 05 16:53:53.315849 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.315794    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:53:53.317048 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.317029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz" event={"ID":"7b7408b7-daea-4b32-a3f9-22ce43664978","Type":"ContainerStarted","Data":"5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8"}
Aug 05 16:53:53.317130 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.317068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz" event={"ID":"7b7408b7-daea-4b32-a3f9-22ce43664978","Type":"ContainerStarted","Data":"49932bebedd5ec4e15cd0ae777e7406c1a8703206ea62f24231b93807c5e1306"}
Aug 05 16:53:53.317175 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.317139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:53:53.351512 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.351463    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp" podStartSLOduration=1.35144771 podStartE2EDuration="1.35144771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:53:53.351331247 +0000 UTC m=+1954.687129191" watchObservedRunningTime="2026-08-05 16:53:53.35144771 +0000 UTC m=+1954.687245654"
Aug 05 16:53:53.379481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.379431    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6" podStartSLOduration=1.339343237 podStartE2EDuration="2.379410397s" totalImagesPullingTime="1.04006716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:53:53.377675367 +0000 UTC m=+1954.713473311" watchObservedRunningTime="2026-08-05 16:53:53.379410397 +0000 UTC m=+1954.715208340"
Aug 05 16:53:53.410591 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:53.410544    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz" podStartSLOduration=1.41052705 podStartE2EDuration="1.41052705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:53:53.410262309 +0000 UTC m=+1954.746060253" watchObservedRunningTime="2026-08-05 16:53:53.41052705 +0000 UTC m=+1954.746324995"
Aug 05 16:53:59.328919 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:53:59.328887    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:54:04.325689 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:04.325657    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:54:04.326132 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:04.325823    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:54:42.745552 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:42.745515    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"]
Aug 05 16:54:42.748079 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:42.745743    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6" podUID="47d7eff8-c551-4ed2-a7b3-9c147629b4ba" containerName="maas-api" containerID="cri-o://ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c" gracePeriod=30
Aug 05 16:54:42.997039 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:42.996983    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:54:43.170143 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.170107    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5w9b\" (UniqueName: \"kubernetes.io/projected/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-kube-api-access-k5w9b\") pod \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") "
Aug 05 16:54:43.170328 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.170167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-openshift-service-ca\") pod \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") "
Aug 05 16:54:43.170328 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.170259    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls\") pod \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\" (UID: \"47d7eff8-c551-4ed2-a7b3-9c147629b4ba\") "
Aug 05 16:54:43.170618 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.170593    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "47d7eff8-c551-4ed2-a7b3-9c147629b4ba" (UID: "47d7eff8-c551-4ed2-a7b3-9c147629b4ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:54:43.172279 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.172253    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "47d7eff8-c551-4ed2-a7b3-9c147629b4ba" (UID: "47d7eff8-c551-4ed2-a7b3-9c147629b4ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:54:43.172400 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.172378    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-kube-api-access-k5w9b" (OuterVolumeSpecName: "kube-api-access-k5w9b") pod "47d7eff8-c551-4ed2-a7b3-9c147629b4ba" (UID: "47d7eff8-c551-4ed2-a7b3-9c147629b4ba"). InnerVolumeSpecName "kube-api-access-k5w9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:54:43.271973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.271893    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5w9b\" (UniqueName: \"kubernetes.io/projected/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-kube-api-access-k5w9b\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:54:43.271973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.271920    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:54:43.271973 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.271931    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d7eff8-c551-4ed2-a7b3-9c147629b4ba-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:54:43.565576 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.565476    2579 generic.go:356] "Generic (PLEG): container finished" podID="47d7eff8-c551-4ed2-a7b3-9c147629b4ba" containerID="ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c" exitCode=0
Aug 05 16:54:43.565576 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.565519    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"
Aug 05 16:54:43.565815 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.565568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6" event={"ID":"47d7eff8-c551-4ed2-a7b3-9c147629b4ba","Type":"ContainerDied","Data":"ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c"}
Aug 05 16:54:43.565815 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.565633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6" event={"ID":"47d7eff8-c551-4ed2-a7b3-9c147629b4ba","Type":"ContainerDied","Data":"3b8ec0958cb4138f4f617cec5db1af2deccc8982179dd95c2cda863b09ba7cc6"}
Aug 05 16:54:43.565815 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.565667    2579 scope.go:117] "RemoveContainer" containerID="ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c"
Aug 05 16:54:43.574547 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.574526    2579 scope.go:117] "RemoveContainer" containerID="ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c"
Aug 05 16:54:43.574801 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:54:43.574783    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c\": container with ID starting with ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c not found: ID does not exist" containerID="ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c"
Aug 05 16:54:43.574840 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.574813    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c"} err="failed to get container status \"ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c\": rpc error: code = NotFound desc = could not find container \"ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c\": container with ID starting with ead41d81411bb373625e1b627d48ef5b371460ad2511e733ff03572ce8a6060c not found: ID does not exist"
Aug 05 16:54:43.886503 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.886407    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"]
Aug 05 16:54:43.901610 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.901579    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb276d9d-594d557fc4-982c6"]
Aug 05 16:54:43.920651 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.920622    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"]
Aug 05 16:54:43.920875 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.920850    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz" podUID="7b7408b7-daea-4b32-a3f9-22ce43664978" containerName="payload-processing" containerID="cri-o://5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8" gracePeriod=30
Aug 05 16:54:43.931715 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.931687    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"]
Aug 05 16:54:43.931931 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:43.931904    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp" podUID="62a7ecc5-934c-46e1-9e95-13047ebe8d1d" containerName="payload-pre-processing" containerID="cri-o://37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3" gracePeriod=30
Aug 05 16:54:44.216114 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.216088    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:54:44.218758 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.218738    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:54:44.381190 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.381160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-plugins-config-volume\") pod \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\" (UID: \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\") "
Aug 05 16:54:44.381190 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.381192    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7408b7-daea-4b32-a3f9-22ce43664978-plugins-config-volume\") pod \"7b7408b7-daea-4b32-a3f9-22ce43664978\" (UID: \"7b7408b7-daea-4b32-a3f9-22ce43664978\") "
Aug 05 16:54:44.381481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.381250    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qwng\" (UniqueName: \"kubernetes.io/projected/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-kube-api-access-5qwng\") pod \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\" (UID: \"62a7ecc5-934c-46e1-9e95-13047ebe8d1d\") "
Aug 05 16:54:44.381481 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.381311    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgv9d\" (UniqueName: \"kubernetes.io/projected/7b7408b7-daea-4b32-a3f9-22ce43664978-kube-api-access-kgv9d\") pod \"7b7408b7-daea-4b32-a3f9-22ce43664978\" (UID: \"7b7408b7-daea-4b32-a3f9-22ce43664978\") "
Aug 05 16:54:44.381641 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.381594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62a7ecc5-934c-46e1-9e95-13047ebe8d1d" (UID: "62a7ecc5-934c-46e1-9e95-13047ebe8d1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:54:44.381807 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.381699    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:54:44.381807 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.381768    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b7408b7-daea-4b32-a3f9-22ce43664978-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b7408b7-daea-4b32-a3f9-22ce43664978" (UID: "7b7408b7-daea-4b32-a3f9-22ce43664978"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:54:44.383627 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.383599    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-kube-api-access-5qwng" (OuterVolumeSpecName: "kube-api-access-5qwng") pod "62a7ecc5-934c-46e1-9e95-13047ebe8d1d" (UID: "62a7ecc5-934c-46e1-9e95-13047ebe8d1d"). InnerVolumeSpecName "kube-api-access-5qwng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:54:44.383715 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.383695    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b7408b7-daea-4b32-a3f9-22ce43664978-kube-api-access-kgv9d" (OuterVolumeSpecName: "kube-api-access-kgv9d") pod "7b7408b7-daea-4b32-a3f9-22ce43664978" (UID: "7b7408b7-daea-4b32-a3f9-22ce43664978"). InnerVolumeSpecName "kube-api-access-kgv9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:54:44.482170 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.482138    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgv9d\" (UniqueName: \"kubernetes.io/projected/7b7408b7-daea-4b32-a3f9-22ce43664978-kube-api-access-kgv9d\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:54:44.482170 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.482165    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7408b7-daea-4b32-a3f9-22ce43664978-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:54:44.482170 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.482175    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qwng\" (UniqueName: \"kubernetes.io/projected/62a7ecc5-934c-46e1-9e95-13047ebe8d1d-kube-api-access-5qwng\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:54:44.571852 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.571811    2579 generic.go:356] "Generic (PLEG): container finished" podID="7b7408b7-daea-4b32-a3f9-22ce43664978" containerID="5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8" exitCode=0
Aug 05 16:54:44.572032 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.571857    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"
Aug 05 16:54:44.572032 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.571890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz" event={"ID":"7b7408b7-daea-4b32-a3f9-22ce43664978","Type":"ContainerDied","Data":"5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8"}
Aug 05 16:54:44.572032 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.571954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz" event={"ID":"7b7408b7-daea-4b32-a3f9-22ce43664978","Type":"ContainerDied","Data":"49932bebedd5ec4e15cd0ae777e7406c1a8703206ea62f24231b93807c5e1306"}
Aug 05 16:54:44.572032 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.571978    2579 scope.go:117] "RemoveContainer" containerID="5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8"
Aug 05 16:54:44.573248 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.573224    2579 generic.go:356] "Generic (PLEG): container finished" podID="62a7ecc5-934c-46e1-9e95-13047ebe8d1d" containerID="37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3" exitCode=0
Aug 05 16:54:44.573363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.573272    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"
Aug 05 16:54:44.573363 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.573308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp" event={"ID":"62a7ecc5-934c-46e1-9e95-13047ebe8d1d","Type":"ContainerDied","Data":"37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3"}
Aug 05 16:54:44.573486 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.573378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp" event={"ID":"62a7ecc5-934c-46e1-9e95-13047ebe8d1d","Type":"ContainerDied","Data":"7f16875a037ff1b40819b31678702f75426825b3ef005ffb3a4adcb39e4f596b"}
Aug 05 16:54:44.581836 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.581819    2579 scope.go:117] "RemoveContainer" containerID="5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8"
Aug 05 16:54:44.582097 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:54:44.582072    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8\": container with ID starting with 5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8 not found: ID does not exist" containerID="5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8"
Aug 05 16:54:44.582197 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.582104    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8"} err="failed to get container status \"5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8\": rpc error: code = NotFound desc = could not find container \"5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8\": container with ID starting with 5e52f43c096929bfbba18f157e0c77e5d58d88a647709dd921da27244c7d00c8 not found: ID does not exist"
Aug 05 16:54:44.582197 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.582127    2579 scope.go:117] "RemoveContainer" containerID="37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3"
Aug 05 16:54:44.589782 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.589764    2579 scope.go:117] "RemoveContainer" containerID="37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3"
Aug 05 16:54:44.590026 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:54:44.590008    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3\": container with ID starting with 37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3 not found: ID does not exist" containerID="37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3"
Aug 05 16:54:44.590074 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.590032    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3"} err="failed to get container status \"37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3\": rpc error: code = NotFound desc = could not find container \"37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3\": container with ID starting with 37f0777a99aecaf13859a2c9c151c9be958208069e6c94be13c3f246adbbe4e3 not found: ID does not exist"
Aug 05 16:54:44.649821 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.649794    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"]
Aug 05 16:54:44.667862 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.667829    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp"]
Aug 05 16:54:44.738849 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.738765    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"]
Aug 05 16:54:44.740398 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:44.740379    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz"]
Aug 05 16:54:45.190389 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:45.190360    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47d7eff8-c551-4ed2-a7b3-9c147629b4ba" path="/var/lib/kubelet/pods/47d7eff8-c551-4ed2-a7b3-9c147629b4ba/volumes"
Aug 05 16:54:45.190744 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:45.190694    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a7ecc5-934c-46e1-9e95-13047ebe8d1d" path="/var/lib/kubelet/pods/62a7ecc5-934c-46e1-9e95-13047ebe8d1d/volumes"
Aug 05 16:54:45.190999 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:45.190986    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b7408b7-daea-4b32-a3f9-22ce43664978" path="/var/lib/kubelet/pods/7b7408b7-daea-4b32-a3f9-22ce43664978/volumes"
Aug 05 16:54:49.189188 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189154    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"]
Aug 05 16:54:49.189671 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189654    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b7408b7-daea-4b32-a3f9-22ce43664978" containerName="payload-processing"
Aug 05 16:54:49.189716 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189673    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b7408b7-daea-4b32-a3f9-22ce43664978" containerName="payload-processing"
Aug 05 16:54:49.189716 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189685    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d7eff8-c551-4ed2-a7b3-9c147629b4ba" containerName="maas-api"
Aug 05 16:54:49.189716 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189690    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d7eff8-c551-4ed2-a7b3-9c147629b4ba" containerName="maas-api"
Aug 05 16:54:49.189716 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189703    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a7ecc5-934c-46e1-9e95-13047ebe8d1d" containerName="payload-pre-processing"
Aug 05 16:54:49.189716 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189709    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a7ecc5-934c-46e1-9e95-13047ebe8d1d" containerName="payload-pre-processing"
Aug 05 16:54:49.189874 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189768    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a7ecc5-934c-46e1-9e95-13047ebe8d1d" containerName="payload-pre-processing"
Aug 05 16:54:49.189874 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189775    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b7408b7-daea-4b32-a3f9-22ce43664978" containerName="payload-processing"
Aug 05 16:54:49.189874 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.189781    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="47d7eff8-c551-4ed2-a7b3-9c147629b4ba" containerName="maas-api"
Aug 05 16:54:49.194486 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.194467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.198012 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.197990    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ff3f79bc-serving-cert\""
Aug 05 16:54:49.202532 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.202453    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"]
Aug 05 16:54:49.225487 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.225457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd9l8\" (UniqueName: \"kubernetes.io/projected/486aeff4-c656-4bc2-8833-023451392e73-kube-api-access-qd9l8\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.225658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.225516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/486aeff4-c656-4bc2-8833-023451392e73-openshift-service-ca\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.225658 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.225567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.326782 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.326744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.326970 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.326891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd9l8\" (UniqueName: \"kubernetes.io/projected/486aeff4-c656-4bc2-8833-023451392e73-kube-api-access-qd9l8\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.326970 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:54:49.326901    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-serving-cert: secret "maas-api-e2e-ait-ff3f79bc-serving-cert" not found
Aug 05 16:54:49.326970 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.326938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/486aeff4-c656-4bc2-8833-023451392e73-openshift-service-ca\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.326970 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:54:49.326967    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls podName:486aeff4-c656-4bc2-8833-023451392e73 nodeName:}" failed. No retries permitted until 2026-08-05 16:54:49.826951322 +0000 UTC m=+2011.162749245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls") pod "maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8" (UID: "486aeff4-c656-4bc2-8833-023451392e73") : secret "maas-api-e2e-ait-ff3f79bc-serving-cert" not found
Aug 05 16:54:49.327534 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.327517    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/486aeff4-c656-4bc2-8833-023451392e73-openshift-service-ca\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.336498 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.336469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd9l8\" (UniqueName: \"kubernetes.io/projected/486aeff4-c656-4bc2-8833-023451392e73-kube-api-access-qd9l8\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.832616 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.832579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.835260 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.835234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls\") pod \"maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:49.934795 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.934754    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"]
Aug 05 16:54:49.938519 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.938494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:49.941371 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.941327    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ff3f79bc\""
Aug 05 16:54:49.950969 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:49.950945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"]
Aug 05 16:54:50.007228 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.007199    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"]
Aug 05 16:54:50.010603 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.010588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.018420 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.018400    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ff3f79bc-dockercfg-ms58j\""
Aug 05 16:54:50.033099 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.033077    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"]
Aug 05 16:54:50.035124 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.035103    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4431cfb6-9fff-4df6-9b07-c2a8148657ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr\" (UID: \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.035196 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.035145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hngn8\" (UniqueName: \"kubernetes.io/projected/4431cfb6-9fff-4df6-9b07-c2a8148657ff-kube-api-access-hngn8\") pod \"payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr\" (UID: \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.035256 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.035232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15618bb-d509-41f0-a255-f5de9892d308-plugins-config-volume\") pod \"payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz\" (UID: \"e15618bb-d509-41f0-a255-f5de9892d308\") " pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:50.035443 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.035424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkcsg\" (UniqueName: \"kubernetes.io/projected/e15618bb-d509-41f0-a255-f5de9892d308-kube-api-access-rkcsg\") pod \"payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz\" (UID: \"e15618bb-d509-41f0-a255-f5de9892d308\") " pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:50.106397 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.106305    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:50.136817 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.136779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15618bb-d509-41f0-a255-f5de9892d308-plugins-config-volume\") pod \"payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz\" (UID: \"e15618bb-d509-41f0-a255-f5de9892d308\") " pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:50.136993 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.136940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkcsg\" (UniqueName: \"kubernetes.io/projected/e15618bb-d509-41f0-a255-f5de9892d308-kube-api-access-rkcsg\") pod \"payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz\" (UID: \"e15618bb-d509-41f0-a255-f5de9892d308\") " pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:50.137063 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.136990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4431cfb6-9fff-4df6-9b07-c2a8148657ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr\" (UID: \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.137063 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.137034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hngn8\" (UniqueName: \"kubernetes.io/projected/4431cfb6-9fff-4df6-9b07-c2a8148657ff-kube-api-access-hngn8\") pod \"payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr\" (UID: \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.137685 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.137662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15618bb-d509-41f0-a255-f5de9892d308-plugins-config-volume\") pod \"payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz\" (UID: \"e15618bb-d509-41f0-a255-f5de9892d308\") " pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:50.137797 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.137749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4431cfb6-9fff-4df6-9b07-c2a8148657ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr\" (UID: \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.149186 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.149091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkcsg\" (UniqueName: \"kubernetes.io/projected/e15618bb-d509-41f0-a255-f5de9892d308-kube-api-access-rkcsg\") pod \"payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz\" (UID: \"e15618bb-d509-41f0-a255-f5de9892d308\") " pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:50.149475 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.149410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hngn8\" (UniqueName: \"kubernetes.io/projected/4431cfb6-9fff-4df6-9b07-c2a8148657ff-kube-api-access-hngn8\") pod \"payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr\" (UID: \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.249541 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.249391    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:50.250762 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.250739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"]
Aug 05 16:54:50.252275 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:54:50.252254    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486aeff4_c656_4bc2_8833_023451392e73.slice/crio-5ff1247ad33768b8bc9a7ea0d209612373939b55fcacc28c6d968e7383106c5f WatchSource:0}: Error finding container 5ff1247ad33768b8bc9a7ea0d209612373939b55fcacc28c6d968e7383106c5f: Status 404 returned error can't find the container with id 5ff1247ad33768b8bc9a7ea0d209612373939b55fcacc28c6d968e7383106c5f
Aug 05 16:54:50.320392 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.320365    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.397619 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.397505    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"]
Aug 05 16:54:50.400093 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:54:50.400061    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15618bb_d509_41f0_a255_f5de9892d308.slice/crio-1c2eb7b70d7ea6dd52d3b9417992f9dbad638cfeb86a64380d4ca9e055e80046 WatchSource:0}: Error finding container 1c2eb7b70d7ea6dd52d3b9417992f9dbad638cfeb86a64380d4ca9e055e80046: Status 404 returned error can't find the container with id 1c2eb7b70d7ea6dd52d3b9417992f9dbad638cfeb86a64380d4ca9e055e80046
Aug 05 16:54:50.474408 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.474338    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"]
Aug 05 16:54:50.477372 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:54:50.477324    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4431cfb6_9fff_4df6_9b07_c2a8148657ff.slice/crio-730333d1b3b71189d87d4a19f1892ec13f3268d06079eaba93c207a95c558f30 WatchSource:0}: Error finding container 730333d1b3b71189d87d4a19f1892ec13f3268d06079eaba93c207a95c558f30: Status 404 returned error can't find the container with id 730333d1b3b71189d87d4a19f1892ec13f3268d06079eaba93c207a95c558f30
Aug 05 16:54:50.604816 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.604782    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8" event={"ID":"486aeff4-c656-4bc2-8833-023451392e73","Type":"ContainerStarted","Data":"5ff1247ad33768b8bc9a7ea0d209612373939b55fcacc28c6d968e7383106c5f"}
Aug 05 16:54:50.606306 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.606282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz" event={"ID":"e15618bb-d509-41f0-a255-f5de9892d308","Type":"ContainerStarted","Data":"2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4"}
Aug 05 16:54:50.606465 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.606327    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:54:50.606465 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.606359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz" event={"ID":"e15618bb-d509-41f0-a255-f5de9892d308","Type":"ContainerStarted","Data":"1c2eb7b70d7ea6dd52d3b9417992f9dbad638cfeb86a64380d4ca9e055e80046"}
Aug 05 16:54:50.607709 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.607685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr" event={"ID":"4431cfb6-9fff-4df6-9b07-c2a8148657ff","Type":"ContainerStarted","Data":"4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7"}
Aug 05 16:54:50.607803 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.607732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr" event={"ID":"4431cfb6-9fff-4df6-9b07-c2a8148657ff","Type":"ContainerStarted","Data":"730333d1b3b71189d87d4a19f1892ec13f3268d06079eaba93c207a95c558f30"}
Aug 05 16:54:50.607803 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.607772    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:54:50.630561 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.630488    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz" podStartSLOduration=1.630466177 podStartE2EDuration="1.630466177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:54:50.62648405 +0000 UTC m=+2011.962281994" watchObservedRunningTime="2026-08-05 16:54:50.630466177 +0000 UTC m=+2011.966264121"
Aug 05 16:54:50.651681 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:50.651637    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr" podStartSLOduration=1.651623512 podStartE2EDuration="1.651623512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:54:50.649161019 +0000 UTC m=+2011.984958965" watchObservedRunningTime="2026-08-05 16:54:50.651623512 +0000 UTC m=+2011.987421455"
Aug 05 16:54:51.613975 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:51.613936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8" event={"ID":"486aeff4-c656-4bc2-8833-023451392e73","Type":"ContainerStarted","Data":"340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9"}
Aug 05 16:54:51.614386 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:51.614289    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:54:51.636587 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:51.636542    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8" podStartSLOduration=2.241218264 podStartE2EDuration="2.63652497s" totalImagesPullingTime="395.306706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:54:51.634641602 +0000 UTC m=+2012.970439550" watchObservedRunningTime="2026-08-05 16:54:51.63652497 +0000 UTC m=+2012.972322915"
Aug 05 16:54:58.629577 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:54:58.629546    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:55:01.616526 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:01.616495    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:55:01.616939 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:01.616568    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:55:29.872036 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:29.871997    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"]
Aug 05 16:55:29.872478 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:29.872235    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8" podUID="486aeff4-c656-4bc2-8833-023451392e73" containerName="maas-api" containerID="cri-o://340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9" gracePeriod=30
Aug 05 16:55:29.961303 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:29.961267    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"]
Aug 05 16:55:29.961547 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:29.961521    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz" podUID="e15618bb-d509-41f0-a255-f5de9892d308" containerName="payload-processing" containerID="cri-o://2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4" gracePeriod=30
Aug 05 16:55:29.980762 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:29.980735    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"]
Aug 05 16:55:29.981013 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:29.980984    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr" podUID="4431cfb6-9fff-4df6-9b07-c2a8148657ff" containerName="payload-pre-processing" containerID="cri-o://4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7" gracePeriod=30
Aug 05 16:55:30.222757 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.222716    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:55:30.266540 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.266516    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:55:30.275130 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.275106    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:55:30.307270 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.307237    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkcsg\" (UniqueName: \"kubernetes.io/projected/e15618bb-d509-41f0-a255-f5de9892d308-kube-api-access-rkcsg\") pod \"e15618bb-d509-41f0-a255-f5de9892d308\" (UID: \"e15618bb-d509-41f0-a255-f5de9892d308\") "
Aug 05 16:55:30.307511 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.307301    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd9l8\" (UniqueName: \"kubernetes.io/projected/486aeff4-c656-4bc2-8833-023451392e73-kube-api-access-qd9l8\") pod \"486aeff4-c656-4bc2-8833-023451392e73\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") "
Aug 05 16:55:30.307511 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.307332    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hngn8\" (UniqueName: \"kubernetes.io/projected/4431cfb6-9fff-4df6-9b07-c2a8148657ff-kube-api-access-hngn8\") pod \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\" (UID: \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\") "
Aug 05 16:55:30.307511 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.307395    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls\") pod \"486aeff4-c656-4bc2-8833-023451392e73\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") "
Aug 05 16:55:30.307511 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.307431    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/486aeff4-c656-4bc2-8833-023451392e73-openshift-service-ca\") pod \"486aeff4-c656-4bc2-8833-023451392e73\" (UID: \"486aeff4-c656-4bc2-8833-023451392e73\") "
Aug 05 16:55:30.307731 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.307548    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4431cfb6-9fff-4df6-9b07-c2a8148657ff-plugins-config-volume\") pod \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\" (UID: \"4431cfb6-9fff-4df6-9b07-c2a8148657ff\") "
Aug 05 16:55:30.307731 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.307576    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15618bb-d509-41f0-a255-f5de9892d308-plugins-config-volume\") pod \"e15618bb-d509-41f0-a255-f5de9892d308\" (UID: \"e15618bb-d509-41f0-a255-f5de9892d308\") "
Aug 05 16:55:30.308109 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.308070    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4431cfb6-9fff-4df6-9b07-c2a8148657ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4431cfb6-9fff-4df6-9b07-c2a8148657ff" (UID: "4431cfb6-9fff-4df6-9b07-c2a8148657ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:55:30.308225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.308207    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15618bb-d509-41f0-a255-f5de9892d308-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e15618bb-d509-41f0-a255-f5de9892d308" (UID: "e15618bb-d509-41f0-a255-f5de9892d308"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:55:30.308546 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.308509    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/486aeff4-c656-4bc2-8833-023451392e73-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "486aeff4-c656-4bc2-8833-023451392e73" (UID: "486aeff4-c656-4bc2-8833-023451392e73"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:55:30.310430 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.310405    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "486aeff4-c656-4bc2-8833-023451392e73" (UID: "486aeff4-c656-4bc2-8833-023451392e73"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:55:30.310706 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.310678    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4431cfb6-9fff-4df6-9b07-c2a8148657ff-kube-api-access-hngn8" (OuterVolumeSpecName: "kube-api-access-hngn8") pod "4431cfb6-9fff-4df6-9b07-c2a8148657ff" (UID: "4431cfb6-9fff-4df6-9b07-c2a8148657ff"). InnerVolumeSpecName "kube-api-access-hngn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:55:30.310824 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.310723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15618bb-d509-41f0-a255-f5de9892d308-kube-api-access-rkcsg" (OuterVolumeSpecName: "kube-api-access-rkcsg") pod "e15618bb-d509-41f0-a255-f5de9892d308" (UID: "e15618bb-d509-41f0-a255-f5de9892d308"). InnerVolumeSpecName "kube-api-access-rkcsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:55:30.310824 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.310728    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/486aeff4-c656-4bc2-8833-023451392e73-kube-api-access-qd9l8" (OuterVolumeSpecName: "kube-api-access-qd9l8") pod "486aeff4-c656-4bc2-8833-023451392e73" (UID: "486aeff4-c656-4bc2-8833-023451392e73"). InnerVolumeSpecName "kube-api-access-qd9l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:55:30.408437 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.408289    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4431cfb6-9fff-4df6-9b07-c2a8148657ff-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:55:30.408437 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.408371    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15618bb-d509-41f0-a255-f5de9892d308-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:55:30.408437 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.408382    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkcsg\" (UniqueName: \"kubernetes.io/projected/e15618bb-d509-41f0-a255-f5de9892d308-kube-api-access-rkcsg\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:55:30.408437 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.408390    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd9l8\" (UniqueName: \"kubernetes.io/projected/486aeff4-c656-4bc2-8833-023451392e73-kube-api-access-qd9l8\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:55:30.408437 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.408399    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hngn8\" (UniqueName: \"kubernetes.io/projected/4431cfb6-9fff-4df6-9b07-c2a8148657ff-kube-api-access-hngn8\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:55:30.408437 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.408408    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/486aeff4-c656-4bc2-8833-023451392e73-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:55:30.408437 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.408416    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/486aeff4-c656-4bc2-8833-023451392e73-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:55:30.805771 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.805728    2579 generic.go:356] "Generic (PLEG): container finished" podID="486aeff4-c656-4bc2-8833-023451392e73" containerID="340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9" exitCode=0
Aug 05 16:55:30.805957 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.805778    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"
Aug 05 16:55:30.805957 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.805805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8" event={"ID":"486aeff4-c656-4bc2-8833-023451392e73","Type":"ContainerDied","Data":"340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9"}
Aug 05 16:55:30.805957 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.805860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8" event={"ID":"486aeff4-c656-4bc2-8833-023451392e73","Type":"ContainerDied","Data":"5ff1247ad33768b8bc9a7ea0d209612373939b55fcacc28c6d968e7383106c5f"}
Aug 05 16:55:30.805957 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.805895    2579 scope.go:117] "RemoveContainer" containerID="340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9"
Aug 05 16:55:30.807370 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.807327    2579 generic.go:356] "Generic (PLEG): container finished" podID="e15618bb-d509-41f0-a255-f5de9892d308" containerID="2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4" exitCode=0
Aug 05 16:55:30.807477 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.807381    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"
Aug 05 16:55:30.807477 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.807382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz" event={"ID":"e15618bb-d509-41f0-a255-f5de9892d308","Type":"ContainerDied","Data":"2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4"}
Aug 05 16:55:30.807477 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.807444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz" event={"ID":"e15618bb-d509-41f0-a255-f5de9892d308","Type":"ContainerDied","Data":"1c2eb7b70d7ea6dd52d3b9417992f9dbad638cfeb86a64380d4ca9e055e80046"}
Aug 05 16:55:30.808923 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.808892    2579 generic.go:356] "Generic (PLEG): container finished" podID="4431cfb6-9fff-4df6-9b07-c2a8148657ff" containerID="4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7" exitCode=0
Aug 05 16:55:30.809030 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.808929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr" event={"ID":"4431cfb6-9fff-4df6-9b07-c2a8148657ff","Type":"ContainerDied","Data":"4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7"}
Aug 05 16:55:30.809030 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.808940    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"
Aug 05 16:55:30.809030 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.808970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr" event={"ID":"4431cfb6-9fff-4df6-9b07-c2a8148657ff","Type":"ContainerDied","Data":"730333d1b3b71189d87d4a19f1892ec13f3268d06079eaba93c207a95c558f30"}
Aug 05 16:55:30.816860 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.816816    2579 scope.go:117] "RemoveContainer" containerID="340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9"
Aug 05 16:55:30.817141 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:55:30.817122    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9\": container with ID starting with 340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9 not found: ID does not exist" containerID="340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9"
Aug 05 16:55:30.817211 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.817150    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9"} err="failed to get container status \"340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9\": rpc error: code = NotFound desc = could not find container \"340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9\": container with ID starting with 340eacce42051ee785d1aaa6ba17868596dc574eb323d13b2d45c6a00da385a9 not found: ID does not exist"
Aug 05 16:55:30.817211 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.817167    2579 scope.go:117] "RemoveContainer" containerID="2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4"
Aug 05 16:55:30.825324 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.825305    2579 scope.go:117] "RemoveContainer" containerID="2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4"
Aug 05 16:55:30.825636 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:55:30.825616    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4\": container with ID starting with 2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4 not found: ID does not exist" containerID="2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4"
Aug 05 16:55:30.825704 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.825645    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4"} err="failed to get container status \"2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4\": rpc error: code = NotFound desc = could not find container \"2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4\": container with ID starting with 2c9501ea828bec9491f1748659a93432a8723db83395162f57d3d65643c65dc4 not found: ID does not exist"
Aug 05 16:55:30.825704 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.825661    2579 scope.go:117] "RemoveContainer" containerID="4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7"
Aug 05 16:55:30.833462 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.833443    2579 scope.go:117] "RemoveContainer" containerID="4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7"
Aug 05 16:55:30.833711 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:55:30.833691    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7\": container with ID starting with 4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7 not found: ID does not exist" containerID="4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7"
Aug 05 16:55:30.833766 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.833718    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7"} err="failed to get container status \"4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7\": rpc error: code = NotFound desc = could not find container \"4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7\": container with ID starting with 4279dbf86dad86e95b19b2ff9f68014ddd380be7ebae48bfb6166e77fb9c94d7 not found: ID does not exist"
Aug 05 16:55:30.844223 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.844199    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"]
Aug 05 16:55:30.854189 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.854166    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ff3f79bc-b7cf7dbd9-dhsj8"]
Aug 05 16:55:30.878182 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.878151    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"]
Aug 05 16:55:30.881836 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.881814    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr"]
Aug 05 16:55:30.897161 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.897113    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"]
Aug 05 16:55:30.898943 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:30.898923    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz"]
Aug 05 16:55:31.188400 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:31.188368    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4431cfb6-9fff-4df6-9b07-c2a8148657ff" path="/var/lib/kubelet/pods/4431cfb6-9fff-4df6-9b07-c2a8148657ff/volumes"
Aug 05 16:55:31.188762 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:31.188749    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="486aeff4-c656-4bc2-8833-023451392e73" path="/var/lib/kubelet/pods/486aeff4-c656-4bc2-8833-023451392e73/volumes"
Aug 05 16:55:31.189068 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:31.189051    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e15618bb-d509-41f0-a255-f5de9892d308" path="/var/lib/kubelet/pods/e15618bb-d509-41f0-a255-f5de9892d308/volumes"
Aug 05 16:55:35.693485 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.693449    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"]
Aug 05 16:55:35.693936 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.693917    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15618bb-d509-41f0-a255-f5de9892d308" containerName="payload-processing"
Aug 05 16:55:35.694021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.693939    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15618bb-d509-41f0-a255-f5de9892d308" containerName="payload-processing"
Aug 05 16:55:35.694021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.693949    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4431cfb6-9fff-4df6-9b07-c2a8148657ff" containerName="payload-pre-processing"
Aug 05 16:55:35.694021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.693955    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4431cfb6-9fff-4df6-9b07-c2a8148657ff" containerName="payload-pre-processing"
Aug 05 16:55:35.694021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.693978    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486aeff4-c656-4bc2-8833-023451392e73" containerName="maas-api"
Aug 05 16:55:35.694021 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.693987    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="486aeff4-c656-4bc2-8833-023451392e73" containerName="maas-api"
Aug 05 16:55:35.694267 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.694086    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e15618bb-d509-41f0-a255-f5de9892d308" containerName="payload-processing"
Aug 05 16:55:35.694267 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.694096    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="486aeff4-c656-4bc2-8833-023451392e73" containerName="maas-api"
Aug 05 16:55:35.694267 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.694112    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4431cfb6-9fff-4df6-9b07-c2a8148657ff" containerName="payload-pre-processing"
Aug 05 16:55:35.699208 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.699186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.703802 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.703770    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-e051d82f-serving-cert\""
Aug 05 16:55:35.719715 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.719684    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"]
Aug 05 16:55:35.753369 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.753311    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-maas-api-tls\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.753528 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.753469    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7htbs\" (UniqueName: \"kubernetes.io/projected/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-kube-api-access-7htbs\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.753528 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.753506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-openshift-service-ca\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.854591 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.854557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7htbs\" (UniqueName: \"kubernetes.io/projected/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-kube-api-access-7htbs\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.854591 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.854596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-openshift-service-ca\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.854813 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.854638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-maas-api-tls\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.855249 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.855227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-openshift-service-ca\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.857099 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.857078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-maas-api-tls\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:35.868716 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:35.868689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7htbs\" (UniqueName: \"kubernetes.io/projected/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-kube-api-access-7htbs\") pod \"maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:36.010283 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.010173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:36.170296 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.170272    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"]
Aug 05 16:55:36.173099 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:55:36.173074    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34eccf7f_7cb5_4edd_a257_5cc619ee8fc0.slice/crio-de8221549223b64208daf1ec4e11136418b4cf005ab057b2fd34c0f7f5dc2d33 WatchSource:0}: Error finding container de8221549223b64208daf1ec4e11136418b4cf005ab057b2fd34c0f7f5dc2d33: Status 404 returned error can't find the container with id de8221549223b64208daf1ec4e11136418b4cf005ab057b2fd34c0f7f5dc2d33
Aug 05 16:55:36.840550 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.840453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k" event={"ID":"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0","Type":"ContainerStarted","Data":"f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb"}
Aug 05 16:55:36.840550 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.840510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k" event={"ID":"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0","Type":"ContainerStarted","Data":"de8221549223b64208daf1ec4e11136418b4cf005ab057b2fd34c0f7f5dc2d33"}
Aug 05 16:55:36.840550 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.840539    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:36.892891 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.892859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"]
Aug 05 16:55:36.896595 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.896572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:36.901892 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.901868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-e051d82f\""
Aug 05 16:55:36.909747 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.909707    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k" podStartSLOduration=1.54860383 podStartE2EDuration="1.909693497s" totalImagesPullingTime="361.089667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:55:36.897016132 +0000 UTC m=+2058.232814087" watchObservedRunningTime="2026-08-05 16:55:36.909693497 +0000 UTC m=+2058.245491488"
Aug 05 16:55:36.910224 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.910203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"]
Aug 05 16:55:36.956878 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.956636    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"]
Aug 05 16:55:36.960630 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.960607    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:36.963573 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.963550    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-e051d82f-dockercfg-jjgt7\""
Aug 05 16:55:36.965337 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.965312    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6baacdca-73b3-4123-85b2-42810a800076-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6\" (UID: \"6baacdca-73b3-4123-85b2-42810a800076\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:36.965486 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.965384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ll2\" (UniqueName: \"kubernetes.io/projected/6baacdca-73b3-4123-85b2-42810a800076-kube-api-access-98ll2\") pod \"payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6\" (UID: \"6baacdca-73b3-4123-85b2-42810a800076\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:36.976685 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:36.976663    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"]
Aug 05 16:55:37.066633 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.066602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6baacdca-73b3-4123-85b2-42810a800076-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6\" (UID: \"6baacdca-73b3-4123-85b2-42810a800076\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:37.066793 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.066650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ll2\" (UniqueName: \"kubernetes.io/projected/6baacdca-73b3-4123-85b2-42810a800076-kube-api-access-98ll2\") pod \"payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6\" (UID: \"6baacdca-73b3-4123-85b2-42810a800076\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:37.066793 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.066682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-plugins-config-volume\") pod \"payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg\" (UID: \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\") " pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:37.066793 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.066755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxkd\" (UniqueName: \"kubernetes.io/projected/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-kube-api-access-bqxkd\") pod \"payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg\" (UID: \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\") " pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:37.071553 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.067877    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6baacdca-73b3-4123-85b2-42810a800076-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6\" (UID: \"6baacdca-73b3-4123-85b2-42810a800076\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:37.080575 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.080548    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ll2\" (UniqueName: \"kubernetes.io/projected/6baacdca-73b3-4123-85b2-42810a800076-kube-api-access-98ll2\") pod \"payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6\" (UID: \"6baacdca-73b3-4123-85b2-42810a800076\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:37.167989 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.167950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxkd\" (UniqueName: \"kubernetes.io/projected/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-kube-api-access-bqxkd\") pod \"payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg\" (UID: \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\") " pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:37.168173 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.168115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-plugins-config-volume\") pod \"payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg\" (UID: \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\") " pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:37.168912 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.168886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-plugins-config-volume\") pod \"payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg\" (UID: \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\") " pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:37.182514 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.182475    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxkd\" (UniqueName: \"kubernetes.io/projected/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-kube-api-access-bqxkd\") pod \"payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg\" (UID: \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\") " pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:37.207503 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.207475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:37.271391 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.271358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:37.368088 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.368052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"]
Aug 05 16:55:37.368260 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:55:37.368229    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6baacdca_73b3_4123_85b2_42810a800076.slice/crio-b738d02e3c4d4037c54c7ff8e91778aa63e63ecbc9226b31d3d8ea1f178ddb93 WatchSource:0}: Error finding container b738d02e3c4d4037c54c7ff8e91778aa63e63ecbc9226b31d3d8ea1f178ddb93: Status 404 returned error can't find the container with id b738d02e3c4d4037c54c7ff8e91778aa63e63ecbc9226b31d3d8ea1f178ddb93
Aug 05 16:55:37.435035 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.435011    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"]
Aug 05 16:55:37.437770 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:55:37.437742    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c229eb1_e7c2_48da_9c1a_723d0dbb0a87.slice/crio-735d1c799032818f9525aeed69a64cf4ba9a2ecab2ab8cdd653b9ff7b473d05b WatchSource:0}: Error finding container 735d1c799032818f9525aeed69a64cf4ba9a2ecab2ab8cdd653b9ff7b473d05b: Status 404 returned error can't find the container with id 735d1c799032818f9525aeed69a64cf4ba9a2ecab2ab8cdd653b9ff7b473d05b
Aug 05 16:55:37.847733 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.847634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6" event={"ID":"6baacdca-73b3-4123-85b2-42810a800076","Type":"ContainerStarted","Data":"d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad"}
Aug 05 16:55:37.847733 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.847701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6" event={"ID":"6baacdca-73b3-4123-85b2-42810a800076","Type":"ContainerStarted","Data":"b738d02e3c4d4037c54c7ff8e91778aa63e63ecbc9226b31d3d8ea1f178ddb93"}
Aug 05 16:55:37.847733 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.847729    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:55:37.849356 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.849324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg" event={"ID":"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87","Type":"ContainerStarted","Data":"9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238"}
Aug 05 16:55:37.849492 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.849394    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg" event={"ID":"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87","Type":"ContainerStarted","Data":"735d1c799032818f9525aeed69a64cf4ba9a2ecab2ab8cdd653b9ff7b473d05b"}
Aug 05 16:55:37.849492 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.849418    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:37.876323 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.876275    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6" podStartSLOduration=1.876261521 podStartE2EDuration="1.876261521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:55:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:55:37.875484065 +0000 UTC m=+2059.211282008" watchObservedRunningTime="2026-08-05 16:55:37.876261521 +0000 UTC m=+2059.212059465"
Aug 05 16:55:37.899749 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:37.899699    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg" podStartSLOduration=1.8996818279999999 podStartE2EDuration="1.899681828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:55:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:55:37.898807855 +0000 UTC m=+2059.234605798" watchObservedRunningTime="2026-08-05 16:55:37.899681828 +0000 UTC m=+2059.235479772"
Aug 05 16:55:42.855195 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:42.855116    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:55:48.856744 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:48.856713    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:55:48.857102 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:55:48.856899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:56:06.506474 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.506446    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"]
Aug 05 16:56:06.507030 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.506659    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k" podUID="34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" containerName="maas-api" containerID="cri-o://f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb" gracePeriod=30
Aug 05 16:56:06.653898 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.653857    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"]
Aug 05 16:56:06.654137 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.654099    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg" podUID="9c229eb1-e7c2-48da-9c1a-723d0dbb0a87" containerName="payload-processing" containerID="cri-o://9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238" gracePeriod=30
Aug 05 16:56:06.665186 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.665156    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"]
Aug 05 16:56:06.665402 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.665364    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6" podUID="6baacdca-73b3-4123-85b2-42810a800076" containerName="payload-pre-processing" containerID="cri-o://d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad" gracePeriod=30
Aug 05 16:56:06.790221 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.790196    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:56:06.923049 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.923024    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:56:06.930613 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.930589    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:56:06.961171 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.961053    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7htbs\" (UniqueName: \"kubernetes.io/projected/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-kube-api-access-7htbs\") pod \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") "
Aug 05 16:56:06.961171 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.961148    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-maas-api-tls\") pod \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") "
Aug 05 16:56:06.961441 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.961202    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-openshift-service-ca\") pod \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\" (UID: \"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0\") "
Aug 05 16:56:06.961950 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.961916    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" (UID: "34eccf7f-7cb5-4edd-a257-5cc619ee8fc0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:56:06.964178 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.964153    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-kube-api-access-7htbs" (OuterVolumeSpecName: "kube-api-access-7htbs") pod "34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" (UID: "34eccf7f-7cb5-4edd-a257-5cc619ee8fc0"). InnerVolumeSpecName "kube-api-access-7htbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:56:06.964432 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.964400    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" (UID: "34eccf7f-7cb5-4edd-a257-5cc619ee8fc0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:56:06.996971 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.996936    2579 generic.go:356] "Generic (PLEG): container finished" podID="34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" containerID="f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb" exitCode=0
Aug 05 16:56:06.997155 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.996980    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"
Aug 05 16:56:06.997155 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.997018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k" event={"ID":"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0","Type":"ContainerDied","Data":"f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb"}
Aug 05 16:56:06.997155 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.997070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k" event={"ID":"34eccf7f-7cb5-4edd-a257-5cc619ee8fc0","Type":"ContainerDied","Data":"de8221549223b64208daf1ec4e11136418b4cf005ab057b2fd34c0f7f5dc2d33"}
Aug 05 16:56:06.997155 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.997099    2579 scope.go:117] "RemoveContainer" containerID="f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb"
Aug 05 16:56:06.998472 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.998445    2579 generic.go:356] "Generic (PLEG): container finished" podID="9c229eb1-e7c2-48da-9c1a-723d0dbb0a87" containerID="9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238" exitCode=0
Aug 05 16:56:06.998596 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.998482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg" event={"ID":"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87","Type":"ContainerDied","Data":"9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238"}
Aug 05 16:56:06.998596 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.998505    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"
Aug 05 16:56:06.998596 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:06.998529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg" event={"ID":"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87","Type":"ContainerDied","Data":"735d1c799032818f9525aeed69a64cf4ba9a2ecab2ab8cdd653b9ff7b473d05b"}
Aug 05 16:56:07.000089 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.000066    2579 generic.go:356] "Generic (PLEG): container finished" podID="6baacdca-73b3-4123-85b2-42810a800076" containerID="d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad" exitCode=0
Aug 05 16:56:07.000192 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.000103    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"
Aug 05 16:56:07.000257 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.000103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6" event={"ID":"6baacdca-73b3-4123-85b2-42810a800076","Type":"ContainerDied","Data":"d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad"}
Aug 05 16:56:07.000257 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.000229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6" event={"ID":"6baacdca-73b3-4123-85b2-42810a800076","Type":"ContainerDied","Data":"b738d02e3c4d4037c54c7ff8e91778aa63e63ecbc9226b31d3d8ea1f178ddb93"}
Aug 05 16:56:07.007253 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.007237    2579 scope.go:117] "RemoveContainer" containerID="f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb"
Aug 05 16:56:07.007572 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:56:07.007555    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb\": container with ID starting with f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb not found: ID does not exist" containerID="f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb"
Aug 05 16:56:07.007626 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.007581    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb"} err="failed to get container status \"f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb\": rpc error: code = NotFound desc = could not find container \"f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb\": container with ID starting with f288ad84ac9755396f1d5f91e97bb83b18501377478e4f7b7aa90f82fc10b6cb not found: ID does not exist"
Aug 05 16:56:07.007626 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.007597    2579 scope.go:117] "RemoveContainer" containerID="9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238"
Aug 05 16:56:07.015483 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.015376    2579 scope.go:117] "RemoveContainer" containerID="9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238"
Aug 05 16:56:07.018180 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:56:07.017690    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238\": container with ID starting with 9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238 not found: ID does not exist" containerID="9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238"
Aug 05 16:56:07.018180 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.017723    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238"} err="failed to get container status \"9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238\": rpc error: code = NotFound desc = could not find container \"9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238\": container with ID starting with 9c1ba1ddd7e1a2940aaee522396dfe25e44b8d6b184f6ef202024e59ffed4238 not found: ID does not exist"
Aug 05 16:56:07.018180 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.017742    2579 scope.go:117] "RemoveContainer" containerID="d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad"
Aug 05 16:56:07.026211 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.026193    2579 scope.go:117] "RemoveContainer" containerID="d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad"
Aug 05 16:56:07.026498 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:56:07.026472    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad\": container with ID starting with d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad not found: ID does not exist" containerID="d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad"
Aug 05 16:56:07.026592 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.026505    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad"} err="failed to get container status \"d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad\": rpc error: code = NotFound desc = could not find container \"d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad\": container with ID starting with d8d0de78d32860db7dc6b5eea221d24062103ea3c4231110f47ed72fb25fa4ad not found: ID does not exist"
Aug 05 16:56:07.043807 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.043783    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"]
Aug 05 16:56:07.049850 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.049828    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e051d82f-7975d8c5c5-8hh6k"]
Aug 05 16:56:07.062089 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062071    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98ll2\" (UniqueName: \"kubernetes.io/projected/6baacdca-73b3-4123-85b2-42810a800076-kube-api-access-98ll2\") pod \"6baacdca-73b3-4123-85b2-42810a800076\" (UID: \"6baacdca-73b3-4123-85b2-42810a800076\") "
Aug 05 16:56:07.062164 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062098    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-plugins-config-volume\") pod \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\" (UID: \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\") "
Aug 05 16:56:07.062164 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062118    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqxkd\" (UniqueName: \"kubernetes.io/projected/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-kube-api-access-bqxkd\") pod \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\" (UID: \"9c229eb1-e7c2-48da-9c1a-723d0dbb0a87\") "
Aug 05 16:56:07.062356 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062327    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6baacdca-73b3-4123-85b2-42810a800076-plugins-config-volume\") pod \"6baacdca-73b3-4123-85b2-42810a800076\" (UID: \"6baacdca-73b3-4123-85b2-42810a800076\") "
Aug 05 16:56:07.062591 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062567    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c229eb1-e7c2-48da-9c1a-723d0dbb0a87" (UID: "9c229eb1-e7c2-48da-9c1a-723d0dbb0a87"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:56:07.062667 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062648    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6baacdca-73b3-4123-85b2-42810a800076-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6baacdca-73b3-4123-85b2-42810a800076" (UID: "6baacdca-73b3-4123-85b2-42810a800076"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:56:07.062719 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062703    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7htbs\" (UniqueName: \"kubernetes.io/projected/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-kube-api-access-7htbs\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:56:07.062765 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062719    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:56:07.062765 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062729    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:56:07.062765 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.062737    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:56:07.064165 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.064144    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-kube-api-access-bqxkd" (OuterVolumeSpecName: "kube-api-access-bqxkd") pod "9c229eb1-e7c2-48da-9c1a-723d0dbb0a87" (UID: "9c229eb1-e7c2-48da-9c1a-723d0dbb0a87"). InnerVolumeSpecName "kube-api-access-bqxkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:56:07.064206 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.064175    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6baacdca-73b3-4123-85b2-42810a800076-kube-api-access-98ll2" (OuterVolumeSpecName: "kube-api-access-98ll2") pod "6baacdca-73b3-4123-85b2-42810a800076" (UID: "6baacdca-73b3-4123-85b2-42810a800076"). InnerVolumeSpecName "kube-api-access-98ll2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:56:07.163225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.163190    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqxkd\" (UniqueName: \"kubernetes.io/projected/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87-kube-api-access-bqxkd\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:56:07.163225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.163220    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6baacdca-73b3-4123-85b2-42810a800076-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:56:07.163225 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.163229    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ll2\" (UniqueName: \"kubernetes.io/projected/6baacdca-73b3-4123-85b2-42810a800076-kube-api-access-98ll2\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:56:07.188064 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.188034    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" path="/var/lib/kubelet/pods/34eccf7f-7cb5-4edd-a257-5cc619ee8fc0/volumes"
Aug 05 16:56:07.326203 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.326136    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"]
Aug 05 16:56:07.332822 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.332798    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg"]
Aug 05 16:56:07.350265 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.350247    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"]
Aug 05 16:56:07.363954 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:07.363931    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6"]
Aug 05 16:56:09.188316 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:09.188283    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6baacdca-73b3-4123-85b2-42810a800076" path="/var/lib/kubelet/pods/6baacdca-73b3-4123-85b2-42810a800076/volumes"
Aug 05 16:56:09.188691 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:09.188665    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c229eb1-e7c2-48da-9c1a-723d0dbb0a87" path="/var/lib/kubelet/pods/9c229eb1-e7c2-48da-9c1a-723d0dbb0a87/volumes"
Aug 05 16:56:19.278810 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:19.278780    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:56:19.284570 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:56:19.284547    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 16:58:11.759616 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.759582    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"]
Aug 05 16:58:11.760255 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760176    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c229eb1-e7c2-48da-9c1a-723d0dbb0a87" containerName="payload-processing"
Aug 05 16:58:11.760255 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760196    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c229eb1-e7c2-48da-9c1a-723d0dbb0a87" containerName="payload-processing"
Aug 05 16:58:11.760255 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760210    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" containerName="maas-api"
Aug 05 16:58:11.760255 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760219    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" containerName="maas-api"
Aug 05 16:58:11.760255 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760248    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6baacdca-73b3-4123-85b2-42810a800076" containerName="payload-pre-processing"
Aug 05 16:58:11.760255 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760258    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6baacdca-73b3-4123-85b2-42810a800076" containerName="payload-pre-processing"
Aug 05 16:58:11.760603 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760364    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c229eb1-e7c2-48da-9c1a-723d0dbb0a87" containerName="payload-processing"
Aug 05 16:58:11.760603 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760384    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34eccf7f-7cb5-4edd-a257-5cc619ee8fc0" containerName="maas-api"
Aug 05 16:58:11.760603 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.760394    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6baacdca-73b3-4123-85b2-42810a800076" containerName="payload-pre-processing"
Aug 05 16:58:11.763477 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.763456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:11.766758 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.766737    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-29433603-serving-cert\""
Aug 05 16:58:11.775693 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.775666    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"]
Aug 05 16:58:11.902613 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.902575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbc871bd-b5af-44c0-b716-a5d40edb4aed-maas-api-tls\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:11.902797 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.902634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc871bd-b5af-44c0-b716-a5d40edb4aed-openshift-service-ca\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:11.902797 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:11.902744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44mn7\" (UniqueName: \"kubernetes.io/projected/fbc871bd-b5af-44c0-b716-a5d40edb4aed-kube-api-access-44mn7\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:12.003741 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.003703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44mn7\" (UniqueName: \"kubernetes.io/projected/fbc871bd-b5af-44c0-b716-a5d40edb4aed-kube-api-access-44mn7\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:12.003912 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.003791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbc871bd-b5af-44c0-b716-a5d40edb4aed-maas-api-tls\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:12.003912 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.003843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc871bd-b5af-44c0-b716-a5d40edb4aed-openshift-service-ca\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:12.004582 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.004560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc871bd-b5af-44c0-b716-a5d40edb4aed-openshift-service-ca\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:12.006318 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.006295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbc871bd-b5af-44c0-b716-a5d40edb4aed-maas-api-tls\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:12.017781 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.017719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44mn7\" (UniqueName: \"kubernetes.io/projected/fbc871bd-b5af-44c0-b716-a5d40edb4aed-kube-api-access-44mn7\") pod \"maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:12.075002 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.074966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:12.420943 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.420887    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"]
Aug 05 16:58:12.423145 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:58:12.423119    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc871bd_b5af_44c0_b716_a5d40edb4aed.slice/crio-bf36a4103800402e1226e16411eee34643d5593e5c80a3cae21d122a14e0b07f WatchSource:0}: Error finding container bf36a4103800402e1226e16411eee34643d5593e5c80a3cae21d122a14e0b07f: Status 404 returned error can't find the container with id bf36a4103800402e1226e16411eee34643d5593e5c80a3cae21d122a14e0b07f
Aug 05 16:58:12.596226 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.596186    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt" event={"ID":"fbc871bd-b5af-44c0-b716-a5d40edb4aed","Type":"ContainerStarted","Data":"bf36a4103800402e1226e16411eee34643d5593e5c80a3cae21d122a14e0b07f"}
Aug 05 16:58:12.756726 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.756627    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"]
Aug 05 16:58:12.761318 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.761302    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:12.764577 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.764554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-29433603\""
Aug 05 16:58:12.764678 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.764624    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-29433603-dockercfg-mzkhx\""
Aug 05 16:58:12.770688 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.770665    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"]
Aug 05 16:58:12.809814 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.809782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc\" (UID: \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:12.809970 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.809890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6fqr\" (UniqueName: \"kubernetes.io/projected/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-kube-api-access-t6fqr\") pod \"payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc\" (UID: \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:12.817859 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.817835    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"]
Aug 05 16:58:12.821624 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.821608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:12.832683 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.832658    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"]
Aug 05 16:58:12.910897 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.910857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc\" (UID: \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:12.911085 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.910948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6fqr\" (UniqueName: \"kubernetes.io/projected/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-kube-api-access-t6fqr\") pod \"payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc\" (UID: \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:12.911085 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.910978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj2mn\" (UniqueName: \"kubernetes.io/projected/d8d8373f-f8bc-472f-a878-7415176f3434-kube-api-access-lj2mn\") pod \"payload-processing-e2e-mt-29433603-675bc98598-sw6z4\" (UID: \"d8d8373f-f8bc-472f-a878-7415176f3434\") " pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:12.911085 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.911012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d8373f-f8bc-472f-a878-7415176f3434-plugins-config-volume\") pod \"payload-processing-e2e-mt-29433603-675bc98598-sw6z4\" (UID: \"d8d8373f-f8bc-472f-a878-7415176f3434\") " pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:12.911581 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.911563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc\" (UID: \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:12.920479 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:12.920457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6fqr\" (UniqueName: \"kubernetes.io/projected/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-kube-api-access-t6fqr\") pod \"payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc\" (UID: \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:13.011677 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.011606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj2mn\" (UniqueName: \"kubernetes.io/projected/d8d8373f-f8bc-472f-a878-7415176f3434-kube-api-access-lj2mn\") pod \"payload-processing-e2e-mt-29433603-675bc98598-sw6z4\" (UID: \"d8d8373f-f8bc-472f-a878-7415176f3434\") " pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:13.011677 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.011646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d8373f-f8bc-472f-a878-7415176f3434-plugins-config-volume\") pod \"payload-processing-e2e-mt-29433603-675bc98598-sw6z4\" (UID: \"d8d8373f-f8bc-472f-a878-7415176f3434\") " pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:13.012301 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.012282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d8373f-f8bc-472f-a878-7415176f3434-plugins-config-volume\") pod \"payload-processing-e2e-mt-29433603-675bc98598-sw6z4\" (UID: \"d8d8373f-f8bc-472f-a878-7415176f3434\") " pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:13.023409 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.023375    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj2mn\" (UniqueName: \"kubernetes.io/projected/d8d8373f-f8bc-472f-a878-7415176f3434-kube-api-access-lj2mn\") pod \"payload-processing-e2e-mt-29433603-675bc98598-sw6z4\" (UID: \"d8d8373f-f8bc-472f-a878-7415176f3434\") " pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:13.072989 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.072967    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:13.134556 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.133329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:13.222379 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.222333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"]
Aug 05 16:58:13.224029 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:58:13.223999    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf9ea0f_f993_4e71_8af1_6e7877648aa7.slice/crio-3fa78c975e872785b9a6392446d1245a3b0ed340786af8d1083ae909eb6205f5 WatchSource:0}: Error finding container 3fa78c975e872785b9a6392446d1245a3b0ed340786af8d1083ae909eb6205f5: Status 404 returned error can't find the container with id 3fa78c975e872785b9a6392446d1245a3b0ed340786af8d1083ae909eb6205f5
Aug 05 16:58:13.281486 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.281460    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"]
Aug 05 16:58:13.282179 ip-10-0-133-70 kubenswrapper[2579]: W0805 16:58:13.282155    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d8373f_f8bc_472f_a878_7415176f3434.slice/crio-81f9b139489dc3e4db843c0ebbf93f0d05f670d2461db2d0baf0f14f542dada3 WatchSource:0}: Error finding container 81f9b139489dc3e4db843c0ebbf93f0d05f670d2461db2d0baf0f14f542dada3: Status 404 returned error can't find the container with id 81f9b139489dc3e4db843c0ebbf93f0d05f670d2461db2d0baf0f14f542dada3
Aug 05 16:58:13.602384 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.602280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt" event={"ID":"fbc871bd-b5af-44c0-b716-a5d40edb4aed","Type":"ContainerStarted","Data":"2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07"}
Aug 05 16:58:13.602562 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.602436    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:13.603939 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.603903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4" event={"ID":"d8d8373f-f8bc-472f-a878-7415176f3434","Type":"ContainerStarted","Data":"634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f"}
Aug 05 16:58:13.604065 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.603950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4" event={"ID":"d8d8373f-f8bc-472f-a878-7415176f3434","Type":"ContainerStarted","Data":"81f9b139489dc3e4db843c0ebbf93f0d05f670d2461db2d0baf0f14f542dada3"}
Aug 05 16:58:13.604065 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.603999    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:13.605463 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.605440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc" event={"ID":"2bf9ea0f-f993-4e71-8af1-6e7877648aa7","Type":"ContainerStarted","Data":"1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1"}
Aug 05 16:58:13.605568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.605475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc" event={"ID":"2bf9ea0f-f993-4e71-8af1-6e7877648aa7","Type":"ContainerStarted","Data":"3fa78c975e872785b9a6392446d1245a3b0ed340786af8d1083ae909eb6205f5"}
Aug 05 16:58:13.605568 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.605562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:13.624244 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.624200    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt" podStartSLOduration=2.015756738 podStartE2EDuration="2.624186455s" totalImagesPullingTime="608.429717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:58:13.622005749 +0000 UTC m=+2214.957803694" watchObservedRunningTime="2026-08-05 16:58:13.624186455 +0000 UTC m=+2214.959984399"
Aug 05 16:58:13.642829 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.642788    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4" podStartSLOduration=1.642774072 podStartE2EDuration="1.642774072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:58:13.639720796 +0000 UTC m=+2214.975518740" watchObservedRunningTime="2026-08-05 16:58:13.642774072 +0000 UTC m=+2214.978572032"
Aug 05 16:58:13.669299 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:13.669255    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc" podStartSLOduration=1.669242181 podStartE2EDuration="1.669242181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:58:13.668618151 +0000 UTC m=+2215.004416108" watchObservedRunningTime="2026-08-05 16:58:13.669242181 +0000 UTC m=+2215.005040126"
Aug 05 16:58:19.616635 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:19.616604    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:24.612731 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:24.612700    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:24.613212 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:24.612780    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:53.698402 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:53.698369    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"]
Aug 05 16:58:53.698947 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:53.698569    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt" podUID="fbc871bd-b5af-44c0-b716-a5d40edb4aed" containerName="maas-api" containerID="cri-o://2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07" gracePeriod=30
Aug 05 16:58:53.765919 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:53.765886    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"]
Aug 05 16:58:53.766116 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:53.766092    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4" podUID="d8d8373f-f8bc-472f-a878-7415176f3434" containerName="payload-processing" containerID="cri-o://634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f" gracePeriod=30
Aug 05 16:58:53.776869 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:53.776843    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"]
Aug 05 16:58:53.777053 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:53.777032    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc" podUID="2bf9ea0f-f993-4e71-8af1-6e7877648aa7" containerName="payload-pre-processing" containerID="cri-o://1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1" gracePeriod=30
Aug 05 16:58:54.042512 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.042488    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:54.046577 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.046551    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:54.060830 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.060810    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:54.188823 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.188790    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc871bd-b5af-44c0-b716-a5d40edb4aed-openshift-service-ca\") pod \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") "
Aug 05 16:58:54.188823 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.188822    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-plugins-config-volume\") pod \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\" (UID: \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\") "
Aug 05 16:58:54.189075 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.188843    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbc871bd-b5af-44c0-b716-a5d40edb4aed-maas-api-tls\") pod \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") "
Aug 05 16:58:54.189075 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.188875    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj2mn\" (UniqueName: \"kubernetes.io/projected/d8d8373f-f8bc-472f-a878-7415176f3434-kube-api-access-lj2mn\") pod \"d8d8373f-f8bc-472f-a878-7415176f3434\" (UID: \"d8d8373f-f8bc-472f-a878-7415176f3434\") "
Aug 05 16:58:54.189075 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.188892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d8373f-f8bc-472f-a878-7415176f3434-plugins-config-volume\") pod \"d8d8373f-f8bc-472f-a878-7415176f3434\" (UID: \"d8d8373f-f8bc-472f-a878-7415176f3434\") "
Aug 05 16:58:54.189075 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.188951    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44mn7\" (UniqueName: \"kubernetes.io/projected/fbc871bd-b5af-44c0-b716-a5d40edb4aed-kube-api-access-44mn7\") pod \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\" (UID: \"fbc871bd-b5af-44c0-b716-a5d40edb4aed\") "
Aug 05 16:58:54.189075 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.188973    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6fqr\" (UniqueName: \"kubernetes.io/projected/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-kube-api-access-t6fqr\") pod \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\" (UID: \"2bf9ea0f-f993-4e71-8af1-6e7877648aa7\") "
Aug 05 16:58:54.189370 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.189309    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8d8373f-f8bc-472f-a878-7415176f3434-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8d8373f-f8bc-472f-a878-7415176f3434" (UID: "d8d8373f-f8bc-472f-a878-7415176f3434"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:58:54.189466 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.189437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bf9ea0f-f993-4e71-8af1-6e7877648aa7" (UID: "2bf9ea0f-f993-4e71-8af1-6e7877648aa7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:58:54.189611 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.189593    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbc871bd-b5af-44c0-b716-a5d40edb4aed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbc871bd-b5af-44c0-b716-a5d40edb4aed" (UID: "fbc871bd-b5af-44c0-b716-a5d40edb4aed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:58:54.191039 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.191007    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d8373f-f8bc-472f-a878-7415176f3434-kube-api-access-lj2mn" (OuterVolumeSpecName: "kube-api-access-lj2mn") pod "d8d8373f-f8bc-472f-a878-7415176f3434" (UID: "d8d8373f-f8bc-472f-a878-7415176f3434"). InnerVolumeSpecName "kube-api-access-lj2mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:58:54.191039 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.191026    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbc871bd-b5af-44c0-b716-a5d40edb4aed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbc871bd-b5af-44c0-b716-a5d40edb4aed" (UID: "fbc871bd-b5af-44c0-b716-a5d40edb4aed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:58:54.191179 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.191129    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc871bd-b5af-44c0-b716-a5d40edb4aed-kube-api-access-44mn7" (OuterVolumeSpecName: "kube-api-access-44mn7") pod "fbc871bd-b5af-44c0-b716-a5d40edb4aed" (UID: "fbc871bd-b5af-44c0-b716-a5d40edb4aed"). InnerVolumeSpecName "kube-api-access-44mn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:58:54.191216 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.191196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-kube-api-access-t6fqr" (OuterVolumeSpecName: "kube-api-access-t6fqr") pod "2bf9ea0f-f993-4e71-8af1-6e7877648aa7" (UID: "2bf9ea0f-f993-4e71-8af1-6e7877648aa7"). InnerVolumeSpecName "kube-api-access-t6fqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:58:54.290423 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.290366    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj2mn\" (UniqueName: \"kubernetes.io/projected/d8d8373f-f8bc-472f-a878-7415176f3434-kube-api-access-lj2mn\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:58:54.290423 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.290389    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d8373f-f8bc-472f-a878-7415176f3434-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:58:54.290423 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.290398    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44mn7\" (UniqueName: \"kubernetes.io/projected/fbc871bd-b5af-44c0-b716-a5d40edb4aed-kube-api-access-44mn7\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:58:54.290423 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.290407    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6fqr\" (UniqueName: \"kubernetes.io/projected/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-kube-api-access-t6fqr\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:58:54.290423 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.290415    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc871bd-b5af-44c0-b716-a5d40edb4aed-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:58:54.290423 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.290424    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf9ea0f-f993-4e71-8af1-6e7877648aa7-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:58:54.290668 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.290434    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbc871bd-b5af-44c0-b716-a5d40edb4aed-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 16:58:54.804446 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.804411    2579 generic.go:356] "Generic (PLEG): container finished" podID="2bf9ea0f-f993-4e71-8af1-6e7877648aa7" containerID="1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1" exitCode=0
Aug 05 16:58:54.804853 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.804461    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"
Aug 05 16:58:54.804853 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.804497    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc" event={"ID":"2bf9ea0f-f993-4e71-8af1-6e7877648aa7","Type":"ContainerDied","Data":"1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1"}
Aug 05 16:58:54.804853 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.804545    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc" event={"ID":"2bf9ea0f-f993-4e71-8af1-6e7877648aa7","Type":"ContainerDied","Data":"3fa78c975e872785b9a6392446d1245a3b0ed340786af8d1083ae909eb6205f5"}
Aug 05 16:58:54.804853 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.804567    2579 scope.go:117] "RemoveContainer" containerID="1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1"
Aug 05 16:58:54.805944 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.805903    2579 generic.go:356] "Generic (PLEG): container finished" podID="fbc871bd-b5af-44c0-b716-a5d40edb4aed" containerID="2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07" exitCode=0
Aug 05 16:58:54.805944 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.805942    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"
Aug 05 16:58:54.806141 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.805962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt" event={"ID":"fbc871bd-b5af-44c0-b716-a5d40edb4aed","Type":"ContainerDied","Data":"2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07"}
Aug 05 16:58:54.806141 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.806027    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt" event={"ID":"fbc871bd-b5af-44c0-b716-a5d40edb4aed","Type":"ContainerDied","Data":"bf36a4103800402e1226e16411eee34643d5593e5c80a3cae21d122a14e0b07f"}
Aug 05 16:58:54.807501 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.807477    2579 generic.go:356] "Generic (PLEG): container finished" podID="d8d8373f-f8bc-472f-a878-7415176f3434" containerID="634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f" exitCode=0
Aug 05 16:58:54.807618 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.807522    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"
Aug 05 16:58:54.807618 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.807528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4" event={"ID":"d8d8373f-f8bc-472f-a878-7415176f3434","Type":"ContainerDied","Data":"634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f"}
Aug 05 16:58:54.807618 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.807567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4" event={"ID":"d8d8373f-f8bc-472f-a878-7415176f3434","Type":"ContainerDied","Data":"81f9b139489dc3e4db843c0ebbf93f0d05f670d2461db2d0baf0f14f542dada3"}
Aug 05 16:58:54.814703 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.814681    2579 scope.go:117] "RemoveContainer" containerID="1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1"
Aug 05 16:58:54.815102 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:58:54.815077    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1\": container with ID starting with 1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1 not found: ID does not exist" containerID="1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1"
Aug 05 16:58:54.815196 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.815111    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1"} err="failed to get container status \"1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1\": rpc error: code = NotFound desc = could not find container \"1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1\": container with ID starting with 1c4870c8b62b1ddf4ad93212f66c6db884223549bff10ffe45e9aeb28de231e1 not found: ID does not exist"
Aug 05 16:58:54.815196 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.815134    2579 scope.go:117] "RemoveContainer" containerID="2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07"
Aug 05 16:58:54.823980 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.823959    2579 scope.go:117] "RemoveContainer" containerID="2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07"
Aug 05 16:58:54.824218 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:58:54.824200    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07\": container with ID starting with 2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07 not found: ID does not exist" containerID="2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07"
Aug 05 16:58:54.824270 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.824225    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07"} err="failed to get container status \"2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07\": rpc error: code = NotFound desc = could not find container \"2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07\": container with ID starting with 2d7181fd32426ba3845af26816e0b76006a5f22cf7227474d41b83bacfc71f07 not found: ID does not exist"
Aug 05 16:58:54.824270 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.824242    2579 scope.go:117] "RemoveContainer" containerID="634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f"
Aug 05 16:58:54.831986 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.831963    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"]
Aug 05 16:58:54.832848 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.832828    2579 scope.go:117] "RemoveContainer" containerID="634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f"
Aug 05 16:58:54.833093 ip-10-0-133-70 kubenswrapper[2579]: E0805 16:58:54.833075    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f\": container with ID starting with 634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f not found: ID does not exist" containerID="634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f"
Aug 05 16:58:54.833138 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.833100    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f"} err="failed to get container status \"634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f\": rpc error: code = NotFound desc = could not find container \"634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f\": container with ID starting with 634c1de64151cd8401b5dcb8e5d8855d08ac9022b98169da017b1e4d733af10f not found: ID does not exist"
Aug 05 16:58:54.837620 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.837599    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc"]
Aug 05 16:58:54.849106 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.849082    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"]
Aug 05 16:58:54.854285 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.854264    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-29433603-64dfffdc5d-2cfgt"]
Aug 05 16:58:54.866322 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.866299    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"]
Aug 05 16:58:54.871420 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:54.871399    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4"]
Aug 05 16:58:55.188742 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:55.188701    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf9ea0f-f993-4e71-8af1-6e7877648aa7" path="/var/lib/kubelet/pods/2bf9ea0f-f993-4e71-8af1-6e7877648aa7/volumes"
Aug 05 16:58:55.189160 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:55.189140    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d8373f-f8bc-472f-a878-7415176f3434" path="/var/lib/kubelet/pods/d8d8373f-f8bc-472f-a878-7415176f3434/volumes"
Aug 05 16:58:55.189594 ip-10-0-133-70 kubenswrapper[2579]: I0805 16:58:55.189575    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbc871bd-b5af-44c0-b716-a5d40edb4aed" path="/var/lib/kubelet/pods/fbc871bd-b5af-44c0-b716-a5d40edb4aed/volumes"
Aug 05 17:01:19.309131 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:19.309107    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:01:19.315925 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:19.315903    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:01:20.561209 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561173    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"]
Aug 05 17:01:20.561660 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561591    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf9ea0f-f993-4e71-8af1-6e7877648aa7" containerName="payload-pre-processing"
Aug 05 17:01:20.561660 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561603    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf9ea0f-f993-4e71-8af1-6e7877648aa7" containerName="payload-pre-processing"
Aug 05 17:01:20.561660 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561612    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d8373f-f8bc-472f-a878-7415176f3434" containerName="payload-processing"
Aug 05 17:01:20.561660 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561618    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d8373f-f8bc-472f-a878-7415176f3434" containerName="payload-processing"
Aug 05 17:01:20.561660 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561639    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc871bd-b5af-44c0-b716-a5d40edb4aed" containerName="maas-api"
Aug 05 17:01:20.561660 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561645    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc871bd-b5af-44c0-b716-a5d40edb4aed" containerName="maas-api"
Aug 05 17:01:20.561913 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561701    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d8373f-f8bc-472f-a878-7415176f3434" containerName="payload-processing"
Aug 05 17:01:20.561913 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561712    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf9ea0f-f993-4e71-8af1-6e7877648aa7" containerName="payload-pre-processing"
Aug 05 17:01:20.561913 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.561722    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc871bd-b5af-44c0-b716-a5d40edb4aed" containerName="maas-api"
Aug 05 17:01:20.564974 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.564955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:20.568377 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.568331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d2645e95-serving-cert\""
Aug 05 17:01:20.577504 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.577483    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"]
Aug 05 17:01:20.617773 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.617738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:20.617953 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.617915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4xs7\" (UniqueName: \"kubernetes.io/projected/b1862627-7313-4161-bc43-5ae5f5e9a8af-kube-api-access-w4xs7\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:20.618015 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.617967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1862627-7313-4161-bc43-5ae5f5e9a8af-openshift-service-ca\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:20.718704 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.718667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4xs7\" (UniqueName: \"kubernetes.io/projected/b1862627-7313-4161-bc43-5ae5f5e9a8af-kube-api-access-w4xs7\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:20.718883 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.718715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1862627-7313-4161-bc43-5ae5f5e9a8af-openshift-service-ca\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:20.718883 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.718789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:20.719078 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:01:20.718945    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-serving-cert: secret "maas-api-e2e-mt-d2645e95-serving-cert" not found
Aug 05 17:01:20.719078 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:01:20.719021    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls podName:b1862627-7313-4161-bc43-5ae5f5e9a8af nodeName:}" failed. No retries permitted until 2026-08-05 17:01:21.219001208 +0000 UTC m=+2402.554799130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls") pod "maas-api-e2e-mt-d2645e95-76d77c656b-btrqq" (UID: "b1862627-7313-4161-bc43-5ae5f5e9a8af") : secret "maas-api-e2e-mt-d2645e95-serving-cert" not found
Aug 05 17:01:20.719496 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.719473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1862627-7313-4161-bc43-5ae5f5e9a8af-openshift-service-ca\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:20.733037 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:20.733011    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4xs7\" (UniqueName: \"kubernetes.io/projected/b1862627-7313-4161-bc43-5ae5f5e9a8af-kube-api-access-w4xs7\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:21.223894 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.223848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:21.226438 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.226410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls\") pod \"maas-api-e2e-mt-d2645e95-76d77c656b-btrqq\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:21.373461 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.373429    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"]
Aug 05 17:01:21.377087 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.377069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:21.381797 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.381779    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d2645e95\""
Aug 05 17:01:21.392492 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.392469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"]
Aug 05 17:01:21.425553 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.425516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6l8l\" (UniqueName: \"kubernetes.io/projected/8edf1481-9fc1-47be-8404-68b248894789-kube-api-access-h6l8l\") pod \"payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv\" (UID: \"8edf1481-9fc1-47be-8404-68b248894789\") " pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:21.425719 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.425568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8edf1481-9fc1-47be-8404-68b248894789-plugins-config-volume\") pod \"payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv\" (UID: \"8edf1481-9fc1-47be-8404-68b248894789\") " pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:21.444701 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.444669    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"]
Aug 05 17:01:21.448123 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.448104    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:21.451907 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.451887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d2645e95-dockercfg-l8z4k\""
Aug 05 17:01:21.460764 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.460739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"]
Aug 05 17:01:21.477039 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.476957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:21.527151 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.527118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8edf1481-9fc1-47be-8404-68b248894789-plugins-config-volume\") pod \"payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv\" (UID: \"8edf1481-9fc1-47be-8404-68b248894789\") " pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:21.527552 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.527526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd4959d5-c417-45de-bec3-83eabbf0f364-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l\" (UID: \"fd4959d5-c417-45de-bec3-83eabbf0f364\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:21.527863 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.527843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg6cc\" (UniqueName: \"kubernetes.io/projected/fd4959d5-c417-45de-bec3-83eabbf0f364-kube-api-access-xg6cc\") pod \"payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l\" (UID: \"fd4959d5-c417-45de-bec3-83eabbf0f364\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:21.528007 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.527948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6l8l\" (UniqueName: \"kubernetes.io/projected/8edf1481-9fc1-47be-8404-68b248894789-kube-api-access-h6l8l\") pod \"payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv\" (UID: \"8edf1481-9fc1-47be-8404-68b248894789\") " pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:21.529734 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.528645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8edf1481-9fc1-47be-8404-68b248894789-plugins-config-volume\") pod \"payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv\" (UID: \"8edf1481-9fc1-47be-8404-68b248894789\") " pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:21.578227 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.578197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6l8l\" (UniqueName: \"kubernetes.io/projected/8edf1481-9fc1-47be-8404-68b248894789-kube-api-access-h6l8l\") pod \"payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv\" (UID: \"8edf1481-9fc1-47be-8404-68b248894789\") " pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:21.628679 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.628641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd4959d5-c417-45de-bec3-83eabbf0f364-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l\" (UID: \"fd4959d5-c417-45de-bec3-83eabbf0f364\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:21.628679 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.628685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg6cc\" (UniqueName: \"kubernetes.io/projected/fd4959d5-c417-45de-bec3-83eabbf0f364-kube-api-access-xg6cc\") pod \"payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l\" (UID: \"fd4959d5-c417-45de-bec3-83eabbf0f364\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:21.629554 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.629524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd4959d5-c417-45de-bec3-83eabbf0f364-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l\" (UID: \"fd4959d5-c417-45de-bec3-83eabbf0f364\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:21.648674 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.648648    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"]
Aug 05 17:01:21.650989 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:01:21.650966    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1862627_7313_4161_bc43_5ae5f5e9a8af.slice/crio-c3e9d622104b71a37461fabda58b32c71a1b2fd5dbcda76fc2130cf85400daea WatchSource:0}: Error finding container c3e9d622104b71a37461fabda58b32c71a1b2fd5dbcda76fc2130cf85400daea: Status 404 returned error can't find the container with id c3e9d622104b71a37461fabda58b32c71a1b2fd5dbcda76fc2130cf85400daea
Aug 05 17:01:21.652283 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.652266    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:01:21.661413 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.661386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg6cc\" (UniqueName: \"kubernetes.io/projected/fd4959d5-c417-45de-bec3-83eabbf0f364-kube-api-access-xg6cc\") pod \"payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l\" (UID: \"fd4959d5-c417-45de-bec3-83eabbf0f364\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:21.687669 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.687642    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:21.759391 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.759361    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:21.838766 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.838738    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"]
Aug 05 17:01:21.840934 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:01:21.840910    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edf1481_9fc1_47be_8404_68b248894789.slice/crio-726919a7d747443847172120e7255ad28f3f84d523281968550a9f05a202c75e WatchSource:0}: Error finding container 726919a7d747443847172120e7255ad28f3f84d523281968550a9f05a202c75e: Status 404 returned error can't find the container with id 726919a7d747443847172120e7255ad28f3f84d523281968550a9f05a202c75e
Aug 05 17:01:21.917143 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:21.917116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"]
Aug 05 17:01:21.918201 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:01:21.918161    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4959d5_c417_45de_bec3_83eabbf0f364.slice/crio-1c5e600bbaf59dbd3af6c442b4b75f06935e24ddc6ecc7cad4476226cc71dad1 WatchSource:0}: Error finding container 1c5e600bbaf59dbd3af6c442b4b75f06935e24ddc6ecc7cad4476226cc71dad1: Status 404 returned error can't find the container with id 1c5e600bbaf59dbd3af6c442b4b75f06935e24ddc6ecc7cad4476226cc71dad1
Aug 05 17:01:22.512970 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.512937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l" event={"ID":"fd4959d5-c417-45de-bec3-83eabbf0f364","Type":"ContainerStarted","Data":"08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f"}
Aug 05 17:01:22.513125 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.512994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l" event={"ID":"fd4959d5-c417-45de-bec3-83eabbf0f364","Type":"ContainerStarted","Data":"1c5e600bbaf59dbd3af6c442b4b75f06935e24ddc6ecc7cad4476226cc71dad1"}
Aug 05 17:01:22.513125 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.513051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:01:22.514571 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.514546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv" event={"ID":"8edf1481-9fc1-47be-8404-68b248894789","Type":"ContainerStarted","Data":"2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a"}
Aug 05 17:01:22.514716 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.514584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv" event={"ID":"8edf1481-9fc1-47be-8404-68b248894789","Type":"ContainerStarted","Data":"726919a7d747443847172120e7255ad28f3f84d523281968550a9f05a202c75e"}
Aug 05 17:01:22.514716 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.514605    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:22.515904 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.515884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq" event={"ID":"b1862627-7313-4161-bc43-5ae5f5e9a8af","Type":"ContainerStarted","Data":"4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85"}
Aug 05 17:01:22.515979 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.515918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq" event={"ID":"b1862627-7313-4161-bc43-5ae5f5e9a8af","Type":"ContainerStarted","Data":"c3e9d622104b71a37461fabda58b32c71a1b2fd5dbcda76fc2130cf85400daea"}
Aug 05 17:01:22.515979 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.515940    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:22.533228 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.533153    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l" podStartSLOduration=1.5331340469999999 podStartE2EDuration="1.533134047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:01:22.532280325 +0000 UTC m=+2403.868078269" watchObservedRunningTime="2026-08-05 17:01:22.533134047 +0000 UTC m=+2403.868931996"
Aug 05 17:01:22.553053 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.553001    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv" podStartSLOduration=1.552982584 podStartE2EDuration="1.552982584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:01:22.552606737 +0000 UTC m=+2403.888404695" watchObservedRunningTime="2026-08-05 17:01:22.552982584 +0000 UTC m=+2403.888780527"
Aug 05 17:01:22.575372 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:22.575295    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq" podStartSLOduration=1.855905122 podStartE2EDuration="2.575277592s" totalImagesPullingTime="719.37247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:01:22.573480493 +0000 UTC m=+2403.909278462" watchObservedRunningTime="2026-08-05 17:01:22.575277592 +0000 UTC m=+2403.911075541"
Aug 05 17:01:28.526926 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:28.526894    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:01:33.523237 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:33.523206    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:01:33.523652 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:01:33.523553    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:02:34.676957 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:34.676924    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"]
Aug 05 17:02:34.766004 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:34.765964    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"]
Aug 05 17:02:34.766292 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:34.766255    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv" podUID="8edf1481-9fc1-47be-8404-68b248894789" containerName="payload-processing" containerID="cri-o://2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a" gracePeriod=30
Aug 05 17:02:34.777120 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:34.777076    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"]
Aug 05 17:02:34.777333 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:34.777306    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l" podUID="fd4959d5-c417-45de-bec3-83eabbf0f364" containerName="payload-pre-processing" containerID="cri-o://08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f" gracePeriod=30
Aug 05 17:02:34.871452 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:34.871394    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq" podUID="b1862627-7313-4161-bc43-5ae5f5e9a8af" containerName="maas-api" containerID="cri-o://4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85" gracePeriod=30
Aug 05 17:02:35.022382 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.022247    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:02:35.119168 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.119145    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6l8l\" (UniqueName: \"kubernetes.io/projected/8edf1481-9fc1-47be-8404-68b248894789-kube-api-access-h6l8l\") pod \"8edf1481-9fc1-47be-8404-68b248894789\" (UID: \"8edf1481-9fc1-47be-8404-68b248894789\") "
Aug 05 17:02:35.119299 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.119248    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8edf1481-9fc1-47be-8404-68b248894789-plugins-config-volume\") pod \"8edf1481-9fc1-47be-8404-68b248894789\" (UID: \"8edf1481-9fc1-47be-8404-68b248894789\") "
Aug 05 17:02:35.119746 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.119717    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8edf1481-9fc1-47be-8404-68b248894789-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8edf1481-9fc1-47be-8404-68b248894789" (UID: "8edf1481-9fc1-47be-8404-68b248894789"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:02:35.121681 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.121658    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8edf1481-9fc1-47be-8404-68b248894789-kube-api-access-h6l8l" (OuterVolumeSpecName: "kube-api-access-h6l8l") pod "8edf1481-9fc1-47be-8404-68b248894789" (UID: "8edf1481-9fc1-47be-8404-68b248894789"). InnerVolumeSpecName "kube-api-access-h6l8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:02:35.124043 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.124016    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:02:35.131965 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.131948    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:02:35.220076 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220044    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4xs7\" (UniqueName: \"kubernetes.io/projected/b1862627-7313-4161-bc43-5ae5f5e9a8af-kube-api-access-w4xs7\") pod \"b1862627-7313-4161-bc43-5ae5f5e9a8af\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") "
Aug 05 17:02:35.220076 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg6cc\" (UniqueName: \"kubernetes.io/projected/fd4959d5-c417-45de-bec3-83eabbf0f364-kube-api-access-xg6cc\") pod \"fd4959d5-c417-45de-bec3-83eabbf0f364\" (UID: \"fd4959d5-c417-45de-bec3-83eabbf0f364\") "
Aug 05 17:02:35.220249 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220131    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls\") pod \"b1862627-7313-4161-bc43-5ae5f5e9a8af\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") "
Aug 05 17:02:35.220249 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220153    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1862627-7313-4161-bc43-5ae5f5e9a8af-openshift-service-ca\") pod \"b1862627-7313-4161-bc43-5ae5f5e9a8af\" (UID: \"b1862627-7313-4161-bc43-5ae5f5e9a8af\") "
Aug 05 17:02:35.220249 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220178    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd4959d5-c417-45de-bec3-83eabbf0f364-plugins-config-volume\") pod \"fd4959d5-c417-45de-bec3-83eabbf0f364\" (UID: \"fd4959d5-c417-45de-bec3-83eabbf0f364\") "
Aug 05 17:02:35.220575 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220542    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1862627-7313-4161-bc43-5ae5f5e9a8af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1862627-7313-4161-bc43-5ae5f5e9a8af" (UID: "b1862627-7313-4161-bc43-5ae5f5e9a8af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:02:35.220575 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220573    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8edf1481-9fc1-47be-8404-68b248894789-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:02:35.220731 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220578    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd4959d5-c417-45de-bec3-83eabbf0f364-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd4959d5-c417-45de-bec3-83eabbf0f364" (UID: "fd4959d5-c417-45de-bec3-83eabbf0f364"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:02:35.220731 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.220595    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6l8l\" (UniqueName: \"kubernetes.io/projected/8edf1481-9fc1-47be-8404-68b248894789-kube-api-access-h6l8l\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:02:35.222190 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.222170    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1862627-7313-4161-bc43-5ae5f5e9a8af" (UID: "b1862627-7313-4161-bc43-5ae5f5e9a8af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:02:35.222190 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.222176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1862627-7313-4161-bc43-5ae5f5e9a8af-kube-api-access-w4xs7" (OuterVolumeSpecName: "kube-api-access-w4xs7") pod "b1862627-7313-4161-bc43-5ae5f5e9a8af" (UID: "b1862627-7313-4161-bc43-5ae5f5e9a8af"). InnerVolumeSpecName "kube-api-access-w4xs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:02:35.222317 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.222222    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd4959d5-c417-45de-bec3-83eabbf0f364-kube-api-access-xg6cc" (OuterVolumeSpecName: "kube-api-access-xg6cc") pod "fd4959d5-c417-45de-bec3-83eabbf0f364" (UID: "fd4959d5-c417-45de-bec3-83eabbf0f364"). InnerVolumeSpecName "kube-api-access-xg6cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:02:35.321238 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.321206    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4xs7\" (UniqueName: \"kubernetes.io/projected/b1862627-7313-4161-bc43-5ae5f5e9a8af-kube-api-access-w4xs7\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:02:35.321238 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.321232    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg6cc\" (UniqueName: \"kubernetes.io/projected/fd4959d5-c417-45de-bec3-83eabbf0f364-kube-api-access-xg6cc\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:02:35.321238 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.321242    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1862627-7313-4161-bc43-5ae5f5e9a8af-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:02:35.321465 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.321252    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1862627-7313-4161-bc43-5ae5f5e9a8af-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:02:35.321465 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.321261    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd4959d5-c417-45de-bec3-83eabbf0f364-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:02:35.878170 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.878135    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd4959d5-c417-45de-bec3-83eabbf0f364" containerID="08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f" exitCode=0
Aug 05 17:02:35.878656 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.878175    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"
Aug 05 17:02:35.878656 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.878211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l" event={"ID":"fd4959d5-c417-45de-bec3-83eabbf0f364","Type":"ContainerDied","Data":"08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f"}
Aug 05 17:02:35.878656 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.878254    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l" event={"ID":"fd4959d5-c417-45de-bec3-83eabbf0f364","Type":"ContainerDied","Data":"1c5e600bbaf59dbd3af6c442b4b75f06935e24ddc6ecc7cad4476226cc71dad1"}
Aug 05 17:02:35.878656 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.878275    2579 scope.go:117] "RemoveContainer" containerID="08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f"
Aug 05 17:02:35.879584 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.879563    2579 generic.go:356] "Generic (PLEG): container finished" podID="8edf1481-9fc1-47be-8404-68b248894789" containerID="2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a" exitCode=0
Aug 05 17:02:35.879651 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.879604    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"
Aug 05 17:02:35.879704 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.879635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv" event={"ID":"8edf1481-9fc1-47be-8404-68b248894789","Type":"ContainerDied","Data":"2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a"}
Aug 05 17:02:35.879704 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.879694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv" event={"ID":"8edf1481-9fc1-47be-8404-68b248894789","Type":"ContainerDied","Data":"726919a7d747443847172120e7255ad28f3f84d523281968550a9f05a202c75e"}
Aug 05 17:02:35.881207 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.881180    2579 generic.go:356] "Generic (PLEG): container finished" podID="b1862627-7313-4161-bc43-5ae5f5e9a8af" containerID="4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85" exitCode=0
Aug 05 17:02:35.881360 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.881222    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"
Aug 05 17:02:35.881360 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.881248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq" event={"ID":"b1862627-7313-4161-bc43-5ae5f5e9a8af","Type":"ContainerDied","Data":"4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85"}
Aug 05 17:02:35.881360 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.881290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq" event={"ID":"b1862627-7313-4161-bc43-5ae5f5e9a8af","Type":"ContainerDied","Data":"c3e9d622104b71a37461fabda58b32c71a1b2fd5dbcda76fc2130cf85400daea"}
Aug 05 17:02:35.888096 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.888078    2579 scope.go:117] "RemoveContainer" containerID="08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f"
Aug 05 17:02:35.888322 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:02:35.888306    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f\": container with ID starting with 08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f not found: ID does not exist" containerID="08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f"
Aug 05 17:02:35.888425 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.888328    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f"} err="failed to get container status \"08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f\": rpc error: code = NotFound desc = could not find container \"08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f\": container with ID starting with 08ab7a93797bbc94afedc6fc2a9a532aec6a30ef937dc268a319a267eac0a12f not found: ID does not exist"
Aug 05 17:02:35.888500 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.888440    2579 scope.go:117] "RemoveContainer" containerID="2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a"
Aug 05 17:02:35.896184 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.896169    2579 scope.go:117] "RemoveContainer" containerID="2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a"
Aug 05 17:02:35.896444 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:02:35.896423    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a\": container with ID starting with 2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a not found: ID does not exist" containerID="2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a"
Aug 05 17:02:35.896534 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.896446    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a"} err="failed to get container status \"2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a\": rpc error: code = NotFound desc = could not find container \"2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a\": container with ID starting with 2f2b146c97a5d500a16b2fac0597ec614a46dc03dde5204a1f33b25a5774cb0a not found: ID does not exist"
Aug 05 17:02:35.896534 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.896461    2579 scope.go:117] "RemoveContainer" containerID="4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85"
Aug 05 17:02:35.903764 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.903747    2579 scope.go:117] "RemoveContainer" containerID="4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85"
Aug 05 17:02:35.903995 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:02:35.903976    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85\": container with ID starting with 4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85 not found: ID does not exist" containerID="4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85"
Aug 05 17:02:35.904060 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.903999    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85"} err="failed to get container status \"4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85\": rpc error: code = NotFound desc = could not find container \"4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85\": container with ID starting with 4ce69b08f1a9051e8d5fc88d803fb5a8c44258752766c24164945299b32cdb85 not found: ID does not exist"
Aug 05 17:02:35.906146 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.906128    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"]
Aug 05 17:02:35.908009 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.907991    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv"]
Aug 05 17:02:35.921002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.920982    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"]
Aug 05 17:02:35.926023 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.926004    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2645e95-76d77c656b-btrqq"]
Aug 05 17:02:35.941134 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.941114    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"]
Aug 05 17:02:35.946674 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:35.946653    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l"]
Aug 05 17:02:37.189470 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:37.189439    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8edf1481-9fc1-47be-8404-68b248894789" path="/var/lib/kubelet/pods/8edf1481-9fc1-47be-8404-68b248894789/volumes"
Aug 05 17:02:37.189827 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:37.189808    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1862627-7313-4161-bc43-5ae5f5e9a8af" path="/var/lib/kubelet/pods/b1862627-7313-4161-bc43-5ae5f5e9a8af/volumes"
Aug 05 17:02:37.190116 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:02:37.190103    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd4959d5-c417-45de-bec3-83eabbf0f364" path="/var/lib/kubelet/pods/fd4959d5-c417-45de-bec3-83eabbf0f364/volumes"
Aug 05 17:04:38.479744 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.479712    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"]
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480122    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8edf1481-9fc1-47be-8404-68b248894789" containerName="payload-processing"
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480136    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8edf1481-9fc1-47be-8404-68b248894789" containerName="payload-processing"
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480144    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd4959d5-c417-45de-bec3-83eabbf0f364" containerName="payload-pre-processing"
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480154    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4959d5-c417-45de-bec3-83eabbf0f364" containerName="payload-pre-processing"
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480168    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1862627-7313-4161-bc43-5ae5f5e9a8af" containerName="maas-api"
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480174    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1862627-7313-4161-bc43-5ae5f5e9a8af" containerName="maas-api"
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480265    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8edf1481-9fc1-47be-8404-68b248894789" containerName="payload-processing"
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480275    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1862627-7313-4161-bc43-5ae5f5e9a8af" containerName="maas-api"
Aug 05 17:04:38.480285 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.480281    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd4959d5-c417-45de-bec3-83eabbf0f364" containerName="payload-pre-processing"
Aug 05 17:04:38.484534 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.484514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:38.490582 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.490559    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-09f3f8-serving-cert\""
Aug 05 17:04:38.498704 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.498670    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"]
Aug 05 17:04:38.600357 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.600312    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20166ffb-cc41-4049-a365-428d89ed687b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:38.600517 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.600433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:38.600517 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.600466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l45nj\" (UniqueName: \"kubernetes.io/projected/20166ffb-cc41-4049-a365-428d89ed687b-kube-api-access-l45nj\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:38.701196 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.701162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20166ffb-cc41-4049-a365-428d89ed687b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:38.701379 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.701222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:38.701379 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:04:38.701304    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-serving-cert: secret "maas-api-e2e-inf-a-09f3f8-serving-cert" not found
Aug 05 17:04:38.701379 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:04:38.701368    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls podName:20166ffb-cc41-4049-a365-428d89ed687b nodeName:}" failed. No retries permitted until 2026-08-05 17:04:39.201338989 +0000 UTC m=+2600.537136911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls") pod "maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb" (UID: "20166ffb-cc41-4049-a365-428d89ed687b") : secret "maas-api-e2e-inf-a-09f3f8-serving-cert" not found
Aug 05 17:04:38.701565 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.701370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l45nj\" (UniqueName: \"kubernetes.io/projected/20166ffb-cc41-4049-a365-428d89ed687b-kube-api-access-l45nj\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:38.701966 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.701941    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20166ffb-cc41-4049-a365-428d89ed687b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:38.713019 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:38.712997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l45nj\" (UniqueName: \"kubernetes.io/projected/20166ffb-cc41-4049-a365-428d89ed687b-kube-api-access-l45nj\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:39.206405 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.206375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:39.208828 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.208805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls\") pod \"maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:39.367752 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.367719    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"]
Aug 05 17:04:39.372088 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.372064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:39.375312 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.375294    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-09f3f8-dockercfg-c4fbb\""
Aug 05 17:04:39.376540 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.376522    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-09f3f8\""
Aug 05 17:04:39.390665 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.390640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"]
Aug 05 17:04:39.394812 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.394792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:39.463924 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.463856    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"]
Aug 05 17:04:39.468722 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.468700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:39.483402 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.483377    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"]
Aug 05 17:04:39.510305 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.510270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca33d453-c111-4040-9b6e-18ff3b50612e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf\" (UID: \"ca33d453-c111-4040-9b6e-18ff3b50612e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:39.510496 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.510361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7phj\" (UniqueName: \"kubernetes.io/projected/ca33d453-c111-4040-9b6e-18ff3b50612e-kube-api-access-n7phj\") pod \"payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf\" (UID: \"ca33d453-c111-4040-9b6e-18ff3b50612e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:39.544311 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.544289    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"]
Aug 05 17:04:39.546337 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:04:39.546300    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20166ffb_cc41_4049_a365_428d89ed687b.slice/crio-129688f4e8868e13d1c4e28225fbe8d84d4a493f84a3463b45ec42c60310c320 WatchSource:0}: Error finding container 129688f4e8868e13d1c4e28225fbe8d84d4a493f84a3463b45ec42c60310c320: Status 404 returned error can't find the container with id 129688f4e8868e13d1c4e28225fbe8d84d4a493f84a3463b45ec42c60310c320
Aug 05 17:04:39.611090 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.611057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7phj\" (UniqueName: \"kubernetes.io/projected/ca33d453-c111-4040-9b6e-18ff3b50612e-kube-api-access-n7phj\") pod \"payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf\" (UID: \"ca33d453-c111-4040-9b6e-18ff3b50612e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:39.611236 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.611160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9de1673b-9f33-45f3-80ed-79f02f076b8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4\" (UID: \"9de1673b-9f33-45f3-80ed-79f02f076b8a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:39.611236 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.611215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca33d453-c111-4040-9b6e-18ff3b50612e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf\" (UID: \"ca33d453-c111-4040-9b6e-18ff3b50612e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:39.611400 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.611276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl45n\" (UniqueName: \"kubernetes.io/projected/9de1673b-9f33-45f3-80ed-79f02f076b8a-kube-api-access-nl45n\") pod \"payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4\" (UID: \"9de1673b-9f33-45f3-80ed-79f02f076b8a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:39.611940 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.611918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca33d453-c111-4040-9b6e-18ff3b50612e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf\" (UID: \"ca33d453-c111-4040-9b6e-18ff3b50612e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:39.620972 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.620947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7phj\" (UniqueName: \"kubernetes.io/projected/ca33d453-c111-4040-9b6e-18ff3b50612e-kube-api-access-n7phj\") pod \"payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf\" (UID: \"ca33d453-c111-4040-9b6e-18ff3b50612e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:39.682867 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.682847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:39.712021 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.711987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9de1673b-9f33-45f3-80ed-79f02f076b8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4\" (UID: \"9de1673b-9f33-45f3-80ed-79f02f076b8a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:39.712140 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.712072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl45n\" (UniqueName: \"kubernetes.io/projected/9de1673b-9f33-45f3-80ed-79f02f076b8a-kube-api-access-nl45n\") pod \"payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4\" (UID: \"9de1673b-9f33-45f3-80ed-79f02f076b8a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:39.712699 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.712676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9de1673b-9f33-45f3-80ed-79f02f076b8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4\" (UID: \"9de1673b-9f33-45f3-80ed-79f02f076b8a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:39.722071 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.722017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl45n\" (UniqueName: \"kubernetes.io/projected/9de1673b-9f33-45f3-80ed-79f02f076b8a-kube-api-access-nl45n\") pod \"payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4\" (UID: \"9de1673b-9f33-45f3-80ed-79f02f076b8a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:39.779402 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.779370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:39.825023 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.824992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"]
Aug 05 17:04:39.828864 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:04:39.828834    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca33d453_c111_4040_9b6e_18ff3b50612e.slice/crio-70e967a23482de37b1de681c08cbf43947a74e956621937d96acc2b8e9f8e116 WatchSource:0}: Error finding container 70e967a23482de37b1de681c08cbf43947a74e956621937d96acc2b8e9f8e116: Status 404 returned error can't find the container with id 70e967a23482de37b1de681c08cbf43947a74e956621937d96acc2b8e9f8e116
Aug 05 17:04:39.927218 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:39.927193    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"]
Aug 05 17:04:39.930098 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:04:39.930073    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de1673b_9f33_45f3_80ed_79f02f076b8a.slice/crio-5f1d9a4cb850b20beb0b13f9784d20cbe7968da80779b81fb77e73c847f7eba4 WatchSource:0}: Error finding container 5f1d9a4cb850b20beb0b13f9784d20cbe7968da80779b81fb77e73c847f7eba4: Status 404 returned error can't find the container with id 5f1d9a4cb850b20beb0b13f9784d20cbe7968da80779b81fb77e73c847f7eba4
Aug 05 17:04:40.464003 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.463971    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4" event={"ID":"9de1673b-9f33-45f3-80ed-79f02f076b8a","Type":"ContainerStarted","Data":"8d92e1229b99898cc752287a7a113afba50342ef3c9a0917f135979eb4577271"}
Aug 05 17:04:40.464205 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.464030    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4" event={"ID":"9de1673b-9f33-45f3-80ed-79f02f076b8a","Type":"ContainerStarted","Data":"5f1d9a4cb850b20beb0b13f9784d20cbe7968da80779b81fb77e73c847f7eba4"}
Aug 05 17:04:40.464205 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.464080    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:40.465836 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.465807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb" event={"ID":"20166ffb-cc41-4049-a365-428d89ed687b","Type":"ContainerStarted","Data":"1fb5ed8481c180749c5c446cbb310c1d3b0ba785432ca2e1418b9937fe440d3d"}
Aug 05 17:04:40.465968 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.465863    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:40.465968 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.465888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb" event={"ID":"20166ffb-cc41-4049-a365-428d89ed687b","Type":"ContainerStarted","Data":"129688f4e8868e13d1c4e28225fbe8d84d4a493f84a3463b45ec42c60310c320"}
Aug 05 17:04:40.467360 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.467322    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf" event={"ID":"ca33d453-c111-4040-9b6e-18ff3b50612e","Type":"ContainerStarted","Data":"6444f96fa11fafcfb491bbd0e95fc6ec3b28ec29de7cd59c4d45852b9906b13d"}
Aug 05 17:04:40.467478 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.467388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:04:40.467478 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.467404    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf" event={"ID":"ca33d453-c111-4040-9b6e-18ff3b50612e","Type":"ContainerStarted","Data":"70e967a23482de37b1de681c08cbf43947a74e956621937d96acc2b8e9f8e116"}
Aug 05 17:04:40.486466 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.486417    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4" podStartSLOduration=1.486404277 podStartE2EDuration="1.486404277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:04:40.484539086 +0000 UTC m=+2601.820337031" watchObservedRunningTime="2026-08-05 17:04:40.486404277 +0000 UTC m=+2601.822202199"
Aug 05 17:04:40.503124 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.503085    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf" podStartSLOduration=1.50307198 podStartE2EDuration="1.50307198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:04:40.50147895 +0000 UTC m=+2601.837276895" watchObservedRunningTime="2026-08-05 17:04:40.50307198 +0000 UTC m=+2601.838869923"
Aug 05 17:04:40.523402 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:40.523363    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb" podStartSLOduration=1.9359971809999998 podStartE2EDuration="2.523337278s" totalImagesPullingTime="587.340097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:04:40.521364594 +0000 UTC m=+2601.857162539" watchObservedRunningTime="2026-08-05 17:04:40.523337278 +0000 UTC m=+2601.859135221"
Aug 05 17:04:46.477359 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:46.477262    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:04:51.474553 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:51.474521    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:04:51.475067 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:04:51.474797    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:05:07.722118 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.722085    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"]
Aug 05 17:05:07.724906 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.724887    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.728136 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.728115    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-034ebc-serving-cert\""
Aug 05 17:05:07.742531 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.742507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"]
Aug 05 17:05:07.763711 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.763684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a640e9c-62f4-43c2-ae9b-113119b6109f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.763826 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.763718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsmww\" (UniqueName: \"kubernetes.io/projected/3a640e9c-62f4-43c2-ae9b-113119b6109f-kube-api-access-rsmww\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.763917 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.763891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a640e9c-62f4-43c2-ae9b-113119b6109f-maas-api-tls\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.864909 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.864874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a640e9c-62f4-43c2-ae9b-113119b6109f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.864909 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.864909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsmww\" (UniqueName: \"kubernetes.io/projected/3a640e9c-62f4-43c2-ae9b-113119b6109f-kube-api-access-rsmww\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.865168 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.864995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a640e9c-62f4-43c2-ae9b-113119b6109f-maas-api-tls\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.865654 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.865627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a640e9c-62f4-43c2-ae9b-113119b6109f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.867408 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.867390    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a640e9c-62f4-43c2-ae9b-113119b6109f-maas-api-tls\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:07.876516 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:07.876489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsmww\" (UniqueName: \"kubernetes.io/projected/3a640e9c-62f4-43c2-ae9b-113119b6109f-kube-api-access-rsmww\") pod \"maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:08.036470 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.036388    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:08.174282 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.174251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"]
Aug 05 17:05:08.175328 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:05:08.175303    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a640e9c_62f4_43c2_ae9b_113119b6109f.slice/crio-693040617e611fbe6e6a550948ff2a4bc7c18f82f61146d905575c79e3005bce WatchSource:0}: Error finding container 693040617e611fbe6e6a550948ff2a4bc7c18f82f61146d905575c79e3005bce: Status 404 returned error can't find the container with id 693040617e611fbe6e6a550948ff2a4bc7c18f82f61146d905575c79e3005bce
Aug 05 17:05:08.609576 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.609547    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v" event={"ID":"3a640e9c-62f4-43c2-ae9b-113119b6109f","Type":"ContainerStarted","Data":"317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400"}
Aug 05 17:05:08.609704 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.609607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v" event={"ID":"3a640e9c-62f4-43c2-ae9b-113119b6109f","Type":"ContainerStarted","Data":"693040617e611fbe6e6a550948ff2a4bc7c18f82f61146d905575c79e3005bce"}
Aug 05 17:05:08.609704 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.609637    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:08.682286 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.682230    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v" podStartSLOduration=1.332966688 podStartE2EDuration="1.682214841s" totalImagesPullingTime="349.248153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:05:08.674468886 +0000 UTC m=+2630.010266832" watchObservedRunningTime="2026-08-05 17:05:08.682214841 +0000 UTC m=+2630.018012785"
Aug 05 17:05:08.684661 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.684638    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"]
Aug 05 17:05:08.687588 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.687570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:08.692074 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.692048    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-034ebc-dockercfg-wr2xf\""
Aug 05 17:05:08.692074 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.692070    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-034ebc\""
Aug 05 17:05:08.722714 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.722688    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"]
Aug 05 17:05:08.774086 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.774053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzn5\" (UniqueName: \"kubernetes.io/projected/de96694b-dff6-45d3-b2ca-fedee4021edb-kube-api-access-tfzn5\") pod \"payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2\" (UID: \"de96694b-dff6-45d3-b2ca-fedee4021edb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:08.774254 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.774195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de96694b-dff6-45d3-b2ca-fedee4021edb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2\" (UID: \"de96694b-dff6-45d3-b2ca-fedee4021edb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:08.875321 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.875243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de96694b-dff6-45d3-b2ca-fedee4021edb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2\" (UID: \"de96694b-dff6-45d3-b2ca-fedee4021edb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:08.875478 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.875416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzn5\" (UniqueName: \"kubernetes.io/projected/de96694b-dff6-45d3-b2ca-fedee4021edb-kube-api-access-tfzn5\") pod \"payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2\" (UID: \"de96694b-dff6-45d3-b2ca-fedee4021edb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:08.876072 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.876053    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de96694b-dff6-45d3-b2ca-fedee4021edb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2\" (UID: \"de96694b-dff6-45d3-b2ca-fedee4021edb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:08.886865 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.886843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzn5\" (UniqueName: \"kubernetes.io/projected/de96694b-dff6-45d3-b2ca-fedee4021edb-kube-api-access-tfzn5\") pod \"payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2\" (UID: \"de96694b-dff6-45d3-b2ca-fedee4021edb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:08.997723 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:08.997690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:09.131174 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:09.131148    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"]
Aug 05 17:05:09.132787 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:05:09.132760    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde96694b_dff6_45d3_b2ca_fedee4021edb.slice/crio-fe35ecc29927cec4639f7bf4997cafc667cc19ce2a2427f959aa0e237032f526 WatchSource:0}: Error finding container fe35ecc29927cec4639f7bf4997cafc667cc19ce2a2427f959aa0e237032f526: Status 404 returned error can't find the container with id fe35ecc29927cec4639f7bf4997cafc667cc19ce2a2427f959aa0e237032f526
Aug 05 17:05:09.615708 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:09.615665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2" event={"ID":"de96694b-dff6-45d3-b2ca-fedee4021edb","Type":"ContainerStarted","Data":"58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268"}
Aug 05 17:05:09.615907 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:09.615732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2" event={"ID":"de96694b-dff6-45d3-b2ca-fedee4021edb","Type":"ContainerStarted","Data":"fe35ecc29927cec4639f7bf4997cafc667cc19ce2a2427f959aa0e237032f526"}
Aug 05 17:05:09.615907 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:09.615845    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:05:09.642465 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:09.642419    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2" podStartSLOduration=1.642407329 podStartE2EDuration="1.642407329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:05:09.64111153 +0000 UTC m=+2630.976909474" watchObservedRunningTime="2026-08-05 17:05:09.642407329 +0000 UTC m=+2630.978205272"
Aug 05 17:05:14.622526 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:14.622494    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:05:20.624863 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:05:20.624833    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:06:19.340746 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:06:19.340673    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:06:19.347630 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:06:19.347607    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:07:02.831512 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:02.831470    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"]
Aug 05 17:07:02.832450 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:02.831740    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb" podUID="20166ffb-cc41-4049-a365-428d89ed687b" containerName="maas-api" containerID="cri-o://1fb5ed8481c180749c5c446cbb310c1d3b0ba785432ca2e1418b9937fe440d3d" gracePeriod=30
Aug 05 17:07:02.920967 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:02.920932    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"]
Aug 05 17:07:02.921219 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:02.921194    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4" podUID="9de1673b-9f33-45f3-80ed-79f02f076b8a" containerName="payload-processing" containerID="cri-o://8d92e1229b99898cc752287a7a113afba50342ef3c9a0917f135979eb4577271" gracePeriod=30
Aug 05 17:07:02.929533 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:02.929495    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"]
Aug 05 17:07:02.929743 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:02.929721    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf" podUID="ca33d453-c111-4040-9b6e-18ff3b50612e" containerName="payload-pre-processing" containerID="cri-o://6444f96fa11fafcfb491bbd0e95fc6ec3b28ec29de7cd59c4d45852b9906b13d" gracePeriod=30
Aug 05 17:07:03.173947 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.173894    2579 generic.go:356] "Generic (PLEG): container finished" podID="9de1673b-9f33-45f3-80ed-79f02f076b8a" containerID="8d92e1229b99898cc752287a7a113afba50342ef3c9a0917f135979eb4577271" exitCode=0
Aug 05 17:07:03.174080 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.173984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4" event={"ID":"9de1673b-9f33-45f3-80ed-79f02f076b8a","Type":"ContainerDied","Data":"8d92e1229b99898cc752287a7a113afba50342ef3c9a0917f135979eb4577271"}
Aug 05 17:07:03.176635 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.176612    2579 generic.go:356] "Generic (PLEG): container finished" podID="20166ffb-cc41-4049-a365-428d89ed687b" containerID="1fb5ed8481c180749c5c446cbb310c1d3b0ba785432ca2e1418b9937fe440d3d" exitCode=0
Aug 05 17:07:03.176764 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.176683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb" event={"ID":"20166ffb-cc41-4049-a365-428d89ed687b","Type":"ContainerDied","Data":"1fb5ed8481c180749c5c446cbb310c1d3b0ba785432ca2e1418b9937fe440d3d"}
Aug 05 17:07:03.176764 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.176734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb" event={"ID":"20166ffb-cc41-4049-a365-428d89ed687b","Type":"ContainerDied","Data":"129688f4e8868e13d1c4e28225fbe8d84d4a493f84a3463b45ec42c60310c320"}
Aug 05 17:07:03.176764 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.176759    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="129688f4e8868e13d1c4e28225fbe8d84d4a493f84a3463b45ec42c60310c320"
Aug 05 17:07:03.178445 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.178426    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca33d453-c111-4040-9b6e-18ff3b50612e" containerID="6444f96fa11fafcfb491bbd0e95fc6ec3b28ec29de7cd59c4d45852b9906b13d" exitCode=0
Aug 05 17:07:03.178545 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.178465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf" event={"ID":"ca33d453-c111-4040-9b6e-18ff3b50612e","Type":"ContainerDied","Data":"6444f96fa11fafcfb491bbd0e95fc6ec3b28ec29de7cd59c4d45852b9906b13d"}
Aug 05 17:07:03.186761 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.186734    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:07:03.244088 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.244062    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:07:03.247293 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.247274    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:07:03.247510 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.247494    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls\") pod \"20166ffb-cc41-4049-a365-428d89ed687b\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") "
Aug 05 17:07:03.247608 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.247594    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20166ffb-cc41-4049-a365-428d89ed687b-openshift-service-ca\") pod \"20166ffb-cc41-4049-a365-428d89ed687b\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") "
Aug 05 17:07:03.247656 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.247630    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l45nj\" (UniqueName: \"kubernetes.io/projected/20166ffb-cc41-4049-a365-428d89ed687b-kube-api-access-l45nj\") pod \"20166ffb-cc41-4049-a365-428d89ed687b\" (UID: \"20166ffb-cc41-4049-a365-428d89ed687b\") "
Aug 05 17:07:03.247990 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.247961    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20166ffb-cc41-4049-a365-428d89ed687b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20166ffb-cc41-4049-a365-428d89ed687b" (UID: "20166ffb-cc41-4049-a365-428d89ed687b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:03.249601 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.249578    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20166ffb-cc41-4049-a365-428d89ed687b" (UID: "20166ffb-cc41-4049-a365-428d89ed687b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:07:03.249844 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.249823    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20166ffb-cc41-4049-a365-428d89ed687b-kube-api-access-l45nj" (OuterVolumeSpecName: "kube-api-access-l45nj") pod "20166ffb-cc41-4049-a365-428d89ed687b" (UID: "20166ffb-cc41-4049-a365-428d89ed687b"). InnerVolumeSpecName "kube-api-access-l45nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:03.348403 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348289    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca33d453-c111-4040-9b6e-18ff3b50612e-plugins-config-volume\") pod \"ca33d453-c111-4040-9b6e-18ff3b50612e\" (UID: \"ca33d453-c111-4040-9b6e-18ff3b50612e\") "
Aug 05 17:07:03.348403 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348326    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl45n\" (UniqueName: \"kubernetes.io/projected/9de1673b-9f33-45f3-80ed-79f02f076b8a-kube-api-access-nl45n\") pod \"9de1673b-9f33-45f3-80ed-79f02f076b8a\" (UID: \"9de1673b-9f33-45f3-80ed-79f02f076b8a\") "
Aug 05 17:07:03.348642 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7phj\" (UniqueName: \"kubernetes.io/projected/ca33d453-c111-4040-9b6e-18ff3b50612e-kube-api-access-n7phj\") pod \"ca33d453-c111-4040-9b6e-18ff3b50612e\" (UID: \"ca33d453-c111-4040-9b6e-18ff3b50612e\") "
Aug 05 17:07:03.348642 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9de1673b-9f33-45f3-80ed-79f02f076b8a-plugins-config-volume\") pod \"9de1673b-9f33-45f3-80ed-79f02f076b8a\" (UID: \"9de1673b-9f33-45f3-80ed-79f02f076b8a\") "
Aug 05 17:07:03.348751 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348712    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20166ffb-cc41-4049-a365-428d89ed687b-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:03.348751 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348736    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l45nj\" (UniqueName: \"kubernetes.io/projected/20166ffb-cc41-4049-a365-428d89ed687b-kube-api-access-l45nj\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:03.348751 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348749    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20166ffb-cc41-4049-a365-428d89ed687b-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:03.348908 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348745    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca33d453-c111-4040-9b6e-18ff3b50612e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca33d453-c111-4040-9b6e-18ff3b50612e" (UID: "ca33d453-c111-4040-9b6e-18ff3b50612e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:03.348908 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.348888    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9de1673b-9f33-45f3-80ed-79f02f076b8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9de1673b-9f33-45f3-80ed-79f02f076b8a" (UID: "9de1673b-9f33-45f3-80ed-79f02f076b8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:03.350450 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.350427    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca33d453-c111-4040-9b6e-18ff3b50612e-kube-api-access-n7phj" (OuterVolumeSpecName: "kube-api-access-n7phj") pod "ca33d453-c111-4040-9b6e-18ff3b50612e" (UID: "ca33d453-c111-4040-9b6e-18ff3b50612e"). InnerVolumeSpecName "kube-api-access-n7phj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:03.350512 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.350475    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9de1673b-9f33-45f3-80ed-79f02f076b8a-kube-api-access-nl45n" (OuterVolumeSpecName: "kube-api-access-nl45n") pod "9de1673b-9f33-45f3-80ed-79f02f076b8a" (UID: "9de1673b-9f33-45f3-80ed-79f02f076b8a"). InnerVolumeSpecName "kube-api-access-nl45n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:03.449768 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.449729    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7phj\" (UniqueName: \"kubernetes.io/projected/ca33d453-c111-4040-9b6e-18ff3b50612e-kube-api-access-n7phj\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:03.449768 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.449761    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9de1673b-9f33-45f3-80ed-79f02f076b8a-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:03.449768 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.449770    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca33d453-c111-4040-9b6e-18ff3b50612e-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:03.449768 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:03.449780    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl45n\" (UniqueName: \"kubernetes.io/projected/9de1673b-9f33-45f3-80ed-79f02f076b8a-kube-api-access-nl45n\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:04.184936 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.184909    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"
Aug 05 17:07:04.185391 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.184957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4" event={"ID":"9de1673b-9f33-45f3-80ed-79f02f076b8a","Type":"ContainerDied","Data":"5f1d9a4cb850b20beb0b13f9784d20cbe7968da80779b81fb77e73c847f7eba4"}
Aug 05 17:07:04.185391 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.185019    2579 scope.go:117] "RemoveContainer" containerID="8d92e1229b99898cc752287a7a113afba50342ef3c9a0917f135979eb4577271"
Aug 05 17:07:04.186380 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.186363    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"
Aug 05 17:07:04.186475 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.186382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf" event={"ID":"ca33d453-c111-4040-9b6e-18ff3b50612e","Type":"ContainerDied","Data":"70e967a23482de37b1de681c08cbf43947a74e956621937d96acc2b8e9f8e116"}
Aug 05 17:07:04.186548 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.186535    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"
Aug 05 17:07:04.195814 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.195786    2579 scope.go:117] "RemoveContainer" containerID="6444f96fa11fafcfb491bbd0e95fc6ec3b28ec29de7cd59c4d45852b9906b13d"
Aug 05 17:07:04.213444 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.213426    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"]
Aug 05 17:07:04.222194 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.222173    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4"]
Aug 05 17:07:04.241335 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.241310    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"]
Aug 05 17:07:04.243879 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.243862    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf"]
Aug 05 17:07:04.259618 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.259595    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"]
Aug 05 17:07:04.263058 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:04.263038    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-09f3f8-6c65dfdb88-rpqrb"]
Aug 05 17:07:05.192296 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:05.192262    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20166ffb-cc41-4049-a365-428d89ed687b" path="/var/lib/kubelet/pods/20166ffb-cc41-4049-a365-428d89ed687b/volumes"
Aug 05 17:07:05.192698 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:05.192665    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9de1673b-9f33-45f3-80ed-79f02f076b8a" path="/var/lib/kubelet/pods/9de1673b-9f33-45f3-80ed-79f02f076b8a/volumes"
Aug 05 17:07:05.192980 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:05.192967    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca33d453-c111-4040-9b6e-18ff3b50612e" path="/var/lib/kubelet/pods/ca33d453-c111-4040-9b6e-18ff3b50612e/volumes"
Aug 05 17:07:15.641271 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:15.641235    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"]
Aug 05 17:07:15.641715 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:15.641547    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v" podUID="3a640e9c-62f4-43c2-ae9b-113119b6109f" containerName="maas-api" containerID="cri-o://317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400" gracePeriod=30
Aug 05 17:07:15.715518 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:15.715483    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"]
Aug 05 17:07:15.715824 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:15.715773    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2" podUID="de96694b-dff6-45d3-b2ca-fedee4021edb" containerName="payload-pre-processing" containerID="cri-o://58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268" gracePeriod=30
Aug 05 17:07:15.961121 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:15.961094    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:07:15.994007 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:15.993981    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:07:16.063482 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.063452    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de96694b-dff6-45d3-b2ca-fedee4021edb-plugins-config-volume\") pod \"de96694b-dff6-45d3-b2ca-fedee4021edb\" (UID: \"de96694b-dff6-45d3-b2ca-fedee4021edb\") "
Aug 05 17:07:16.063662 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.063508    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsmww\" (UniqueName: \"kubernetes.io/projected/3a640e9c-62f4-43c2-ae9b-113119b6109f-kube-api-access-rsmww\") pod \"3a640e9c-62f4-43c2-ae9b-113119b6109f\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") "
Aug 05 17:07:16.063662 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.063557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a640e9c-62f4-43c2-ae9b-113119b6109f-maas-api-tls\") pod \"3a640e9c-62f4-43c2-ae9b-113119b6109f\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") "
Aug 05 17:07:16.063662 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.063636    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a640e9c-62f4-43c2-ae9b-113119b6109f-openshift-service-ca\") pod \"3a640e9c-62f4-43c2-ae9b-113119b6109f\" (UID: \"3a640e9c-62f4-43c2-ae9b-113119b6109f\") "
Aug 05 17:07:16.063662 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.063660    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfzn5\" (UniqueName: \"kubernetes.io/projected/de96694b-dff6-45d3-b2ca-fedee4021edb-kube-api-access-tfzn5\") pod \"de96694b-dff6-45d3-b2ca-fedee4021edb\" (UID: \"de96694b-dff6-45d3-b2ca-fedee4021edb\") "
Aug 05 17:07:16.063931 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.063908    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de96694b-dff6-45d3-b2ca-fedee4021edb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de96694b-dff6-45d3-b2ca-fedee4021edb" (UID: "de96694b-dff6-45d3-b2ca-fedee4021edb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:16.063989 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.063954    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a640e9c-62f4-43c2-ae9b-113119b6109f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a640e9c-62f4-43c2-ae9b-113119b6109f" (UID: "3a640e9c-62f4-43c2-ae9b-113119b6109f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:16.065762 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.065738    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a640e9c-62f4-43c2-ae9b-113119b6109f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a640e9c-62f4-43c2-ae9b-113119b6109f" (UID: "3a640e9c-62f4-43c2-ae9b-113119b6109f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:07:16.065855 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.065772    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de96694b-dff6-45d3-b2ca-fedee4021edb-kube-api-access-tfzn5" (OuterVolumeSpecName: "kube-api-access-tfzn5") pod "de96694b-dff6-45d3-b2ca-fedee4021edb" (UID: "de96694b-dff6-45d3-b2ca-fedee4021edb"). InnerVolumeSpecName "kube-api-access-tfzn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:16.065855 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.065777    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a640e9c-62f4-43c2-ae9b-113119b6109f-kube-api-access-rsmww" (OuterVolumeSpecName: "kube-api-access-rsmww") pod "3a640e9c-62f4-43c2-ae9b-113119b6109f" (UID: "3a640e9c-62f4-43c2-ae9b-113119b6109f"). InnerVolumeSpecName "kube-api-access-rsmww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:16.165049 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.165016    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a640e9c-62f4-43c2-ae9b-113119b6109f-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:16.165049 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.165042    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfzn5\" (UniqueName: \"kubernetes.io/projected/de96694b-dff6-45d3-b2ca-fedee4021edb-kube-api-access-tfzn5\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:16.165049 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.165052    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de96694b-dff6-45d3-b2ca-fedee4021edb-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:16.165293 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.165061    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsmww\" (UniqueName: \"kubernetes.io/projected/3a640e9c-62f4-43c2-ae9b-113119b6109f-kube-api-access-rsmww\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:16.165293 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.165070    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a640e9c-62f4-43c2-ae9b-113119b6109f-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:07:16.253585 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.253498    2579 generic.go:356] "Generic (PLEG): container finished" podID="de96694b-dff6-45d3-b2ca-fedee4021edb" containerID="58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268" exitCode=0
Aug 05 17:07:16.253585 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.253542    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"
Aug 05 17:07:16.253803 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.253580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2" event={"ID":"de96694b-dff6-45d3-b2ca-fedee4021edb","Type":"ContainerDied","Data":"58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268"}
Aug 05 17:07:16.253803 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.253633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2" event={"ID":"de96694b-dff6-45d3-b2ca-fedee4021edb","Type":"ContainerDied","Data":"fe35ecc29927cec4639f7bf4997cafc667cc19ce2a2427f959aa0e237032f526"}
Aug 05 17:07:16.253803 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.253661    2579 scope.go:117] "RemoveContainer" containerID="58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268"
Aug 05 17:07:16.254933 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.254908    2579 generic.go:356] "Generic (PLEG): container finished" podID="3a640e9c-62f4-43c2-ae9b-113119b6109f" containerID="317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400" exitCode=0
Aug 05 17:07:16.255035 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.254946    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"
Aug 05 17:07:16.255035 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.254958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v" event={"ID":"3a640e9c-62f4-43c2-ae9b-113119b6109f","Type":"ContainerDied","Data":"317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400"}
Aug 05 17:07:16.255035 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.254998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v" event={"ID":"3a640e9c-62f4-43c2-ae9b-113119b6109f","Type":"ContainerDied","Data":"693040617e611fbe6e6a550948ff2a4bc7c18f82f61146d905575c79e3005bce"}
Aug 05 17:07:16.262618 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.262603    2579 scope.go:117] "RemoveContainer" containerID="58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268"
Aug 05 17:07:16.262869 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:07:16.262850    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268\": container with ID starting with 58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268 not found: ID does not exist" containerID="58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268"
Aug 05 17:07:16.262966 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.262878    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268"} err="failed to get container status \"58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268\": rpc error: code = NotFound desc = could not find container \"58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268\": container with ID starting with 58b9bbc2dcf2b71e2a779ce3748059a4e670d8c530daf08e234a68ba4abff268 not found: ID does not exist"
Aug 05 17:07:16.262966 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.262899    2579 scope.go:117] "RemoveContainer" containerID="317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400"
Aug 05 17:07:16.270590 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.270575    2579 scope.go:117] "RemoveContainer" containerID="317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400"
Aug 05 17:07:16.270817 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:07:16.270798    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400\": container with ID starting with 317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400 not found: ID does not exist" containerID="317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400"
Aug 05 17:07:16.270890 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.270820    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400"} err="failed to get container status \"317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400\": rpc error: code = NotFound desc = could not find container \"317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400\": container with ID starting with 317f2c65d75ff36b0f1203ac5e499e11d7d4bfc835a9c2b7c6ce218d63b4c400 not found: ID does not exist"
Aug 05 17:07:16.281506 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.281485    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"]
Aug 05 17:07:16.288364 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.288318    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-034ebc-5d685ccd8-p5z5v"]
Aug 05 17:07:16.314520 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.314500    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"]
Aug 05 17:07:16.321002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:16.320971    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2"]
Aug 05 17:07:17.188407 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:17.188372    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a640e9c-62f4-43c2-ae9b-113119b6109f" path="/var/lib/kubelet/pods/3a640e9c-62f4-43c2-ae9b-113119b6109f/volumes"
Aug 05 17:07:17.188763 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:17.188741    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de96694b-dff6-45d3-b2ca-fedee4021edb" path="/var/lib/kubelet/pods/de96694b-dff6-45d3-b2ca-fedee4021edb/volumes"
Aug 05 17:07:27.275190 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275150    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"]
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275558    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20166ffb-cc41-4049-a365-428d89ed687b" containerName="maas-api"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275570    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="20166ffb-cc41-4049-a365-428d89ed687b" containerName="maas-api"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275582    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de96694b-dff6-45d3-b2ca-fedee4021edb" containerName="payload-pre-processing"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275587    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="de96694b-dff6-45d3-b2ca-fedee4021edb" containerName="payload-pre-processing"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275596    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca33d453-c111-4040-9b6e-18ff3b50612e" containerName="payload-pre-processing"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275601    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca33d453-c111-4040-9b6e-18ff3b50612e" containerName="payload-pre-processing"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275607    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a640e9c-62f4-43c2-ae9b-113119b6109f" containerName="maas-api"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275612    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a640e9c-62f4-43c2-ae9b-113119b6109f" containerName="maas-api"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275649    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9de1673b-9f33-45f3-80ed-79f02f076b8a" containerName="payload-processing"
Aug 05 17:07:27.275672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275659    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9de1673b-9f33-45f3-80ed-79f02f076b8a" containerName="payload-processing"
Aug 05 17:07:27.276134 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275723    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca33d453-c111-4040-9b6e-18ff3b50612e" containerName="payload-pre-processing"
Aug 05 17:07:27.276134 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275732    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="de96694b-dff6-45d3-b2ca-fedee4021edb" containerName="payload-pre-processing"
Aug 05 17:07:27.276134 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275740    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9de1673b-9f33-45f3-80ed-79f02f076b8a" containerName="payload-processing"
Aug 05 17:07:27.276134 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275747    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a640e9c-62f4-43c2-ae9b-113119b6109f" containerName="maas-api"
Aug 05 17:07:27.276134 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.275753    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="20166ffb-cc41-4049-a365-428d89ed687b" containerName="maas-api"
Aug 05 17:07:27.281263 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.281240    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.284005 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.283979    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-64d8dc-serving-cert\""
Aug 05 17:07:27.288629 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.288605    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"]
Aug 05 17:07:27.380622 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.380585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgp5z\" (UniqueName: \"kubernetes.io/projected/6c56170f-222f-42ca-9b01-0832b7fb636e-kube-api-access-lgp5z\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.380795 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.380702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.380795 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.380764    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c56170f-222f-42ca-9b01-0832b7fb636e-openshift-service-ca\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.481390 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.481326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c56170f-222f-42ca-9b01-0832b7fb636e-openshift-service-ca\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.481390 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.481395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgp5z\" (UniqueName: \"kubernetes.io/projected/6c56170f-222f-42ca-9b01-0832b7fb636e-kube-api-access-lgp5z\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.481602 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.481468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.481602 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:07:27.481561    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-serving-cert: secret "maas-api-e2e-api-a-64d8dc-serving-cert" not found
Aug 05 17:07:27.481687 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:07:27.481623    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls podName:6c56170f-222f-42ca-9b01-0832b7fb636e nodeName:}" failed. No retries permitted until 2026-08-05 17:07:27.981605601 +0000 UTC m=+2769.317403522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls") pod "maas-api-e2e-api-a-64d8dc-9956c8f96-brld2" (UID: "6c56170f-222f-42ca-9b01-0832b7fb636e") : secret "maas-api-e2e-api-a-64d8dc-serving-cert" not found
Aug 05 17:07:27.482024 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.482003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c56170f-222f-42ca-9b01-0832b7fb636e-openshift-service-ca\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.492935 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.492906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgp5z\" (UniqueName: \"kubernetes.io/projected/6c56170f-222f-42ca-9b01-0832b7fb636e-kube-api-access-lgp5z\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.987558 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.987531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:27.989892 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:27.989865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls\") pod \"maas-api-e2e-api-a-64d8dc-9956c8f96-brld2\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:28.049664 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.049631    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"]
Aug 05 17:07:28.053136 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.053116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:28.056220 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.056200    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-64d8dc-dockercfg-2t855\""
Aug 05 17:07:28.056452 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.056438    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-64d8dc\""
Aug 05 17:07:28.064598 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.064574    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"]
Aug 05 17:07:28.096985 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.096959    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"]
Aug 05 17:07:28.100336 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.100322    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:28.109593 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.109570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"]
Aug 05 17:07:28.189707 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.189672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da623ea3-ce97-4550-8410-c9d141b79737-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q\" (UID: \"da623ea3-ce97-4550-8410-c9d141b79737\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:28.189887 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.189730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/242f0131-4d92-4924-91eb-4809f548937e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp\" (UID: \"242f0131-4d92-4924-91eb-4809f548937e\") " pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:28.189887 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.189835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct7zr\" (UniqueName: \"kubernetes.io/projected/242f0131-4d92-4924-91eb-4809f548937e-kube-api-access-ct7zr\") pod \"payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp\" (UID: \"242f0131-4d92-4924-91eb-4809f548937e\") " pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:28.190051 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.189961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd9bd\" (UniqueName: \"kubernetes.io/projected/da623ea3-ce97-4550-8410-c9d141b79737-kube-api-access-pd9bd\") pod \"payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q\" (UID: \"da623ea3-ce97-4550-8410-c9d141b79737\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:28.193493 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.193464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:28.291099 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.290927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da623ea3-ce97-4550-8410-c9d141b79737-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q\" (UID: \"da623ea3-ce97-4550-8410-c9d141b79737\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:28.291099 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.290986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/242f0131-4d92-4924-91eb-4809f548937e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp\" (UID: \"242f0131-4d92-4924-91eb-4809f548937e\") " pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:28.291099 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.291053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct7zr\" (UniqueName: \"kubernetes.io/projected/242f0131-4d92-4924-91eb-4809f548937e-kube-api-access-ct7zr\") pod \"payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp\" (UID: \"242f0131-4d92-4924-91eb-4809f548937e\") " pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:28.291635 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.291120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd9bd\" (UniqueName: \"kubernetes.io/projected/da623ea3-ce97-4550-8410-c9d141b79737-kube-api-access-pd9bd\") pod \"payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q\" (UID: \"da623ea3-ce97-4550-8410-c9d141b79737\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:28.292761 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.292736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da623ea3-ce97-4550-8410-c9d141b79737-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q\" (UID: \"da623ea3-ce97-4550-8410-c9d141b79737\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:28.293053 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.293031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/242f0131-4d92-4924-91eb-4809f548937e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp\" (UID: \"242f0131-4d92-4924-91eb-4809f548937e\") " pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:28.301730 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.301510    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct7zr\" (UniqueName: \"kubernetes.io/projected/242f0131-4d92-4924-91eb-4809f548937e-kube-api-access-ct7zr\") pod \"payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp\" (UID: \"242f0131-4d92-4924-91eb-4809f548937e\") " pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:28.301730 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.301690    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd9bd\" (UniqueName: \"kubernetes.io/projected/da623ea3-ce97-4550-8410-c9d141b79737-kube-api-access-pd9bd\") pod \"payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q\" (UID: \"da623ea3-ce97-4550-8410-c9d141b79737\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:28.335280 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.335248    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"]
Aug 05 17:07:28.337194 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:07:28.337169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c56170f_222f_42ca_9b01_0832b7fb636e.slice/crio-a8e976e02843975c07982246c180d91c85054882ac1dfff83b7c2ba5d43eb15d WatchSource:0}: Error finding container a8e976e02843975c07982246c180d91c85054882ac1dfff83b7c2ba5d43eb15d: Status 404 returned error can't find the container with id a8e976e02843975c07982246c180d91c85054882ac1dfff83b7c2ba5d43eb15d
Aug 05 17:07:28.338499 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.338482    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:07:28.364806 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.364780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:28.410447 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.410421    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:28.566012 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.565983    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"]
Aug 05 17:07:28.568366 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:07:28.568305    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda623ea3_ce97_4550_8410_c9d141b79737.slice/crio-dba6bdecba7131439f6610cf72a1f87ce9d60fe4e5ee9d2f1eb55a7610210bb5 WatchSource:0}: Error finding container dba6bdecba7131439f6610cf72a1f87ce9d60fe4e5ee9d2f1eb55a7610210bb5: Status 404 returned error can't find the container with id dba6bdecba7131439f6610cf72a1f87ce9d60fe4e5ee9d2f1eb55a7610210bb5
Aug 05 17:07:28.716264 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:28.716233    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"]
Aug 05 17:07:28.719534 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:07:28.719502    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242f0131_4d92_4924_91eb_4809f548937e.slice/crio-ad18c1e86b19d0c6581126da671d3f470bd9aa0a16cb717fbf2e2f8845b9020e WatchSource:0}: Error finding container ad18c1e86b19d0c6581126da671d3f470bd9aa0a16cb717fbf2e2f8845b9020e: Status 404 returned error can't find the container with id ad18c1e86b19d0c6581126da671d3f470bd9aa0a16cb717fbf2e2f8845b9020e
Aug 05 17:07:29.322746 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.322707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2" event={"ID":"6c56170f-222f-42ca-9b01-0832b7fb636e","Type":"ContainerStarted","Data":"5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203"}
Aug 05 17:07:29.323286 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.323259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2" event={"ID":"6c56170f-222f-42ca-9b01-0832b7fb636e","Type":"ContainerStarted","Data":"a8e976e02843975c07982246c180d91c85054882ac1dfff83b7c2ba5d43eb15d"}
Aug 05 17:07:29.323427 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.323302    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:29.325095 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.325058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q" event={"ID":"da623ea3-ce97-4550-8410-c9d141b79737","Type":"ContainerStarted","Data":"f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b"}
Aug 05 17:07:29.325201 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.325109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q" event={"ID":"da623ea3-ce97-4550-8410-c9d141b79737","Type":"ContainerStarted","Data":"dba6bdecba7131439f6610cf72a1f87ce9d60fe4e5ee9d2f1eb55a7610210bb5"}
Aug 05 17:07:29.325201 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.325139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:29.326806 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.326784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp" event={"ID":"242f0131-4d92-4924-91eb-4809f548937e","Type":"ContainerStarted","Data":"c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601"}
Aug 05 17:07:29.326921 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.326826    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp" event={"ID":"242f0131-4d92-4924-91eb-4809f548937e","Type":"ContainerStarted","Data":"ad18c1e86b19d0c6581126da671d3f470bd9aa0a16cb717fbf2e2f8845b9020e"}
Aug 05 17:07:29.326921 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.326864    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:29.344070 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.344023    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2" podStartSLOduration=1.90495218 podStartE2EDuration="2.343998947s" totalImagesPullingTime="439.046767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:07:29.343095893 +0000 UTC m=+2770.678893838" watchObservedRunningTime="2026-08-05 17:07:29.343998947 +0000 UTC m=+2770.679796896"
Aug 05 17:07:29.386624 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.386578    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q" podStartSLOduration=1.386565774 podStartE2EDuration="1.386565774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:07:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:07:29.384909373 +0000 UTC m=+2770.720707316" watchObservedRunningTime="2026-08-05 17:07:29.386565774 +0000 UTC m=+2770.722363696"
Aug 05 17:07:29.424800 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:29.424751    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp" podStartSLOduration=1.424737555 podStartE2EDuration="1.424737555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:07:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:07:29.423284575 +0000 UTC m=+2770.759082521" watchObservedRunningTime="2026-08-05 17:07:29.424737555 +0000 UTC m=+2770.760535536"
Aug 05 17:07:35.339441 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:35.339411    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:07:40.335524 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:40.335490    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:07:40.335921 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:40.335713    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:07:56.351680 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.351639    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"]
Aug 05 17:07:56.356636 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.356615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.360517 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.360494    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f2130f-serving-cert\""
Aug 05 17:07:56.367164 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.367143    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"]
Aug 05 17:07:56.456824 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.456790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-openshift-service-ca\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.456824 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.456832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq7ck\" (UniqueName: \"kubernetes.io/projected/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-kube-api-access-dq7ck\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.457065 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.456931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-maas-api-tls\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.558219 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.558185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-maas-api-tls\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.558439 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.558300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-openshift-service-ca\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.558439 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.558336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq7ck\" (UniqueName: \"kubernetes.io/projected/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-kube-api-access-dq7ck\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.559103 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.559079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-openshift-service-ca\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.560952 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.560930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-maas-api-tls\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.566641 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.566624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq7ck\" (UniqueName: \"kubernetes.io/projected/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-kube-api-access-dq7ck\") pod \"maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.669478 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.669449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:56.812276 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:56.812247    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"]
Aug 05 17:07:56.814926 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:07:56.814893    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2e58fe_79db_4603_a6ec_e3a5b47ddb3c.slice/crio-4a16ff6a7c37c4b5e8a92a51e7e6ce525579dd6e95a88efaa7bcc77be47a7b33 WatchSource:0}: Error finding container 4a16ff6a7c37c4b5e8a92a51e7e6ce525579dd6e95a88efaa7bcc77be47a7b33: Status 404 returned error can't find the container with id 4a16ff6a7c37c4b5e8a92a51e7e6ce525579dd6e95a88efaa7bcc77be47a7b33
Aug 05 17:07:57.080723 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.080632    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"]
Aug 05 17:07:57.085499 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.085475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:57.088490 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.088458    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-f2130f-dockercfg-s8sqv\""
Aug 05 17:07:57.088490 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.088480    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-f2130f\""
Aug 05 17:07:57.094956 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.094930    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"]
Aug 05 17:07:57.165165 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.165113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c7c6163-59f0-4530-930e-ee772d566fc0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc\" (UID: \"4c7c6163-59f0-4530-930e-ee772d566fc0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:57.165339 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.165227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52qrg\" (UniqueName: \"kubernetes.io/projected/4c7c6163-59f0-4530-930e-ee772d566fc0-kube-api-access-52qrg\") pod \"payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc\" (UID: \"4c7c6163-59f0-4530-930e-ee772d566fc0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:57.266199 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.266159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52qrg\" (UniqueName: \"kubernetes.io/projected/4c7c6163-59f0-4530-930e-ee772d566fc0-kube-api-access-52qrg\") pod \"payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc\" (UID: \"4c7c6163-59f0-4530-930e-ee772d566fc0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:57.266436 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.266318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c7c6163-59f0-4530-930e-ee772d566fc0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc\" (UID: \"4c7c6163-59f0-4530-930e-ee772d566fc0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:57.267013 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.266988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c7c6163-59f0-4530-930e-ee772d566fc0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc\" (UID: \"4c7c6163-59f0-4530-930e-ee772d566fc0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:57.274894 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.274873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52qrg\" (UniqueName: \"kubernetes.io/projected/4c7c6163-59f0-4530-930e-ee772d566fc0-kube-api-access-52qrg\") pod \"payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc\" (UID: \"4c7c6163-59f0-4530-930e-ee772d566fc0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:57.397183 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.397086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:57.474648 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.474613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv" event={"ID":"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c","Type":"ContainerStarted","Data":"4a16ff6a7c37c4b5e8a92a51e7e6ce525579dd6e95a88efaa7bcc77be47a7b33"}
Aug 05 17:07:57.546981 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:57.546950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"]
Aug 05 17:07:57.548771 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:07:57.548747    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7c6163_59f0_4530_930e_ee772d566fc0.slice/crio-1524eae72d9c0f42325241e47f850db16203e257380214749c255fac7513c6a4 WatchSource:0}: Error finding container 1524eae72d9c0f42325241e47f850db16203e257380214749c255fac7513c6a4: Status 404 returned error can't find the container with id 1524eae72d9c0f42325241e47f850db16203e257380214749c255fac7513c6a4
Aug 05 17:07:58.480847 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:58.480809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv" event={"ID":"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c","Type":"ContainerStarted","Data":"61c1aabe8c8952d9149b974434b61b4166fbbe14db7c6ea467b7cdeb69249384"}
Aug 05 17:07:58.481295 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:58.480901    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:07:58.482525 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:58.482500    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc" event={"ID":"4c7c6163-59f0-4530-930e-ee772d566fc0","Type":"ContainerStarted","Data":"31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047"}
Aug 05 17:07:58.482648 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:58.482540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc" event={"ID":"4c7c6163-59f0-4530-930e-ee772d566fc0","Type":"ContainerStarted","Data":"1524eae72d9c0f42325241e47f850db16203e257380214749c255fac7513c6a4"}
Aug 05 17:07:58.482648 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:58.482563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:07:58.501891 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:58.501837    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv" podStartSLOduration=1.880670581 podStartE2EDuration="2.501821551s" totalImagesPullingTime="621.15097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:07:58.501553877 +0000 UTC m=+2799.837351821" watchObservedRunningTime="2026-08-05 17:07:58.501821551 +0000 UTC m=+2799.837619494"
Aug 05 17:07:58.520912 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:07:58.520854    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc" podStartSLOduration=1.520838025 podStartE2EDuration="1.520838025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:07:58.519693286 +0000 UTC m=+2799.855491249" watchObservedRunningTime="2026-08-05 17:07:58.520838025 +0000 UTC m=+2799.856635968"
Aug 05 17:08:04.493658 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:04.493627    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:08:09.490312 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:09.490276    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:08:38.583415 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.583381    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"]
Aug 05 17:08:38.584135 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.584088    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2" podUID="6c56170f-222f-42ca-9b01-0832b7fb636e" containerName="maas-api" containerID="cri-o://5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203" gracePeriod=30
Aug 05 17:08:38.663966 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.663922    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"]
Aug 05 17:08:38.664243 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.664213    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp" podUID="242f0131-4d92-4924-91eb-4809f548937e" containerName="payload-processing" containerID="cri-o://c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601" gracePeriod=30
Aug 05 17:08:38.674538 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.674357    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"]
Aug 05 17:08:38.674925 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.674884    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q" podUID="da623ea3-ce97-4550-8410-c9d141b79737" containerName="payload-pre-processing" containerID="cri-o://f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b" gracePeriod=30
Aug 05 17:08:38.913820 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.913327    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:08:38.973817 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.973789    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:08:38.983551 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:38.983532    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:08:39.055300 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055272    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da623ea3-ce97-4550-8410-c9d141b79737-plugins-config-volume\") pod \"da623ea3-ce97-4550-8410-c9d141b79737\" (UID: \"da623ea3-ce97-4550-8410-c9d141b79737\") "
Aug 05 17:08:39.055480 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055318    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct7zr\" (UniqueName: \"kubernetes.io/projected/242f0131-4d92-4924-91eb-4809f548937e-kube-api-access-ct7zr\") pod \"242f0131-4d92-4924-91eb-4809f548937e\" (UID: \"242f0131-4d92-4924-91eb-4809f548937e\") "
Aug 05 17:08:39.055480 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055382    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c56170f-222f-42ca-9b01-0832b7fb636e-openshift-service-ca\") pod \"6c56170f-222f-42ca-9b01-0832b7fb636e\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") "
Aug 05 17:08:39.055480 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055415    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgp5z\" (UniqueName: \"kubernetes.io/projected/6c56170f-222f-42ca-9b01-0832b7fb636e-kube-api-access-lgp5z\") pod \"6c56170f-222f-42ca-9b01-0832b7fb636e\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") "
Aug 05 17:08:39.055480 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls\") pod \"6c56170f-222f-42ca-9b01-0832b7fb636e\" (UID: \"6c56170f-222f-42ca-9b01-0832b7fb636e\") "
Aug 05 17:08:39.055722 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/242f0131-4d92-4924-91eb-4809f548937e-plugins-config-volume\") pod \"242f0131-4d92-4924-91eb-4809f548937e\" (UID: \"242f0131-4d92-4924-91eb-4809f548937e\") "
Aug 05 17:08:39.055722 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd9bd\" (UniqueName: \"kubernetes.io/projected/da623ea3-ce97-4550-8410-c9d141b79737-kube-api-access-pd9bd\") pod \"da623ea3-ce97-4550-8410-c9d141b79737\" (UID: \"da623ea3-ce97-4550-8410-c9d141b79737\") "
Aug 05 17:08:39.055722 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055702    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da623ea3-ce97-4550-8410-c9d141b79737-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da623ea3-ce97-4550-8410-c9d141b79737" (UID: "da623ea3-ce97-4550-8410-c9d141b79737"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:39.055893 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055766    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c56170f-222f-42ca-9b01-0832b7fb636e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c56170f-222f-42ca-9b01-0832b7fb636e" (UID: "6c56170f-222f-42ca-9b01-0832b7fb636e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:39.056037 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.055988    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da623ea3-ce97-4550-8410-c9d141b79737-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:08:39.056037 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.056013    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c56170f-222f-42ca-9b01-0832b7fb636e-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:08:39.056193 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.056118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242f0131-4d92-4924-91eb-4809f548937e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "242f0131-4d92-4924-91eb-4809f548937e" (UID: "242f0131-4d92-4924-91eb-4809f548937e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:39.057581 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.057552    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/242f0131-4d92-4924-91eb-4809f548937e-kube-api-access-ct7zr" (OuterVolumeSpecName: "kube-api-access-ct7zr") pod "242f0131-4d92-4924-91eb-4809f548937e" (UID: "242f0131-4d92-4924-91eb-4809f548937e"). InnerVolumeSpecName "kube-api-access-ct7zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:39.057690 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.057639    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da623ea3-ce97-4550-8410-c9d141b79737-kube-api-access-pd9bd" (OuterVolumeSpecName: "kube-api-access-pd9bd") pod "da623ea3-ce97-4550-8410-c9d141b79737" (UID: "da623ea3-ce97-4550-8410-c9d141b79737"). InnerVolumeSpecName "kube-api-access-pd9bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:39.057917 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.057897    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c56170f-222f-42ca-9b01-0832b7fb636e" (UID: "6c56170f-222f-42ca-9b01-0832b7fb636e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:08:39.057994 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.057910    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c56170f-222f-42ca-9b01-0832b7fb636e-kube-api-access-lgp5z" (OuterVolumeSpecName: "kube-api-access-lgp5z") pod "6c56170f-222f-42ca-9b01-0832b7fb636e" (UID: "6c56170f-222f-42ca-9b01-0832b7fb636e"). InnerVolumeSpecName "kube-api-access-lgp5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:39.157549 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.157480    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct7zr\" (UniqueName: \"kubernetes.io/projected/242f0131-4d92-4924-91eb-4809f548937e-kube-api-access-ct7zr\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:08:39.157549 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.157506    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgp5z\" (UniqueName: \"kubernetes.io/projected/6c56170f-222f-42ca-9b01-0832b7fb636e-kube-api-access-lgp5z\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:08:39.157549 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.157515    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c56170f-222f-42ca-9b01-0832b7fb636e-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:08:39.157549 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.157526    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/242f0131-4d92-4924-91eb-4809f548937e-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:08:39.157549 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.157534    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd9bd\" (UniqueName: \"kubernetes.io/projected/da623ea3-ce97-4550-8410-c9d141b79737-kube-api-access-pd9bd\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:08:39.687270 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.687233    2579 generic.go:356] "Generic (PLEG): container finished" podID="242f0131-4d92-4924-91eb-4809f548937e" containerID="c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601" exitCode=0
Aug 05 17:08:39.687270 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.687273    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"
Aug 05 17:08:39.687766 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.687322    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp" event={"ID":"242f0131-4d92-4924-91eb-4809f548937e","Type":"ContainerDied","Data":"c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601"}
Aug 05 17:08:39.687766 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.687388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp" event={"ID":"242f0131-4d92-4924-91eb-4809f548937e","Type":"ContainerDied","Data":"ad18c1e86b19d0c6581126da671d3f470bd9aa0a16cb717fbf2e2f8845b9020e"}
Aug 05 17:08:39.687766 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.687421    2579 scope.go:117] "RemoveContainer" containerID="c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601"
Aug 05 17:08:39.688865 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.688837    2579 generic.go:356] "Generic (PLEG): container finished" podID="6c56170f-222f-42ca-9b01-0832b7fb636e" containerID="5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203" exitCode=0
Aug 05 17:08:39.689040 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.688896    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"
Aug 05 17:08:39.689040 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.688929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2" event={"ID":"6c56170f-222f-42ca-9b01-0832b7fb636e","Type":"ContainerDied","Data":"5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203"}
Aug 05 17:08:39.689040 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.688982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2" event={"ID":"6c56170f-222f-42ca-9b01-0832b7fb636e","Type":"ContainerDied","Data":"a8e976e02843975c07982246c180d91c85054882ac1dfff83b7c2ba5d43eb15d"}
Aug 05 17:08:39.690445 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.690419    2579 generic.go:356] "Generic (PLEG): container finished" podID="da623ea3-ce97-4550-8410-c9d141b79737" containerID="f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b" exitCode=0
Aug 05 17:08:39.690548 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.690456    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"
Aug 05 17:08:39.690548 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.690461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q" event={"ID":"da623ea3-ce97-4550-8410-c9d141b79737","Type":"ContainerDied","Data":"f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b"}
Aug 05 17:08:39.690548 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.690505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q" event={"ID":"da623ea3-ce97-4550-8410-c9d141b79737","Type":"ContainerDied","Data":"dba6bdecba7131439f6610cf72a1f87ce9d60fe4e5ee9d2f1eb55a7610210bb5"}
Aug 05 17:08:39.696846 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.696818    2579 scope.go:117] "RemoveContainer" containerID="c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601"
Aug 05 17:08:39.697121 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:08:39.697080    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601\": container with ID starting with c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601 not found: ID does not exist" containerID="c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601"
Aug 05 17:08:39.697121 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.697107    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601"} err="failed to get container status \"c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601\": rpc error: code = NotFound desc = could not find container \"c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601\": container with ID starting with c7994e8ed410c58ecf6507ab3db24ed5368128ee12fe03002c295e29defdc601 not found: ID does not exist"
Aug 05 17:08:39.697228 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.697124    2579 scope.go:117] "RemoveContainer" containerID="5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203"
Aug 05 17:08:39.704677 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.704662    2579 scope.go:117] "RemoveContainer" containerID="5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203"
Aug 05 17:08:39.704903 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:08:39.704885    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203\": container with ID starting with 5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203 not found: ID does not exist" containerID="5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203"
Aug 05 17:08:39.704949 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.704908    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203"} err="failed to get container status \"5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203\": rpc error: code = NotFound desc = could not find container \"5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203\": container with ID starting with 5f8e56aa8366969e2d09cc73df0f6ac49f40c46e1175e682b930328ab042f203 not found: ID does not exist"
Aug 05 17:08:39.704949 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.704923    2579 scope.go:117] "RemoveContainer" containerID="f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b"
Aug 05 17:08:39.712127 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.712112    2579 scope.go:117] "RemoveContainer" containerID="f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b"
Aug 05 17:08:39.712458 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:08:39.712436    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b\": container with ID starting with f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b not found: ID does not exist" containerID="f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b"
Aug 05 17:08:39.712540 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.712462    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b"} err="failed to get container status \"f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b\": rpc error: code = NotFound desc = could not find container \"f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b\": container with ID starting with f70b2153289f28ea15bdf1e794dc18fe310e83e92ac4518e8ca286b8e2fd5c9b not found: ID does not exist"
Aug 05 17:08:39.715643 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.715626    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"]
Aug 05 17:08:39.721325 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.721307    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d8dc-9956c8f96-brld2"]
Aug 05 17:08:39.734940 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.734916    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"]
Aug 05 17:08:39.741228 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.741202    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q"]
Aug 05 17:08:39.753605 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.753585    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"]
Aug 05 17:08:39.758384 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:39.758363    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp"]
Aug 05 17:08:41.188886 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:41.188853    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="242f0131-4d92-4924-91eb-4809f548937e" path="/var/lib/kubelet/pods/242f0131-4d92-4924-91eb-4809f548937e/volumes"
Aug 05 17:08:41.189381 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:41.189254    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c56170f-222f-42ca-9b01-0832b7fb636e" path="/var/lib/kubelet/pods/6c56170f-222f-42ca-9b01-0832b7fb636e/volumes"
Aug 05 17:08:41.189588 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:08:41.189574    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da623ea3-ce97-4550-8410-c9d141b79737" path="/var/lib/kubelet/pods/da623ea3-ce97-4550-8410-c9d141b79737/volumes"
Aug 05 17:09:01.632800 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:01.632758    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"]
Aug 05 17:09:01.633580 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:01.633544    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv" podUID="2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" containerName="maas-api" containerID="cri-o://61c1aabe8c8952d9149b974434b61b4166fbbe14db7c6ea467b7cdeb69249384" gracePeriod=30
Aug 05 17:09:01.709260 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:01.709222    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"]
Aug 05 17:09:01.709895 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:01.709536    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc" podUID="4c7c6163-59f0-4530-930e-ee772d566fc0" containerName="payload-pre-processing" containerID="cri-o://31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047" gracePeriod=30
Aug 05 17:09:01.807475 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:01.807437    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" containerID="61c1aabe8c8952d9149b974434b61b4166fbbe14db7c6ea467b7cdeb69249384" exitCode=0
Aug 05 17:09:01.807661 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:01.807514    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv" event={"ID":"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c","Type":"ContainerDied","Data":"61c1aabe8c8952d9149b974434b61b4166fbbe14db7c6ea467b7cdeb69249384"}
Aug 05 17:09:01.969714 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:01.969686    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:09:01.997337 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:01.997310    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:09:02.067777 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.067747    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-maas-api-tls\") pod \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") "
Aug 05 17:09:02.067948 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.067847    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52qrg\" (UniqueName: \"kubernetes.io/projected/4c7c6163-59f0-4530-930e-ee772d566fc0-kube-api-access-52qrg\") pod \"4c7c6163-59f0-4530-930e-ee772d566fc0\" (UID: \"4c7c6163-59f0-4530-930e-ee772d566fc0\") "
Aug 05 17:09:02.067948 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.067892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c7c6163-59f0-4530-930e-ee772d566fc0-plugins-config-volume\") pod \"4c7c6163-59f0-4530-930e-ee772d566fc0\" (UID: \"4c7c6163-59f0-4530-930e-ee772d566fc0\") "
Aug 05 17:09:02.067948 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.067918    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-openshift-service-ca\") pod \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") "
Aug 05 17:09:02.067948 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.067942    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq7ck\" (UniqueName: \"kubernetes.io/projected/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-kube-api-access-dq7ck\") pod \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\" (UID: \"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c\") "
Aug 05 17:09:02.068305 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.068274    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" (UID: "2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:02.068454 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.068403    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c7c6163-59f0-4530-930e-ee772d566fc0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4c7c6163-59f0-4530-930e-ee772d566fc0" (UID: "4c7c6163-59f0-4530-930e-ee772d566fc0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:02.070052 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.070031    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-kube-api-access-dq7ck" (OuterVolumeSpecName: "kube-api-access-dq7ck") pod "2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" (UID: "2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c"). InnerVolumeSpecName "kube-api-access-dq7ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:02.070310 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.070293    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7c6163-59f0-4530-930e-ee772d566fc0-kube-api-access-52qrg" (OuterVolumeSpecName: "kube-api-access-52qrg") pod "4c7c6163-59f0-4530-930e-ee772d566fc0" (UID: "4c7c6163-59f0-4530-930e-ee772d566fc0"). InnerVolumeSpecName "kube-api-access-52qrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:02.070373 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.070301    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" (UID: "2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:09:02.169564 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.169535    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52qrg\" (UniqueName: \"kubernetes.io/projected/4c7c6163-59f0-4530-930e-ee772d566fc0-kube-api-access-52qrg\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:09:02.169564 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.169563    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c7c6163-59f0-4530-930e-ee772d566fc0-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:09:02.169743 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.169574    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:09:02.169743 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.169583    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq7ck\" (UniqueName: \"kubernetes.io/projected/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-kube-api-access-dq7ck\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:09:02.169743 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.169593    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:09:02.813805 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.813779    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"
Aug 05 17:09:02.813805 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.813811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv" event={"ID":"2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c","Type":"ContainerDied","Data":"4a16ff6a7c37c4b5e8a92a51e7e6ce525579dd6e95a88efaa7bcc77be47a7b33"}
Aug 05 17:09:02.814389 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.813877    2579 scope.go:117] "RemoveContainer" containerID="61c1aabe8c8952d9149b974434b61b4166fbbe14db7c6ea467b7cdeb69249384"
Aug 05 17:09:02.815254 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.815067    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c7c6163-59f0-4530-930e-ee772d566fc0" containerID="31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047" exitCode=0
Aug 05 17:09:02.815254 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.815109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc" event={"ID":"4c7c6163-59f0-4530-930e-ee772d566fc0","Type":"ContainerDied","Data":"31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047"}
Aug 05 17:09:02.815254 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.815161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc" event={"ID":"4c7c6163-59f0-4530-930e-ee772d566fc0","Type":"ContainerDied","Data":"1524eae72d9c0f42325241e47f850db16203e257380214749c255fac7513c6a4"}
Aug 05 17:09:02.815254 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.815115    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"
Aug 05 17:09:02.823311 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.823295    2579 scope.go:117] "RemoveContainer" containerID="31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047"
Aug 05 17:09:02.831635 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.831613    2579 scope.go:117] "RemoveContainer" containerID="31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047"
Aug 05 17:09:02.831901 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:09:02.831877    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047\": container with ID starting with 31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047 not found: ID does not exist" containerID="31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047"
Aug 05 17:09:02.831994 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.831906    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047"} err="failed to get container status \"31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047\": rpc error: code = NotFound desc = could not find container \"31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047\": container with ID starting with 31faa8dd60bb97abc6b80422c515fca233ed67a2c0cf5c33654aba43d4768047 not found: ID does not exist"
Aug 05 17:09:02.844565 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.844541    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"]
Aug 05 17:09:02.852460 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.852434    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f2130f-5d56f54546-d5mmv"]
Aug 05 17:09:02.867683 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.867654    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"]
Aug 05 17:09:02.872810 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:02.872784    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc"]
Aug 05 17:09:03.188730 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:03.188700    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" path="/var/lib/kubelet/pods/2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c/volumes"
Aug 05 17:09:03.189073 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:03.189059    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c7c6163-59f0-4530-930e-ee772d566fc0" path="/var/lib/kubelet/pods/4c7c6163-59f0-4530-930e-ee772d566fc0/volumes"
Aug 05 17:09:13.780322 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780247    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"]
Aug 05 17:09:13.780858 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780841    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c7c6163-59f0-4530-930e-ee772d566fc0" containerName="payload-pre-processing"
Aug 05 17:09:13.780905 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780861    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c7c6163-59f0-4530-930e-ee772d566fc0" containerName="payload-pre-processing"
Aug 05 17:09:13.780905 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780894    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="242f0131-4d92-4924-91eb-4809f548937e" containerName="payload-processing"
Aug 05 17:09:13.780905 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780903    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="242f0131-4d92-4924-91eb-4809f548937e" containerName="payload-processing"
Aug 05 17:09:13.781002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780921    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da623ea3-ce97-4550-8410-c9d141b79737" containerName="payload-pre-processing"
Aug 05 17:09:13.781002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780931    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="da623ea3-ce97-4550-8410-c9d141b79737" containerName="payload-pre-processing"
Aug 05 17:09:13.781002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780946    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c56170f-222f-42ca-9b01-0832b7fb636e" containerName="maas-api"
Aug 05 17:09:13.781002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780954    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c56170f-222f-42ca-9b01-0832b7fb636e" containerName="maas-api"
Aug 05 17:09:13.781002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780964    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" containerName="maas-api"
Aug 05 17:09:13.781002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.780972    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" containerName="maas-api"
Aug 05 17:09:13.781182 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.781051    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="da623ea3-ce97-4550-8410-c9d141b79737" containerName="payload-pre-processing"
Aug 05 17:09:13.781182 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.781062    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c56170f-222f-42ca-9b01-0832b7fb636e" containerName="maas-api"
Aug 05 17:09:13.781182 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.781071    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2e58fe-79db-4603-a6ec-e3a5b47ddb3c" containerName="maas-api"
Aug 05 17:09:13.781182 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.781079    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="242f0131-4d92-4924-91eb-4809f548937e" containerName="payload-processing"
Aug 05 17:09:13.781182 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.781091    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c7c6163-59f0-4530-930e-ee772d566fc0" containerName="payload-pre-processing"
Aug 05 17:09:13.784527 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.784510    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:13.787268 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.787236    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-02b433-serving-cert\""
Aug 05 17:09:13.791670 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.791648    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"]
Aug 05 17:09:13.878368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.878266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:13.878556 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.878439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:13.878556 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.878525    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhk5q\" (UniqueName: \"kubernetes.io/projected/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-kube-api-access-hhk5q\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:13.979077 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.979044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:13.979255 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.979102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:13.979255 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.979144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhk5q\" (UniqueName: \"kubernetes.io/projected/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-kube-api-access-hhk5q\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:13.979255 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:09:13.979194    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-serving-cert: secret "maas-api-e2e-shared-a-02b433-serving-cert" not found
Aug 05 17:09:13.979474 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:09:13.979275    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls podName:435c1a18-634e-49ab-9fb3-1ce98b0e8ff3 nodeName:}" failed. No retries permitted until 2026-08-05 17:09:14.479256398 +0000 UTC m=+2875.815054320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls") pod "maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt" (UID: "435c1a18-634e-49ab-9fb3-1ce98b0e8ff3") : secret "maas-api-e2e-shared-a-02b433-serving-cert" not found
Aug 05 17:09:13.979845 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.979821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:13.991959 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:13.991936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhk5q\" (UniqueName: \"kubernetes.io/projected/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-kube-api-access-hhk5q\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:14.483572 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.483528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:14.486058 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.486031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls\") pod \"maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:14.677907 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.677869    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"]
Aug 05 17:09:14.681570 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.681552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:14.684360 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.684329    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-02b433\""
Aug 05 17:09:14.684471 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.684332    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-02b433-dockercfg-q9rwv\""
Aug 05 17:09:14.695564 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.695543    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"]
Aug 05 17:09:14.698398 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.698330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:14.721787 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.721752    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"]
Aug 05 17:09:14.726826 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.726807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:14.736107 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.736082    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"]
Aug 05 17:09:14.785730 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.785700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda34de9-bc81-4f55-a617-e8ec86f82fd1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn\" (UID: \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:14.786107 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.785773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94l65\" (UniqueName: \"kubernetes.io/projected/dda34de9-bc81-4f55-a617-e8ec86f82fd1-kube-api-access-94l65\") pod \"payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn\" (UID: \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:14.786107 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.785863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj7x5\" (UniqueName: \"kubernetes.io/projected/464fceb2-39c8-42da-a50e-9418fe442d20-kube-api-access-bj7x5\") pod \"payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp\" (UID: \"464fceb2-39c8-42da-a50e-9418fe442d20\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:14.786107 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.785905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/464fceb2-39c8-42da-a50e-9418fe442d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp\" (UID: \"464fceb2-39c8-42da-a50e-9418fe442d20\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:14.839557 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.839524    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"]
Aug 05 17:09:14.842256 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:09:14.842230    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435c1a18_634e_49ab_9fb3_1ce98b0e8ff3.slice/crio-23fc7a21aa8287d7b52be78945aa7269b69e02792ece06ed2614c0d919ce2fa9 WatchSource:0}: Error finding container 23fc7a21aa8287d7b52be78945aa7269b69e02792ece06ed2614c0d919ce2fa9: Status 404 returned error can't find the container with id 23fc7a21aa8287d7b52be78945aa7269b69e02792ece06ed2614c0d919ce2fa9
Aug 05 17:09:14.882629 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.882587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt" event={"ID":"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3","Type":"ContainerStarted","Data":"23fc7a21aa8287d7b52be78945aa7269b69e02792ece06ed2614c0d919ce2fa9"}
Aug 05 17:09:14.887236 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.887215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda34de9-bc81-4f55-a617-e8ec86f82fd1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn\" (UID: \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:14.887324 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.887265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94l65\" (UniqueName: \"kubernetes.io/projected/dda34de9-bc81-4f55-a617-e8ec86f82fd1-kube-api-access-94l65\") pod \"payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn\" (UID: \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:14.887434 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.887404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj7x5\" (UniqueName: \"kubernetes.io/projected/464fceb2-39c8-42da-a50e-9418fe442d20-kube-api-access-bj7x5\") pod \"payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp\" (UID: \"464fceb2-39c8-42da-a50e-9418fe442d20\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:14.887499 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.887461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/464fceb2-39c8-42da-a50e-9418fe442d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp\" (UID: \"464fceb2-39c8-42da-a50e-9418fe442d20\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:14.888157 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.888138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda34de9-bc81-4f55-a617-e8ec86f82fd1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn\" (UID: \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:14.888256 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.888235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/464fceb2-39c8-42da-a50e-9418fe442d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp\" (UID: \"464fceb2-39c8-42da-a50e-9418fe442d20\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:14.896322 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.896299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94l65\" (UniqueName: \"kubernetes.io/projected/dda34de9-bc81-4f55-a617-e8ec86f82fd1-kube-api-access-94l65\") pod \"payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn\" (UID: \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:14.896427 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.896386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj7x5\" (UniqueName: \"kubernetes.io/projected/464fceb2-39c8-42da-a50e-9418fe442d20-kube-api-access-bj7x5\") pod \"payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp\" (UID: \"464fceb2-39c8-42da-a50e-9418fe442d20\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:14.992664 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:14.992580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:15.040092 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.040044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:15.169031 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.168994    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"]
Aug 05 17:09:15.171280 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:09:15.171252    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464fceb2_39c8_42da_a50e_9418fe442d20.slice/crio-a174963135927bc69bef02a242974eff929466fee7f27f0959e2f9be0c461890 WatchSource:0}: Error finding container a174963135927bc69bef02a242974eff929466fee7f27f0959e2f9be0c461890: Status 404 returned error can't find the container with id a174963135927bc69bef02a242974eff929466fee7f27f0959e2f9be0c461890
Aug 05 17:09:15.217513 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.217477    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"]
Aug 05 17:09:15.222552 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:09:15.222530    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda34de9_bc81_4f55_a617_e8ec86f82fd1.slice/crio-8f0dabf7e984bb59a3781c631e3b0c52ce49818b740fae59540bcc4b05e3aa67 WatchSource:0}: Error finding container 8f0dabf7e984bb59a3781c631e3b0c52ce49818b740fae59540bcc4b05e3aa67: Status 404 returned error can't find the container with id 8f0dabf7e984bb59a3781c631e3b0c52ce49818b740fae59540bcc4b05e3aa67
Aug 05 17:09:15.890069 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.889962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn" event={"ID":"dda34de9-bc81-4f55-a617-e8ec86f82fd1","Type":"ContainerStarted","Data":"43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8"}
Aug 05 17:09:15.890498 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.890134    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:15.890498 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.890174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn" event={"ID":"dda34de9-bc81-4f55-a617-e8ec86f82fd1","Type":"ContainerStarted","Data":"8f0dabf7e984bb59a3781c631e3b0c52ce49818b740fae59540bcc4b05e3aa67"}
Aug 05 17:09:15.891492 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.891467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp" event={"ID":"464fceb2-39c8-42da-a50e-9418fe442d20","Type":"ContainerStarted","Data":"f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330"}
Aug 05 17:09:15.891619 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.891516    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:15.891619 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.891541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp" event={"ID":"464fceb2-39c8-42da-a50e-9418fe442d20","Type":"ContainerStarted","Data":"a174963135927bc69bef02a242974eff929466fee7f27f0959e2f9be0c461890"}
Aug 05 17:09:15.892808 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.892781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt" event={"ID":"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3","Type":"ContainerStarted","Data":"422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0"}
Aug 05 17:09:15.892882 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.892829    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:15.910029 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.909963    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn" podStartSLOduration=1.909950586 podStartE2EDuration="1.909950586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:15.908108446 +0000 UTC m=+2877.243906392" watchObservedRunningTime="2026-08-05 17:09:15.909950586 +0000 UTC m=+2877.245748508"
Aug 05 17:09:15.928136 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.928087    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt" podStartSLOduration=2.16790459 podStartE2EDuration="2.92806884s" totalImagesPullingTime="760.16425ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:15.926503542 +0000 UTC m=+2877.262301489" watchObservedRunningTime="2026-08-05 17:09:15.92806884 +0000 UTC m=+2877.263866769"
Aug 05 17:09:15.944739 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:15.944692    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp" podStartSLOduration=1.944678221 podStartE2EDuration="1.944678221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:15.943923927 +0000 UTC m=+2877.279721872" watchObservedRunningTime="2026-08-05 17:09:15.944678221 +0000 UTC m=+2877.280476166"
Aug 05 17:09:21.904575 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:21.904543    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:09:26.900529 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:26.900487    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:09:26.900961 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:26.900690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:09:42.001115 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.001079    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"]
Aug 05 17:09:42.004922 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.004903    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.008109 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.008088    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-46e6bf-serving-cert\""
Aug 05 17:09:42.017334 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.017313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"]
Aug 05 17:09:42.027164 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.027136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r64j\" (UniqueName: \"kubernetes.io/projected/330fd7b3-2b2d-43f0-8fbc-581390e5330a-kube-api-access-2r64j\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.027270 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.027175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.027335 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.027272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/330fd7b3-2b2d-43f0-8fbc-581390e5330a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.128363 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.128311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/330fd7b3-2b2d-43f0-8fbc-581390e5330a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.128531 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.128425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r64j\" (UniqueName: \"kubernetes.io/projected/330fd7b3-2b2d-43f0-8fbc-581390e5330a-kube-api-access-2r64j\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.128531 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.128451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.128608 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:09:42.128567    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-serving-cert: secret "maas-api-e2e-shared-b-46e6bf-serving-cert" not found
Aug 05 17:09:42.128644 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:09:42.128620    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls podName:330fd7b3-2b2d-43f0-8fbc-581390e5330a nodeName:}" failed. No retries permitted until 2026-08-05 17:09:42.628604068 +0000 UTC m=+2903.964401990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls") pod "maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt" (UID: "330fd7b3-2b2d-43f0-8fbc-581390e5330a") : secret "maas-api-e2e-shared-b-46e6bf-serving-cert" not found
Aug 05 17:09:42.128937 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.128915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/330fd7b3-2b2d-43f0-8fbc-581390e5330a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.138187 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.138159    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r64j\" (UniqueName: \"kubernetes.io/projected/330fd7b3-2b2d-43f0-8fbc-581390e5330a-kube-api-access-2r64j\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.633970 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.633937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.636263 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.636244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls\") pod \"maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.810051 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.810014    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"]
Aug 05 17:09:42.813779 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.813764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:42.816845 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.816826    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-46e6bf\""
Aug 05 17:09:42.835699 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.835663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gglxt\" (UniqueName: \"kubernetes.io/projected/5e5db8fc-f683-4f9c-965a-3ce6ad663333-kube-api-access-gglxt\") pod \"payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn\" (UID: \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\") " pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:42.835823 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.835762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5db8fc-f683-4f9c-965a-3ce6ad663333-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn\" (UID: \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\") " pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:42.839804 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.839779    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"]
Aug 05 17:09:42.916703 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.916671    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:42.937177 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.937149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5db8fc-f683-4f9c-965a-3ce6ad663333-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn\" (UID: \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\") " pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:42.937308 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.937244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gglxt\" (UniqueName: \"kubernetes.io/projected/5e5db8fc-f683-4f9c-965a-3ce6ad663333-kube-api-access-gglxt\") pod \"payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn\" (UID: \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\") " pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:42.937854 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.937832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5db8fc-f683-4f9c-965a-3ce6ad663333-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn\" (UID: \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\") " pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:42.947627 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:42.947604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gglxt\" (UniqueName: \"kubernetes.io/projected/5e5db8fc-f683-4f9c-965a-3ce6ad663333-kube-api-access-gglxt\") pod \"payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn\" (UID: \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\") " pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:43.096930 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:43.096905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"]
Aug 05 17:09:43.099187 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:09:43.099157    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330fd7b3_2b2d_43f0_8fbc_581390e5330a.slice/crio-23276680f152b593bcd766d1535098932bd9121fa57e6c17da4ace299603b747 WatchSource:0}: Error finding container 23276680f152b593bcd766d1535098932bd9121fa57e6c17da4ace299603b747: Status 404 returned error can't find the container with id 23276680f152b593bcd766d1535098932bd9121fa57e6c17da4ace299603b747
Aug 05 17:09:43.124478 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:43.124454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:43.266231 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:43.266192    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"]
Aug 05 17:09:43.267394 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:09:43.267370    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5db8fc_f683_4f9c_965a_3ce6ad663333.slice/crio-e4dfa350f3f061a9d5a051abe55165d0b78a1778855df51f7775a949227c3277 WatchSource:0}: Error finding container e4dfa350f3f061a9d5a051abe55165d0b78a1778855df51f7775a949227c3277: Status 404 returned error can't find the container with id e4dfa350f3f061a9d5a051abe55165d0b78a1778855df51f7775a949227c3277
Aug 05 17:09:44.029849 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:44.029813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt" event={"ID":"330fd7b3-2b2d-43f0-8fbc-581390e5330a","Type":"ContainerStarted","Data":"1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c"}
Aug 05 17:09:44.030069 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:44.029893    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt" event={"ID":"330fd7b3-2b2d-43f0-8fbc-581390e5330a","Type":"ContainerStarted","Data":"23276680f152b593bcd766d1535098932bd9121fa57e6c17da4ace299603b747"}
Aug 05 17:09:44.030069 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:44.029929    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:44.031393 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:44.031366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn" event={"ID":"5e5db8fc-f683-4f9c-965a-3ce6ad663333","Type":"ContainerStarted","Data":"23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137"}
Aug 05 17:09:44.031511 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:44.031409    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn" event={"ID":"5e5db8fc-f683-4f9c-965a-3ce6ad663333","Type":"ContainerStarted","Data":"e4dfa350f3f061a9d5a051abe55165d0b78a1778855df51f7775a949227c3277"}
Aug 05 17:09:44.031511 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:44.031453    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:09:44.051427 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:44.051386    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt" podStartSLOduration=2.56525729 podStartE2EDuration="3.05136826s" totalImagesPullingTime="486.11097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:44.049362829 +0000 UTC m=+2905.385160792" watchObservedRunningTime="2026-08-05 17:09:44.05136826 +0000 UTC m=+2905.387166210"
Aug 05 17:09:44.070088 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:44.070050    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn" podStartSLOduration=2.07003749 podStartE2EDuration="2.07003749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:44.067748389 +0000 UTC m=+2905.403546334" watchObservedRunningTime="2026-08-05 17:09:44.07003749 +0000 UTC m=+2905.405835435"
Aug 05 17:09:50.042120 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:50.042089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:09:55.038201 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:09:55.038170    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:11:19.371096 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:11:19.371072    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:11:19.378903 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:11:19.378883    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:11:19.551823 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:11:19.551793    2579 scope.go:117] "RemoveContainer" containerID="1fb5ed8481c180749c5c446cbb310c1d3b0ba785432ca2e1418b9937fe440d3d"
Aug 05 17:16:19.400418 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:16:19.400389    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:16:19.409389 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:16:19.409366    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:17:21.618009 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:21.617973    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139681450475568"]
Aug 05 17:17:21.621542 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:21.621524    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450475568"
Aug 05 17:17:21.624680 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:21.624662    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vwmvl\""
Aug 05 17:17:21.629921 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:21.629898    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450475568"]
Aug 05 17:17:21.704027 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:21.703996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4nwk\" (UniqueName: \"kubernetes.io/projected/7c7ff115-8c1e-444d-8b54-90019e7e2f7e-kube-api-access-q4nwk\") pod \"test-curl-7497-139681450475568\" (UID: \"7c7ff115-8c1e-444d-8b54-90019e7e2f7e\") " pod="opendatahub/test-curl-7497-139681450475568"
Aug 05 17:17:21.804894 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:21.804861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4nwk\" (UniqueName: \"kubernetes.io/projected/7c7ff115-8c1e-444d-8b54-90019e7e2f7e-kube-api-access-q4nwk\") pod \"test-curl-7497-139681450475568\" (UID: \"7c7ff115-8c1e-444d-8b54-90019e7e2f7e\") " pod="opendatahub/test-curl-7497-139681450475568"
Aug 05 17:17:21.815112 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:21.815081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4nwk\" (UniqueName: \"kubernetes.io/projected/7c7ff115-8c1e-444d-8b54-90019e7e2f7e-kube-api-access-q4nwk\") pod \"test-curl-7497-139681450475568\" (UID: \"7c7ff115-8c1e-444d-8b54-90019e7e2f7e\") " pod="opendatahub/test-curl-7497-139681450475568"
Aug 05 17:17:21.932621 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:21.932595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450475568"
Aug 05 17:17:22.071382 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:22.071039    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450475568"]
Aug 05 17:17:22.077694 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:17:22.077654    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c7ff115_8c1e_444d_8b54_90019e7e2f7e.slice/crio-7abb648af02402b56492614892599cc11699c765860746606061ed81b14ec627 WatchSource:0}: Error finding container 7abb648af02402b56492614892599cc11699c765860746606061ed81b14ec627: Status 404 returned error can't find the container with id 7abb648af02402b56492614892599cc11699c765860746606061ed81b14ec627
Aug 05 17:17:22.078980 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:22.078957    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:17:22.254421 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:22.254304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450475568" event={"ID":"7c7ff115-8c1e-444d-8b54-90019e7e2f7e","Type":"ContainerStarted","Data":"7abb648af02402b56492614892599cc11699c765860746606061ed81b14ec627"}
Aug 05 17:17:23.260580 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:23.260544    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c7ff115-8c1e-444d-8b54-90019e7e2f7e" containerID="4211d6c1fd3133a0d4f62901a3da751e33a3f498c48eb2a55d7b0a9f3aae1663" exitCode=0
Aug 05 17:17:23.260974 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:23.260596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450475568" event={"ID":"7c7ff115-8c1e-444d-8b54-90019e7e2f7e","Type":"ContainerDied","Data":"4211d6c1fd3133a0d4f62901a3da751e33a3f498c48eb2a55d7b0a9f3aae1663"}
Aug 05 17:17:24.401594 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:24.401567    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450475568"
Aug 05 17:17:24.429222 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:24.429193    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4nwk\" (UniqueName: \"kubernetes.io/projected/7c7ff115-8c1e-444d-8b54-90019e7e2f7e-kube-api-access-q4nwk\") pod \"7c7ff115-8c1e-444d-8b54-90019e7e2f7e\" (UID: \"7c7ff115-8c1e-444d-8b54-90019e7e2f7e\") "
Aug 05 17:17:24.431355 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:24.431305    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7ff115-8c1e-444d-8b54-90019e7e2f7e-kube-api-access-q4nwk" (OuterVolumeSpecName: "kube-api-access-q4nwk") pod "7c7ff115-8c1e-444d-8b54-90019e7e2f7e" (UID: "7c7ff115-8c1e-444d-8b54-90019e7e2f7e"). InnerVolumeSpecName "kube-api-access-q4nwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:24.458621 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:24.458595    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139681450475568_7c7ff115-8c1e-444d-8b54-90019e7e2f7e/test-curl-7497-139681450475568/0.log"
Aug 05 17:17:24.495169 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:24.495127    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139681450475568"]
Aug 05 17:17:24.500682 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:24.500655    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139681450475568"]
Aug 05 17:17:24.530169 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:24.530088    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4nwk\" (UniqueName: \"kubernetes.io/projected/7c7ff115-8c1e-444d-8b54-90019e7e2f7e-kube-api-access-q4nwk\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:17:25.188868 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:25.188836    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c7ff115-8c1e-444d-8b54-90019e7e2f7e" path="/var/lib/kubelet/pods/7c7ff115-8c1e-444d-8b54-90019e7e2f7e/volumes"
Aug 05 17:17:25.270970 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:25.270938    2579 scope.go:117] "RemoveContainer" containerID="4211d6c1fd3133a0d4f62901a3da751e33a3f498c48eb2a55d7b0a9f3aae1663"
Aug 05 17:17:25.270970 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:25.270959    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450475568"
Aug 05 17:17:40.202045 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.202009    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"]
Aug 05 17:17:40.202506 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.202489    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7ff115-8c1e-444d-8b54-90019e7e2f7e" containerName="test-curl-7497-139681450475568"
Aug 05 17:17:40.202506 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.202507    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7ff115-8c1e-444d-8b54-90019e7e2f7e" containerName="test-curl-7497-139681450475568"
Aug 05 17:17:40.202596 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.202590    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7ff115-8c1e-444d-8b54-90019e7e2f7e" containerName="test-curl-7497-139681450475568"
Aug 05 17:17:40.207460 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.207435    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.214224 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.214165    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b2b0ab-serving-cert\""
Aug 05 17:17:40.226816 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.226788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"]
Aug 05 17:17:40.286918 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.286883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be9190c9-19e4-4be5-8bc3-3cda1a416563-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.287122 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.286964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7qn6\" (UniqueName: \"kubernetes.io/projected/be9190c9-19e4-4be5-8bc3-3cda1a416563-kube-api-access-p7qn6\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.287122 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.287007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be9190c9-19e4-4be5-8bc3-3cda1a416563-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.387867 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.387826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be9190c9-19e4-4be5-8bc3-3cda1a416563-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.388046 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.387886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7qn6\" (UniqueName: \"kubernetes.io/projected/be9190c9-19e4-4be5-8bc3-3cda1a416563-kube-api-access-p7qn6\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.388046 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.387921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be9190c9-19e4-4be5-8bc3-3cda1a416563-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.388689 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.388655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be9190c9-19e4-4be5-8bc3-3cda1a416563-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.390200 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.390183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be9190c9-19e4-4be5-8bc3-3cda1a416563-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.405044 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.405020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7qn6\" (UniqueName: \"kubernetes.io/projected/be9190c9-19e4-4be5-8bc3-3cda1a416563-kube-api-access-p7qn6\") pod \"maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.518114 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.518033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:40.668763 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:40.668723    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"]
Aug 05 17:17:40.669636 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:17:40.669609    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe9190c9_19e4_4be5_8bc3_3cda1a416563.slice/crio-9b84684c5d0556bf3d2b17f2dae4bb3d8a3976ca5b18bb8ba4704526e86888e2 WatchSource:0}: Error finding container 9b84684c5d0556bf3d2b17f2dae4bb3d8a3976ca5b18bb8ba4704526e86888e2: Status 404 returned error can't find the container with id 9b84684c5d0556bf3d2b17f2dae4bb3d8a3976ca5b18bb8ba4704526e86888e2
Aug 05 17:17:41.352101 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:41.352059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz" event={"ID":"be9190c9-19e4-4be5-8bc3-3cda1a416563","Type":"ContainerStarted","Data":"7e5b4ba77346cd0fa16178a9091de499df68bea3c5f2726e369cf971cbd90e41"}
Aug 05 17:17:41.352560 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:41.352127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz" event={"ID":"be9190c9-19e4-4be5-8bc3-3cda1a416563","Type":"ContainerStarted","Data":"9b84684c5d0556bf3d2b17f2dae4bb3d8a3976ca5b18bb8ba4704526e86888e2"}
Aug 05 17:17:41.352560 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:41.352157    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:17:41.384641 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:41.384589    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz" podStartSLOduration=0.817080505 podStartE2EDuration="1.384573365s" totalImagesPullingTime="567.49286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:17:41.381337073 +0000 UTC m=+3382.717135016" watchObservedRunningTime="2026-08-05 17:17:41.384573365 +0000 UTC m=+3382.720371308"
Aug 05 17:17:47.362909 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:17:47.362879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:18:09.975517 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:09.975483    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"]
Aug 05 17:18:09.978724 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:09.978708    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:09.983357 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:09.983332    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-f6c2cb-dockercfg-tvgfz\""
Aug 05 17:18:09.983476 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:09.983406    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-f6c2cb\""
Aug 05 17:18:09.990615 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:09.990589    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"]
Aug 05 17:18:10.080963 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.080933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpsw\" (UniqueName: \"kubernetes.io/projected/03db491d-5bca-46a1-a7df-9183c78b4ca7-kube-api-access-cdpsw\") pod \"payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw\" (UID: \"03db491d-5bca-46a1-a7df-9183c78b4ca7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:10.081129 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.080981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03db491d-5bca-46a1-a7df-9183c78b4ca7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw\" (UID: \"03db491d-5bca-46a1-a7df-9183c78b4ca7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:10.089049 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.089022    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"]
Aug 05 17:18:10.092520 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.092502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:10.112797 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.112770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"]
Aug 05 17:18:10.182509 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.182479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03db491d-5bca-46a1-a7df-9183c78b4ca7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw\" (UID: \"03db491d-5bca-46a1-a7df-9183c78b4ca7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:10.182644 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.182531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5\" (UID: \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:10.182644 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.182598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-862c9\" (UniqueName: \"kubernetes.io/projected/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-kube-api-access-862c9\") pod \"payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5\" (UID: \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:10.182725 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.182647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdpsw\" (UniqueName: \"kubernetes.io/projected/03db491d-5bca-46a1-a7df-9183c78b4ca7-kube-api-access-cdpsw\") pod \"payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw\" (UID: \"03db491d-5bca-46a1-a7df-9183c78b4ca7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:10.183197 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.183181    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03db491d-5bca-46a1-a7df-9183c78b4ca7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw\" (UID: \"03db491d-5bca-46a1-a7df-9183c78b4ca7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:10.201098 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.201079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdpsw\" (UniqueName: \"kubernetes.io/projected/03db491d-5bca-46a1-a7df-9183c78b4ca7-kube-api-access-cdpsw\") pod \"payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw\" (UID: \"03db491d-5bca-46a1-a7df-9183c78b4ca7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:10.283996 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.283932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-862c9\" (UniqueName: \"kubernetes.io/projected/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-kube-api-access-862c9\") pod \"payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5\" (UID: \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:10.284133 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.284111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5\" (UID: \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:10.284761 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.284743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5\" (UID: \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:10.290791 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.290773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:10.293298 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.293277    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-862c9\" (UniqueName: \"kubernetes.io/projected/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-kube-api-access-862c9\") pod \"payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5\" (UID: \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:10.402969 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.402933    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:10.430686 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.430660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"]
Aug 05 17:18:10.432677 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:18:10.432652    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03db491d_5bca_46a1_a7df_9183c78b4ca7.slice/crio-544ddd3836fc3c09c61a9ebef833592f6509895307a1112ee8a9879ddb2690f7 WatchSource:0}: Error finding container 544ddd3836fc3c09c61a9ebef833592f6509895307a1112ee8a9879ddb2690f7: Status 404 returned error can't find the container with id 544ddd3836fc3c09c61a9ebef833592f6509895307a1112ee8a9879ddb2690f7
Aug 05 17:18:10.496627 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.496578    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw" event={"ID":"03db491d-5bca-46a1-a7df-9183c78b4ca7","Type":"ContainerStarted","Data":"544ddd3836fc3c09c61a9ebef833592f6509895307a1112ee8a9879ddb2690f7"}
Aug 05 17:18:10.549009 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:10.548976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"]
Aug 05 17:18:10.549758 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:18:10.549731    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78fbeda_b75d_4538_b4a7_5e2b5d861e08.slice/crio-07d05c09b24dc05b83a0a7767dc489de08b22efad95635f70585051e602ed496 WatchSource:0}: Error finding container 07d05c09b24dc05b83a0a7767dc489de08b22efad95635f70585051e602ed496: Status 404 returned error can't find the container with id 07d05c09b24dc05b83a0a7767dc489de08b22efad95635f70585051e602ed496
Aug 05 17:18:11.502896 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:11.502806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5" event={"ID":"e78fbeda-b75d-4538-b4a7-5e2b5d861e08","Type":"ContainerStarted","Data":"26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f"}
Aug 05 17:18:11.502896 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:11.502864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5" event={"ID":"e78fbeda-b75d-4538-b4a7-5e2b5d861e08","Type":"ContainerStarted","Data":"07d05c09b24dc05b83a0a7767dc489de08b22efad95635f70585051e602ed496"}
Aug 05 17:18:11.503375 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:11.502958    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:11.504301 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:11.504280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw" event={"ID":"03db491d-5bca-46a1-a7df-9183c78b4ca7","Type":"ContainerStarted","Data":"750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961"}
Aug 05 17:18:11.504367 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:11.504326    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:11.524255 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:11.524213    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5" podStartSLOduration=1.5242007640000002 podStartE2EDuration="1.524200764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:18:11.523425391 +0000 UTC m=+3412.859223347" watchObservedRunningTime="2026-08-05 17:18:11.524200764 +0000 UTC m=+3412.859998707"
Aug 05 17:18:11.542375 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:11.542314    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw" podStartSLOduration=2.542301104 podStartE2EDuration="2.542301104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:18:11.540998222 +0000 UTC m=+3412.876796167" watchObservedRunningTime="2026-08-05 17:18:11.542301104 +0000 UTC m=+3412.878099047"
Aug 05 17:18:22.511989 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:22.511962    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:18:22.512373 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:22.512034    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:18:39.758977 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:39.758941    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-x5xxr_8c133297-2e88-47bb-9524-b3d6fd175987/payload-processing/0.log"
Aug 05 17:18:39.861672 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:18:39.861641    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5_e78fbeda-b75d-4538-b4a7-5e2b5d861e08/payload-processing/0.log"
Aug 05 17:19:29.798708 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:29.798674    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-x5xxr_8c133297-2e88-47bb-9524-b3d6fd175987/payload-processing/0.log"
Aug 05 17:19:29.913509 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:29.913483    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5_e78fbeda-b75d-4538-b4a7-5e2b5d861e08/payload-processing/0.log"
Aug 05 17:19:35.234235 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.234204    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"]
Aug 05 17:19:35.237868 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.237851    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.240899 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.240878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-fc56ab\""
Aug 05 17:19:35.241033 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.240976    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-fc56ab-dockercfg-wldhk\""
Aug 05 17:19:35.251120 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.251091    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"]
Aug 05 17:19:35.253432 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.253411    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"]
Aug 05 17:19:35.257297 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.257277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:35.267465 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.267442    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"]
Aug 05 17:19:35.383025 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.382993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4\" (UID: \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.383161 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.383038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a254087e-f0b2-40e2-a66d-35b1d5aebd17-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4\" (UID: \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:35.383161 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.383057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkg2p\" (UniqueName: \"kubernetes.io/projected/a254087e-f0b2-40e2-a66d-35b1d5aebd17-kube-api-access-pkg2p\") pod \"payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4\" (UID: \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:35.383161 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.383114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9gg5\" (UniqueName: \"kubernetes.io/projected/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-kube-api-access-t9gg5\") pod \"payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4\" (UID: \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.484477 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.484399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4\" (UID: \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.484477 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.484445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a254087e-f0b2-40e2-a66d-35b1d5aebd17-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4\" (UID: \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:35.484477 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.484465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkg2p\" (UniqueName: \"kubernetes.io/projected/a254087e-f0b2-40e2-a66d-35b1d5aebd17-kube-api-access-pkg2p\") pod \"payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4\" (UID: \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:35.484701 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.484508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9gg5\" (UniqueName: \"kubernetes.io/projected/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-kube-api-access-t9gg5\") pod \"payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4\" (UID: \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.485327 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.485303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4\" (UID: \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.485406 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.485303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a254087e-f0b2-40e2-a66d-35b1d5aebd17-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4\" (UID: \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:35.495634 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.495615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkg2p\" (UniqueName: \"kubernetes.io/projected/a254087e-f0b2-40e2-a66d-35b1d5aebd17-kube-api-access-pkg2p\") pod \"payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4\" (UID: \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:35.495828 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.495805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9gg5\" (UniqueName: \"kubernetes.io/projected/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-kube-api-access-t9gg5\") pod \"payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4\" (UID: \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.548765 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.548737    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.570045 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.570020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:35.697516 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.696865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"]
Aug 05 17:19:35.699393 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:19:35.699362    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ee1f06_20c7_417f_bf4f_b71f2eecdfc8.slice/crio-58a27822e7f4f573cf3aac4f01b5f39913943e113cb77a8bb49f047625209830 WatchSource:0}: Error finding container 58a27822e7f4f573cf3aac4f01b5f39913943e113cb77a8bb49f047625209830: Status 404 returned error can't find the container with id 58a27822e7f4f573cf3aac4f01b5f39913943e113cb77a8bb49f047625209830
Aug 05 17:19:35.930686 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.930652    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"]
Aug 05 17:19:35.932405 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:19:35.932378    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda254087e_f0b2_40e2_a66d_35b1d5aebd17.slice/crio-4a84cae9f6345c16ff4433782292bfe8aeb50a8b79a1c6484d5aa9c573bc7caa WatchSource:0}: Error finding container 4a84cae9f6345c16ff4433782292bfe8aeb50a8b79a1c6484d5aa9c573bc7caa: Status 404 returned error can't find the container with id 4a84cae9f6345c16ff4433782292bfe8aeb50a8b79a1c6484d5aa9c573bc7caa
Aug 05 17:19:35.942240 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.942216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4" event={"ID":"a254087e-f0b2-40e2-a66d-35b1d5aebd17","Type":"ContainerStarted","Data":"4a84cae9f6345c16ff4433782292bfe8aeb50a8b79a1c6484d5aa9c573bc7caa"}
Aug 05 17:19:35.943883 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.943856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4" event={"ID":"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8","Type":"ContainerStarted","Data":"7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6"}
Aug 05 17:19:35.943970 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.943905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4" event={"ID":"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8","Type":"ContainerStarted","Data":"58a27822e7f4f573cf3aac4f01b5f39913943e113cb77a8bb49f047625209830"}
Aug 05 17:19:35.944012 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.943992    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:35.965996 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:35.965946    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4" podStartSLOduration=0.965929592 podStartE2EDuration="965.929592ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:35.963333066 +0000 UTC m=+3497.299131035" watchObservedRunningTime="2026-08-05 17:19:35.965929592 +0000 UTC m=+3497.301727539"
Aug 05 17:19:36.951407 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:36.951339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4" event={"ID":"a254087e-f0b2-40e2-a66d-35b1d5aebd17","Type":"ContainerStarted","Data":"0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a"}
Aug 05 17:19:36.951915 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:36.951557    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:36.971353 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:36.971284    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4" podStartSLOduration=1.971262305 podStartE2EDuration="1.971262305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:36.969789306 +0000 UTC m=+3498.305587253" watchObservedRunningTime="2026-08-05 17:19:36.971262305 +0000 UTC m=+3498.307060250"
Aug 05 17:19:46.954177 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:46.954097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:47.958527 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:47.958499    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:54.427146 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.427114    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"]
Aug 05 17:19:54.427679 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.427370    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4" podUID="a254087e-f0b2-40e2-a66d-35b1d5aebd17" containerName="payload-processing" containerID="cri-o://0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a" gracePeriod=30
Aug 05 17:19:54.435066 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.435030    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"]
Aug 05 17:19:54.435268 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.435240    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4" podUID="b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8" containerName="payload-pre-processing" containerID="cri-o://7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6" gracePeriod=30
Aug 05 17:19:54.694418 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.694391    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:54.718653 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.718620    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:54.871870 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.871843    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkg2p\" (UniqueName: \"kubernetes.io/projected/a254087e-f0b2-40e2-a66d-35b1d5aebd17-kube-api-access-pkg2p\") pod \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\" (UID: \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\") "
Aug 05 17:19:54.872075 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.871894    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9gg5\" (UniqueName: \"kubernetes.io/projected/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-kube-api-access-t9gg5\") pod \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\" (UID: \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\") "
Aug 05 17:19:54.872075 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.871949    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a254087e-f0b2-40e2-a66d-35b1d5aebd17-plugins-config-volume\") pod \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\" (UID: \"a254087e-f0b2-40e2-a66d-35b1d5aebd17\") "
Aug 05 17:19:54.872075 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.872031    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-plugins-config-volume\") pod \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\" (UID: \"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8\") "
Aug 05 17:19:54.872466 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.872432    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a254087e-f0b2-40e2-a66d-35b1d5aebd17-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a254087e-f0b2-40e2-a66d-35b1d5aebd17" (UID: "a254087e-f0b2-40e2-a66d-35b1d5aebd17"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:19:54.872613 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.872484    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8" (UID: "b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:19:54.874057 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.874032    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a254087e-f0b2-40e2-a66d-35b1d5aebd17-kube-api-access-pkg2p" (OuterVolumeSpecName: "kube-api-access-pkg2p") pod "a254087e-f0b2-40e2-a66d-35b1d5aebd17" (UID: "a254087e-f0b2-40e2-a66d-35b1d5aebd17"). InnerVolumeSpecName "kube-api-access-pkg2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:19:54.874148 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.874110    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-kube-api-access-t9gg5" (OuterVolumeSpecName: "kube-api-access-t9gg5") pod "b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8" (UID: "b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8"). InnerVolumeSpecName "kube-api-access-t9gg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:19:54.972891 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.972808    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:19:54.972891 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.972835    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkg2p\" (UniqueName: \"kubernetes.io/projected/a254087e-f0b2-40e2-a66d-35b1d5aebd17-kube-api-access-pkg2p\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:19:54.972891 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.972845    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9gg5\" (UniqueName: \"kubernetes.io/projected/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8-kube-api-access-t9gg5\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:19:54.972891 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:54.972853    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a254087e-f0b2-40e2-a66d-35b1d5aebd17-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:19:55.050003 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.049970    2579 generic.go:356] "Generic (PLEG): container finished" podID="a254087e-f0b2-40e2-a66d-35b1d5aebd17" containerID="0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a" exitCode=0
Aug 05 17:19:55.050178 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.050015    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"
Aug 05 17:19:55.050178 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.050055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4" event={"ID":"a254087e-f0b2-40e2-a66d-35b1d5aebd17","Type":"ContainerDied","Data":"0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a"}
Aug 05 17:19:55.050178 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.050107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4" event={"ID":"a254087e-f0b2-40e2-a66d-35b1d5aebd17","Type":"ContainerDied","Data":"4a84cae9f6345c16ff4433782292bfe8aeb50a8b79a1c6484d5aa9c573bc7caa"}
Aug 05 17:19:55.050178 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.050136    2579 scope.go:117] "RemoveContainer" containerID="0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a"
Aug 05 17:19:55.051433 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.051413    2579 generic.go:356] "Generic (PLEG): container finished" podID="b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8" containerID="7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6" exitCode=0
Aug 05 17:19:55.051562 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.051463    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"
Aug 05 17:19:55.051562 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.051475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4" event={"ID":"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8","Type":"ContainerDied","Data":"7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6"}
Aug 05 17:19:55.051562 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.051507    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4" event={"ID":"b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8","Type":"ContainerDied","Data":"58a27822e7f4f573cf3aac4f01b5f39913943e113cb77a8bb49f047625209830"}
Aug 05 17:19:55.067726 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.067709    2579 scope.go:117] "RemoveContainer" containerID="0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a"
Aug 05 17:19:55.067972 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:19:55.067951    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a\": container with ID starting with 0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a not found: ID does not exist" containerID="0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a"
Aug 05 17:19:55.068063 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.067983    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a"} err="failed to get container status \"0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a\": rpc error: code = NotFound desc = could not find container \"0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a\": container with ID starting with 0fe1c2b6b952fa94603b550162400752f3b114fc2ce146e4107d5e55bc57d74a not found: ID does not exist"
Aug 05 17:19:55.068063 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.068006    2579 scope.go:117] "RemoveContainer" containerID="7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6"
Aug 05 17:19:55.076112 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.076099    2579 scope.go:117] "RemoveContainer" containerID="7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6"
Aug 05 17:19:55.076401 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:19:55.076336    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6\": container with ID starting with 7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6 not found: ID does not exist" containerID="7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6"
Aug 05 17:19:55.076498 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.076405    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6"} err="failed to get container status \"7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6\": rpc error: code = NotFound desc = could not find container \"7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6\": container with ID starting with 7005558d38a8a8d875d48e441751e301d7f6579557bcc9b96e9c195d95913bf6 not found: ID does not exist"
Aug 05 17:19:55.080892 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.080873    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"]
Aug 05 17:19:55.086677 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.086658    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4"]
Aug 05 17:19:55.097640 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.097622    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"]
Aug 05 17:19:55.102966 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.102947    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4"]
Aug 05 17:19:55.189101 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.189075    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a254087e-f0b2-40e2-a66d-35b1d5aebd17" path="/var/lib/kubelet/pods/a254087e-f0b2-40e2-a66d-35b1d5aebd17/volumes"
Aug 05 17:19:55.189551 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:19:55.189533    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8" path="/var/lib/kubelet/pods/b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8/volumes"
Aug 05 17:20:14.903401 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:14.903369    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"]
Aug 05 17:20:14.903918 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:14.903592    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz" podUID="be9190c9-19e4-4be5-8bc3-3cda1a416563" containerName="maas-api" containerID="cri-o://7e5b4ba77346cd0fa16178a9091de499df68bea3c5f2726e369cf971cbd90e41" gracePeriod=30
Aug 05 17:20:15.156727 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.156684    2579 generic.go:356] "Generic (PLEG): container finished" podID="be9190c9-19e4-4be5-8bc3-3cda1a416563" containerID="7e5b4ba77346cd0fa16178a9091de499df68bea3c5f2726e369cf971cbd90e41" exitCode=0
Aug 05 17:20:15.156870 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.156759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz" event={"ID":"be9190c9-19e4-4be5-8bc3-3cda1a416563","Type":"ContainerDied","Data":"7e5b4ba77346cd0fa16178a9091de499df68bea3c5f2726e369cf971cbd90e41"}
Aug 05 17:20:15.156870 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.156825    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz" event={"ID":"be9190c9-19e4-4be5-8bc3-3cda1a416563","Type":"ContainerDied","Data":"9b84684c5d0556bf3d2b17f2dae4bb3d8a3976ca5b18bb8ba4704526e86888e2"}
Aug 05 17:20:15.156870 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.156851    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b84684c5d0556bf3d2b17f2dae4bb3d8a3976ca5b18bb8ba4704526e86888e2"
Aug 05 17:20:15.173162 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.173136    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:20:15.261952 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.261915    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7qn6\" (UniqueName: \"kubernetes.io/projected/be9190c9-19e4-4be5-8bc3-3cda1a416563-kube-api-access-p7qn6\") pod \"be9190c9-19e4-4be5-8bc3-3cda1a416563\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") "
Aug 05 17:20:15.262121 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.261984    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be9190c9-19e4-4be5-8bc3-3cda1a416563-openshift-service-ca\") pod \"be9190c9-19e4-4be5-8bc3-3cda1a416563\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") "
Aug 05 17:20:15.262121 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.262062    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be9190c9-19e4-4be5-8bc3-3cda1a416563-maas-api-tls\") pod \"be9190c9-19e4-4be5-8bc3-3cda1a416563\" (UID: \"be9190c9-19e4-4be5-8bc3-3cda1a416563\") "
Aug 05 17:20:15.262416 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.262328    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be9190c9-19e4-4be5-8bc3-3cda1a416563-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be9190c9-19e4-4be5-8bc3-3cda1a416563" (UID: "be9190c9-19e4-4be5-8bc3-3cda1a416563"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:20:15.263149 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.262684    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be9190c9-19e4-4be5-8bc3-3cda1a416563-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:20:15.264754 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.264728    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be9190c9-19e4-4be5-8bc3-3cda1a416563-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be9190c9-19e4-4be5-8bc3-3cda1a416563" (UID: "be9190c9-19e4-4be5-8bc3-3cda1a416563"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:20:15.264754 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.264745    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be9190c9-19e4-4be5-8bc3-3cda1a416563-kube-api-access-p7qn6" (OuterVolumeSpecName: "kube-api-access-p7qn6") pod "be9190c9-19e4-4be5-8bc3-3cda1a416563" (UID: "be9190c9-19e4-4be5-8bc3-3cda1a416563"). InnerVolumeSpecName "kube-api-access-p7qn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:20:15.363685 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.363652    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be9190c9-19e4-4be5-8bc3-3cda1a416563-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:20:15.363685 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:15.363681    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7qn6\" (UniqueName: \"kubernetes.io/projected/be9190c9-19e4-4be5-8bc3-3cda1a416563-kube-api-access-p7qn6\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:20:16.161762 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:16.161731    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"
Aug 05 17:20:16.187502 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:16.187464    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"]
Aug 05 17:20:16.195417 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:16.195391    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2b0ab-589498ff7f-lfxbz"]
Aug 05 17:20:17.188977 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:20:17.188941    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be9190c9-19e4-4be5-8bc3-3cda1a416563" path="/var/lib/kubelet/pods/be9190c9-19e4-4be5-8bc3-3cda1a416563/volumes"
Aug 05 17:21:15.422049 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.421968    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"]
Aug 05 17:21:15.424671 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.422199    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5" podUID="e78fbeda-b75d-4538-b4a7-5e2b5d861e08" containerName="payload-processing" containerID="cri-o://26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f" gracePeriod=30
Aug 05 17:21:15.436247 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.436217    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"]
Aug 05 17:21:15.436440 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.436417    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw" podUID="03db491d-5bca-46a1-a7df-9183c78b4ca7" containerName="payload-pre-processing" containerID="cri-o://750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961" gracePeriod=30
Aug 05 17:21:15.736780 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.736756    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:21:15.739732 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.739712    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:21:15.840969 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.840937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03db491d-5bca-46a1-a7df-9183c78b4ca7-plugins-config-volume\") pod \"03db491d-5bca-46a1-a7df-9183c78b4ca7\" (UID: \"03db491d-5bca-46a1-a7df-9183c78b4ca7\") "
Aug 05 17:21:15.841129 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.840992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-plugins-config-volume\") pod \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\" (UID: \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\") "
Aug 05 17:21:15.841129 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.841024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdpsw\" (UniqueName: \"kubernetes.io/projected/03db491d-5bca-46a1-a7df-9183c78b4ca7-kube-api-access-cdpsw\") pod \"03db491d-5bca-46a1-a7df-9183c78b4ca7\" (UID: \"03db491d-5bca-46a1-a7df-9183c78b4ca7\") "
Aug 05 17:21:15.841129 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.841084    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-862c9\" (UniqueName: \"kubernetes.io/projected/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-kube-api-access-862c9\") pod \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\" (UID: \"e78fbeda-b75d-4538-b4a7-5e2b5d861e08\") "
Aug 05 17:21:15.841379 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.841356    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03db491d-5bca-46a1-a7df-9183c78b4ca7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03db491d-5bca-46a1-a7df-9183c78b4ca7" (UID: "03db491d-5bca-46a1-a7df-9183c78b4ca7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:15.841453 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.841372    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e78fbeda-b75d-4538-b4a7-5e2b5d861e08" (UID: "e78fbeda-b75d-4538-b4a7-5e2b5d861e08"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:15.841492 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.841467    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03db491d-5bca-46a1-a7df-9183c78b4ca7-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:15.841492 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.841482    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:15.843155 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.843130    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-kube-api-access-862c9" (OuterVolumeSpecName: "kube-api-access-862c9") pod "e78fbeda-b75d-4538-b4a7-5e2b5d861e08" (UID: "e78fbeda-b75d-4538-b4a7-5e2b5d861e08"). InnerVolumeSpecName "kube-api-access-862c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:15.843516 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.843497    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03db491d-5bca-46a1-a7df-9183c78b4ca7-kube-api-access-cdpsw" (OuterVolumeSpecName: "kube-api-access-cdpsw") pod "03db491d-5bca-46a1-a7df-9183c78b4ca7" (UID: "03db491d-5bca-46a1-a7df-9183c78b4ca7"). InnerVolumeSpecName "kube-api-access-cdpsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:15.942816 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.942788    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdpsw\" (UniqueName: \"kubernetes.io/projected/03db491d-5bca-46a1-a7df-9183c78b4ca7-kube-api-access-cdpsw\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:15.942816 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:15.942812    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-862c9\" (UniqueName: \"kubernetes.io/projected/e78fbeda-b75d-4538-b4a7-5e2b5d861e08-kube-api-access-862c9\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:16.476716 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.476676    2579 generic.go:356] "Generic (PLEG): container finished" podID="e78fbeda-b75d-4538-b4a7-5e2b5d861e08" containerID="26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f" exitCode=0
Aug 05 17:21:16.477139 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.476720    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"
Aug 05 17:21:16.477139 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.476762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5" event={"ID":"e78fbeda-b75d-4538-b4a7-5e2b5d861e08","Type":"ContainerDied","Data":"26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f"}
Aug 05 17:21:16.477139 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.476816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5" event={"ID":"e78fbeda-b75d-4538-b4a7-5e2b5d861e08","Type":"ContainerDied","Data":"07d05c09b24dc05b83a0a7767dc489de08b22efad95635f70585051e602ed496"}
Aug 05 17:21:16.477139 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.476841    2579 scope.go:117] "RemoveContainer" containerID="26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f"
Aug 05 17:21:16.478204 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.478059    2579 generic.go:356] "Generic (PLEG): container finished" podID="03db491d-5bca-46a1-a7df-9183c78b4ca7" containerID="750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961" exitCode=0
Aug 05 17:21:16.478204 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.478109    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"
Aug 05 17:21:16.478204 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.478150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw" event={"ID":"03db491d-5bca-46a1-a7df-9183c78b4ca7","Type":"ContainerDied","Data":"750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961"}
Aug 05 17:21:16.478204 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.478185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw" event={"ID":"03db491d-5bca-46a1-a7df-9183c78b4ca7","Type":"ContainerDied","Data":"544ddd3836fc3c09c61a9ebef833592f6509895307a1112ee8a9879ddb2690f7"}
Aug 05 17:21:16.486072 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.486057    2579 scope.go:117] "RemoveContainer" containerID="26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f"
Aug 05 17:21:16.486402 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:21:16.486375    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f\": container with ID starting with 26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f not found: ID does not exist" containerID="26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f"
Aug 05 17:21:16.486527 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.486410    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f"} err="failed to get container status \"26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f\": rpc error: code = NotFound desc = could not find container \"26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f\": container with ID starting with 26e9bfd1ebdbaf73bf75e83b859f4098284a69192c49e317fbd170280352a47f not found: ID does not exist"
Aug 05 17:21:16.486527 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.486435    2579 scope.go:117] "RemoveContainer" containerID="750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961"
Aug 05 17:21:16.494568 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.494551    2579 scope.go:117] "RemoveContainer" containerID="750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961"
Aug 05 17:21:16.494803 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:21:16.494788    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961\": container with ID starting with 750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961 not found: ID does not exist" containerID="750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961"
Aug 05 17:21:16.494849 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.494809    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961"} err="failed to get container status \"750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961\": rpc error: code = NotFound desc = could not find container \"750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961\": container with ID starting with 750fdd71acf1cd97d5b9399ce1e7ca94c45021cb4c2924e6d3f260660beed961 not found: ID does not exist"
Aug 05 17:21:16.504638 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.504618    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"]
Aug 05 17:21:16.508543 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.508525    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw"]
Aug 05 17:21:16.520376 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.520357    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"]
Aug 05 17:21:16.524270 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:16.524250    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5"]
Aug 05 17:21:17.188798 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:17.188763    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03db491d-5bca-46a1-a7df-9183c78b4ca7" path="/var/lib/kubelet/pods/03db491d-5bca-46a1-a7df-9183c78b4ca7/volumes"
Aug 05 17:21:17.189129 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:17.189115    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e78fbeda-b75d-4538-b4a7-5e2b5d861e08" path="/var/lib/kubelet/pods/e78fbeda-b75d-4538-b4a7-5e2b5d861e08/volumes"
Aug 05 17:21:19.435325 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:19.435298    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:21:19.444886 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:19.444864    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbkr7_92ab4d4b-a4a1-45dc-b762-e5a9fcf76197/ovn-acl-logging/0.log"
Aug 05 17:21:33.109135 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.109102    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"]
Aug 05 17:21:33.109597 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.109339    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt" podUID="435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" containerName="maas-api" containerID="cri-o://422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0" gracePeriod=30
Aug 05 17:21:33.191254 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.191225    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"]
Aug 05 17:21:33.191508 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.191465    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn" podUID="dda34de9-bc81-4f55-a617-e8ec86f82fd1" containerName="payload-processing" containerID="cri-o://43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8" gracePeriod=30
Aug 05 17:21:33.198205 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.198174    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"]
Aug 05 17:21:33.198538 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.198411    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp" podUID="464fceb2-39c8-42da-a50e-9418fe442d20" containerName="payload-pre-processing" containerID="cri-o://f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330" gracePeriod=30
Aug 05 17:21:33.451645 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.451619    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:21:33.499576 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.499551    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhk5q\" (UniqueName: \"kubernetes.io/projected/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-kube-api-access-hhk5q\") pod \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") "
Aug 05 17:21:33.499706 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.499641    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls\") pod \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") "
Aug 05 17:21:33.499803 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.499785    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-openshift-service-ca\") pod \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\" (UID: \"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3\") "
Aug 05 17:21:33.500249 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.500218    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" (UID: "435c1a18-634e-49ab-9fb3-1ce98b0e8ff3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:33.501870 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.501846    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-kube-api-access-hhk5q" (OuterVolumeSpecName: "kube-api-access-hhk5q") pod "435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" (UID: "435c1a18-634e-49ab-9fb3-1ce98b0e8ff3"). InnerVolumeSpecName "kube-api-access-hhk5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:33.502115 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.502094    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" (UID: "435c1a18-634e-49ab-9fb3-1ce98b0e8ff3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:21:33.506906 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.506882    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:21:33.512842 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.512827    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:21:33.571752 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.571721    2579 generic.go:356] "Generic (PLEG): container finished" podID="dda34de9-bc81-4f55-a617-e8ec86f82fd1" containerID="43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8" exitCode=0
Aug 05 17:21:33.571887 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.571755    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"
Aug 05 17:21:33.571887 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.571793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn" event={"ID":"dda34de9-bc81-4f55-a617-e8ec86f82fd1","Type":"ContainerDied","Data":"43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8"}
Aug 05 17:21:33.571887 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.571842    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn" event={"ID":"dda34de9-bc81-4f55-a617-e8ec86f82fd1","Type":"ContainerDied","Data":"8f0dabf7e984bb59a3781c631e3b0c52ce49818b740fae59540bcc4b05e3aa67"}
Aug 05 17:21:33.571887 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.571871    2579 scope.go:117] "RemoveContainer" containerID="43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8"
Aug 05 17:21:33.573200 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.573180    2579 generic.go:356] "Generic (PLEG): container finished" podID="464fceb2-39c8-42da-a50e-9418fe442d20" containerID="f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330" exitCode=0
Aug 05 17:21:33.573323 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.573239    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"
Aug 05 17:21:33.573323 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.573267    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp" event={"ID":"464fceb2-39c8-42da-a50e-9418fe442d20","Type":"ContainerDied","Data":"f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330"}
Aug 05 17:21:33.573323 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.573314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp" event={"ID":"464fceb2-39c8-42da-a50e-9418fe442d20","Type":"ContainerDied","Data":"a174963135927bc69bef02a242974eff929466fee7f27f0959e2f9be0c461890"}
Aug 05 17:21:33.574577 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.574553    2579 generic.go:356] "Generic (PLEG): container finished" podID="435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" containerID="422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0" exitCode=0
Aug 05 17:21:33.574694 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.574592    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"
Aug 05 17:21:33.574694 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.574632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt" event={"ID":"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3","Type":"ContainerDied","Data":"422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0"}
Aug 05 17:21:33.574694 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.574671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt" event={"ID":"435c1a18-634e-49ab-9fb3-1ce98b0e8ff3","Type":"ContainerDied","Data":"23fc7a21aa8287d7b52be78945aa7269b69e02792ece06ed2614c0d919ce2fa9"}
Aug 05 17:21:33.580809 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.580787    2579 scope.go:117] "RemoveContainer" containerID="43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8"
Aug 05 17:21:33.581064 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:21:33.581047    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8\": container with ID starting with 43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8 not found: ID does not exist" containerID="43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8"
Aug 05 17:21:33.581137 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.581072    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8"} err="failed to get container status \"43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8\": rpc error: code = NotFound desc = could not find container \"43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8\": container with ID starting with 43f5ee9619ab6cef6751b64461b1aad8de8cc63ab70b6fe600f513bfc53753d8 not found: ID does not exist"
Aug 05 17:21:33.581137 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.581087    2579 scope.go:117] "RemoveContainer" containerID="f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330"
Aug 05 17:21:33.588876 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.588856    2579 scope.go:117] "RemoveContainer" containerID="f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330"
Aug 05 17:21:33.589116 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:21:33.589097    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330\": container with ID starting with f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330 not found: ID does not exist" containerID="f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330"
Aug 05 17:21:33.589192 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.589121    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330"} err="failed to get container status \"f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330\": rpc error: code = NotFound desc = could not find container \"f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330\": container with ID starting with f89e05b081ed9e8bde226b89fb1e21f9a5cda91d82d0caad5cf59c5d5eb83330 not found: ID does not exist"
Aug 05 17:21:33.589192 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.589137    2579 scope.go:117] "RemoveContainer" containerID="422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0"
Aug 05 17:21:33.596375 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.596333    2579 scope.go:117] "RemoveContainer" containerID="422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0"
Aug 05 17:21:33.596659 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:21:33.596639    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0\": container with ID starting with 422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0 not found: ID does not exist" containerID="422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0"
Aug 05 17:21:33.596716 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.596665    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0"} err="failed to get container status \"422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0\": rpc error: code = NotFound desc = could not find container \"422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0\": container with ID starting with 422a7b3435c7049a07085468c073e837cca61e8853c1b4dfc3ecfb449e779fc0 not found: ID does not exist"
Aug 05 17:21:33.600966 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.600949    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94l65\" (UniqueName: \"kubernetes.io/projected/dda34de9-bc81-4f55-a617-e8ec86f82fd1-kube-api-access-94l65\") pod \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\" (UID: \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\") "
Aug 05 17:21:33.601053 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601010    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda34de9-bc81-4f55-a617-e8ec86f82fd1-plugins-config-volume\") pod \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\" (UID: \"dda34de9-bc81-4f55-a617-e8ec86f82fd1\") "
Aug 05 17:21:33.601177 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601164    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/464fceb2-39c8-42da-a50e-9418fe442d20-plugins-config-volume\") pod \"464fceb2-39c8-42da-a50e-9418fe442d20\" (UID: \"464fceb2-39c8-42da-a50e-9418fe442d20\") "
Aug 05 17:21:33.601240 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601224    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj7x5\" (UniqueName: \"kubernetes.io/projected/464fceb2-39c8-42da-a50e-9418fe442d20-kube-api-access-bj7x5\") pod \"464fceb2-39c8-42da-a50e-9418fe442d20\" (UID: \"464fceb2-39c8-42da-a50e-9418fe442d20\") "
Aug 05 17:21:33.601426 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dda34de9-bc81-4f55-a617-e8ec86f82fd1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dda34de9-bc81-4f55-a617-e8ec86f82fd1" (UID: "dda34de9-bc81-4f55-a617-e8ec86f82fd1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:33.601572 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601551    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:33.601651 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601574    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:33.601651 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601588    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda34de9-bc81-4f55-a617-e8ec86f82fd1-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:33.601651 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601602    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhk5q\" (UniqueName: \"kubernetes.io/projected/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3-kube-api-access-hhk5q\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:33.601651 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.601553    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/464fceb2-39c8-42da-a50e-9418fe442d20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "464fceb2-39c8-42da-a50e-9418fe442d20" (UID: "464fceb2-39c8-42da-a50e-9418fe442d20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:33.602938 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.602909    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda34de9-bc81-4f55-a617-e8ec86f82fd1-kube-api-access-94l65" (OuterVolumeSpecName: "kube-api-access-94l65") pod "dda34de9-bc81-4f55-a617-e8ec86f82fd1" (UID: "dda34de9-bc81-4f55-a617-e8ec86f82fd1"). InnerVolumeSpecName "kube-api-access-94l65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:33.603164 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.603150    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/464fceb2-39c8-42da-a50e-9418fe442d20-kube-api-access-bj7x5" (OuterVolumeSpecName: "kube-api-access-bj7x5") pod "464fceb2-39c8-42da-a50e-9418fe442d20" (UID: "464fceb2-39c8-42da-a50e-9418fe442d20"). InnerVolumeSpecName "kube-api-access-bj7x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:33.637890 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.637834    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"]
Aug 05 17:21:33.643760 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.643738    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-02b433-84dfc94f4-srjmt"]
Aug 05 17:21:33.702882 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.702860    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj7x5\" (UniqueName: \"kubernetes.io/projected/464fceb2-39c8-42da-a50e-9418fe442d20-kube-api-access-bj7x5\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:33.702882 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.702880    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94l65\" (UniqueName: \"kubernetes.io/projected/dda34de9-bc81-4f55-a617-e8ec86f82fd1-kube-api-access-94l65\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:33.703002 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.702889    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/464fceb2-39c8-42da-a50e-9418fe442d20-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:33.898905 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.898840    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"]
Aug 05 17:21:33.905035 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.904993    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn"]
Aug 05 17:21:33.917571 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.917550    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"]
Aug 05 17:21:33.924547 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:33.924522    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp"]
Aug 05 17:21:35.189547 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:35.189514    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" path="/var/lib/kubelet/pods/435c1a18-634e-49ab-9fb3-1ce98b0e8ff3/volumes"
Aug 05 17:21:35.190036 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:35.190008    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="464fceb2-39c8-42da-a50e-9418fe442d20" path="/var/lib/kubelet/pods/464fceb2-39c8-42da-a50e-9418fe442d20/volumes"
Aug 05 17:21:35.190410 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:35.190391    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda34de9-bc81-4f55-a617-e8ec86f82fd1" path="/var/lib/kubelet/pods/dda34de9-bc81-4f55-a617-e8ec86f82fd1/volumes"
Aug 05 17:21:50.944981 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:50.944944    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"]
Aug 05 17:21:50.945530 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:50.945214    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt" podUID="330fd7b3-2b2d-43f0-8fbc-581390e5330a" containerName="maas-api" containerID="cri-o://1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c" gracePeriod=30
Aug 05 17:21:51.007291 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.007258    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"]
Aug 05 17:21:51.007559 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.007514    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn" podUID="5e5db8fc-f683-4f9c-965a-3ce6ad663333" containerName="payload-processing" containerID="cri-o://23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137" gracePeriod=30
Aug 05 17:21:51.268746 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.268719    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:21:51.288805 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.288782    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:21:51.370320 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.370291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5db8fc-f683-4f9c-965a-3ce6ad663333-plugins-config-volume\") pod \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\" (UID: \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\") "
Aug 05 17:21:51.370320 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.370325    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r64j\" (UniqueName: \"kubernetes.io/projected/330fd7b3-2b2d-43f0-8fbc-581390e5330a-kube-api-access-2r64j\") pod \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") "
Aug 05 17:21:51.370550 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.370534    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gglxt\" (UniqueName: \"kubernetes.io/projected/5e5db8fc-f683-4f9c-965a-3ce6ad663333-kube-api-access-gglxt\") pod \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\" (UID: \"5e5db8fc-f683-4f9c-965a-3ce6ad663333\") "
Aug 05 17:21:51.370612 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.370574    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/330fd7b3-2b2d-43f0-8fbc-581390e5330a-openshift-service-ca\") pod \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") "
Aug 05 17:21:51.370693 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.370661    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e5db8fc-f683-4f9c-965a-3ce6ad663333-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e5db8fc-f683-4f9c-965a-3ce6ad663333" (UID: "5e5db8fc-f683-4f9c-965a-3ce6ad663333"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:51.370693 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.370671    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls\") pod \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\" (UID: \"330fd7b3-2b2d-43f0-8fbc-581390e5330a\") "
Aug 05 17:21:51.370956 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.370936    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330fd7b3-2b2d-43f0-8fbc-581390e5330a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "330fd7b3-2b2d-43f0-8fbc-581390e5330a" (UID: "330fd7b3-2b2d-43f0-8fbc-581390e5330a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:51.371105 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.371089    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/330fd7b3-2b2d-43f0-8fbc-581390e5330a-openshift-service-ca\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:51.371173 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.371105    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5db8fc-f683-4f9c-965a-3ce6ad663333-plugins-config-volume\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:51.372419 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.372388    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/330fd7b3-2b2d-43f0-8fbc-581390e5330a-kube-api-access-2r64j" (OuterVolumeSpecName: "kube-api-access-2r64j") pod "330fd7b3-2b2d-43f0-8fbc-581390e5330a" (UID: "330fd7b3-2b2d-43f0-8fbc-581390e5330a"). InnerVolumeSpecName "kube-api-access-2r64j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:51.372520 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.372505    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e5db8fc-f683-4f9c-965a-3ce6ad663333-kube-api-access-gglxt" (OuterVolumeSpecName: "kube-api-access-gglxt") pod "5e5db8fc-f683-4f9c-965a-3ce6ad663333" (UID: "5e5db8fc-f683-4f9c-965a-3ce6ad663333"). InnerVolumeSpecName "kube-api-access-gglxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:51.372520 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.372507    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "330fd7b3-2b2d-43f0-8fbc-581390e5330a" (UID: "330fd7b3-2b2d-43f0-8fbc-581390e5330a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:21:51.472004 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.471938    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/330fd7b3-2b2d-43f0-8fbc-581390e5330a-maas-api-tls\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:51.472004 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.471960    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r64j\" (UniqueName: \"kubernetes.io/projected/330fd7b3-2b2d-43f0-8fbc-581390e5330a-kube-api-access-2r64j\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:51.472004 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.471970    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gglxt\" (UniqueName: \"kubernetes.io/projected/5e5db8fc-f683-4f9c-965a-3ce6ad663333-kube-api-access-gglxt\") on node \"ip-10-0-133-70.ec2.internal\" DevicePath \"\""
Aug 05 17:21:51.664999 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.664966    2579 generic.go:356] "Generic (PLEG): container finished" podID="330fd7b3-2b2d-43f0-8fbc-581390e5330a" containerID="1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c" exitCode=0
Aug 05 17:21:51.665165 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.665016    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"
Aug 05 17:21:51.665165 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.665050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt" event={"ID":"330fd7b3-2b2d-43f0-8fbc-581390e5330a","Type":"ContainerDied","Data":"1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c"}
Aug 05 17:21:51.665165 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.665109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt" event={"ID":"330fd7b3-2b2d-43f0-8fbc-581390e5330a","Type":"ContainerDied","Data":"23276680f152b593bcd766d1535098932bd9121fa57e6c17da4ace299603b747"}
Aug 05 17:21:51.665165 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.665141    2579 scope.go:117] "RemoveContainer" containerID="1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c"
Aug 05 17:21:51.666383 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.666340    2579 generic.go:356] "Generic (PLEG): container finished" podID="5e5db8fc-f683-4f9c-965a-3ce6ad663333" containerID="23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137" exitCode=0
Aug 05 17:21:51.666490 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.666399    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"
Aug 05 17:21:51.666490 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.666445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn" event={"ID":"5e5db8fc-f683-4f9c-965a-3ce6ad663333","Type":"ContainerDied","Data":"23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137"}
Aug 05 17:21:51.666490 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.666485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn" event={"ID":"5e5db8fc-f683-4f9c-965a-3ce6ad663333","Type":"ContainerDied","Data":"e4dfa350f3f061a9d5a051abe55165d0b78a1778855df51f7775a949227c3277"}
Aug 05 17:21:51.677918 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.677662    2579 scope.go:117] "RemoveContainer" containerID="1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c"
Aug 05 17:21:51.678262 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:21:51.678236    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c\": container with ID starting with 1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c not found: ID does not exist" containerID="1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c"
Aug 05 17:21:51.678386 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.678272    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c"} err="failed to get container status \"1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c\": rpc error: code = NotFound desc = could not find container \"1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c\": container with ID starting with 1500ee3178d81f583eb90d1cfe7dddda79707bd0490bd93b3b3af7601dab2f5c not found: ID does not exist"
Aug 05 17:21:51.678386 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.678296    2579 scope.go:117] "RemoveContainer" containerID="23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137"
Aug 05 17:21:51.686646 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.686632    2579 scope.go:117] "RemoveContainer" containerID="23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137"
Aug 05 17:21:51.686890 ip-10-0-133-70 kubenswrapper[2579]: E0805 17:21:51.686869    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137\": container with ID starting with 23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137 not found: ID does not exist" containerID="23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137"
Aug 05 17:21:51.686957 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.686900    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137"} err="failed to get container status \"23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137\": rpc error: code = NotFound desc = could not find container \"23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137\": container with ID starting with 23e0795f90b7010a4cfc3a70f90206d81896d2e0ce42dff7d52096f595d1b137 not found: ID does not exist"
Aug 05 17:21:51.692663 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.692639    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"]
Aug 05 17:21:51.699414 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.699394    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-46e6bf-5cc75d9454-h6qdt"]
Aug 05 17:21:51.711543 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.711523    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"]
Aug 05 17:21:51.718296 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:51.718275    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn"]
Aug 05 17:21:53.188716 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:53.188682    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="330fd7b3-2b2d-43f0-8fbc-581390e5330a" path="/var/lib/kubelet/pods/330fd7b3-2b2d-43f0-8fbc-581390e5330a/volumes"
Aug 05 17:21:53.189075 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:21:53.189036    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e5db8fc-f683-4f9c-965a-3ce6ad663333" path="/var/lib/kubelet/pods/5e5db8fc-f683-4f9c-965a-3ce6ad663333/volumes"
Aug 05 17:22:03.858396 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:03.858362    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7764f5fb7b-mppdg_8328252f-6ff8-4b4b-8524-f6d08d4520c8/manager/0.log"
Aug 05 17:22:04.316999 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:04.316972    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9778877d8-rdz48_cb18316d-cafd-4441-bbdb-b7aa719a4d44/copy-manifests/0.log"
Aug 05 17:22:04.329640 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:04.329618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9778877d8-rdz48_cb18316d-cafd-4441-bbdb-b7aa719a4d44/manager/0.log"
Aug 05 17:22:04.774784 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:04.774755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7c9cd88448-cg9g2_ac190872-b17a-4648-9b2e-998344221a91/maas-api/0.log"
Aug 05 17:22:05.196415 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:05.196389    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-7vcxp_04afc8d1-0e08-4128-ac59-18d36484c2f5/postgres/0.log"
Aug 05 17:22:06.249793 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:06.249764    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-vlq99_24b6f1ac-59d0-4d3e-bf78-da21387bdc33/kuadrant-console-plugin/0.log"
Aug 05 17:22:07.263667 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:07.263642    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f6d6f675-rqjgd_3476ed57-c461-47e2-b3c4-82526b6aa45b/kube-auth-proxy/0.log"
Aug 05 17:22:07.498847 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:07.498818    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-g467b_fceeaf1f-afc2-4488-9b8e-da65f5d7c100/payload-pre-processing/0.log"
Aug 05 17:22:07.606310 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:07.606236    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-x5xxr_8c133297-2e88-47bb-9524-b3d6fd175987/payload-processing/0.log"
Aug 05 17:22:08.043275 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:08.043247    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-47rpt_185fd475-274f-4fee-981a-b3ded3954d6a/main/0.log"
Aug 05 17:22:08.473800 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:08.473775    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7kwfl_c91dec94-2c59-40df-afb0-72120ff5a7e7/main/0.log"
Aug 05 17:22:16.970910 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:16.970852    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gzhh7_1f760ce6-beba-4e85-88b4-cd8b33410e66/global-pull-secret-syncer/0.log"
Aug 05 17:22:17.244451 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:17.244363    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ngdgn_2808e440-611f-4111-b468-a34f18b5f32f/konnectivity-agent/0.log"
Aug 05 17:22:17.396681 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:17.396656    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-70.ec2.internal_ec80920c6181151ca83a615f0c6f4f91/haproxy/0.log"
Aug 05 17:22:22.241271 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:22.241243    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-vlq99_24b6f1ac-59d0-4d3e-bf78-da21387bdc33/kuadrant-console-plugin/0.log"
Aug 05 17:22:23.985134 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:23.985102    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96888ca6-cada-4716-b00f-2e332b838a79/alertmanager/0.log"
Aug 05 17:22:24.010910 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.010888    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96888ca6-cada-4716-b00f-2e332b838a79/config-reloader/0.log"
Aug 05 17:22:24.036751 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.036727    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96888ca6-cada-4716-b00f-2e332b838a79/kube-rbac-proxy-web/0.log"
Aug 05 17:22:24.070181 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.070160    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96888ca6-cada-4716-b00f-2e332b838a79/kube-rbac-proxy/0.log"
Aug 05 17:22:24.100369 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.100334    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96888ca6-cada-4716-b00f-2e332b838a79/kube-rbac-proxy-metric/0.log"
Aug 05 17:22:24.146179 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.146160    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96888ca6-cada-4716-b00f-2e332b838a79/prom-label-proxy/0.log"
Aug 05 17:22:24.183449 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.183432    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96888ca6-cada-4716-b00f-2e332b838a79/init-config-reloader/0.log"
Aug 05 17:22:24.234295 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.234278    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-445dx_e9520ecb-d16e-4d30-95bd-1c10d571ec9a/cluster-monitoring-operator/0.log"
Aug 05 17:22:24.265527 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.265472    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-s8gdb_12277e02-790b-453f-85c9-773191c0207a/kube-state-metrics/0.log"
Aug 05 17:22:24.289096 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.289079    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-s8gdb_12277e02-790b-453f-85c9-773191c0207a/kube-rbac-proxy-main/0.log"
Aug 05 17:22:24.316410 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.316391    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-s8gdb_12277e02-790b-453f-85c9-773191c0207a/kube-rbac-proxy-self/0.log"
Aug 05 17:22:24.353904 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.353885    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68975f9ffc-9d55f_a03fa4f1-d2fa-4a2a-9aa1-8450184e746b/metrics-server/0.log"
Aug 05 17:22:24.388187 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.388163    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-p78cq_ae5a402d-47c1-4c74-aa8b-89deff924ac8/monitoring-plugin/0.log"
Aug 05 17:22:24.532962 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.532916    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p8vjf_083e4000-6959-4c24-af8c-da79a472185b/node-exporter/0.log"
Aug 05 17:22:24.561821 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.561803    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p8vjf_083e4000-6959-4c24-af8c-da79a472185b/kube-rbac-proxy/0.log"
Aug 05 17:22:24.600630 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.600611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p8vjf_083e4000-6959-4c24-af8c-da79a472185b/init-textfile/0.log"
Aug 05 17:22:24.816400 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.816307    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6ab1825-4475-4acb-b329-1a9e592463c1/prometheus/0.log"
Aug 05 17:22:24.843538 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.843508    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6ab1825-4475-4acb-b329-1a9e592463c1/config-reloader/0.log"
Aug 05 17:22:24.872935 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.872915    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6ab1825-4475-4acb-b329-1a9e592463c1/thanos-sidecar/0.log"
Aug 05 17:22:24.899163 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.899137    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6ab1825-4475-4acb-b329-1a9e592463c1/kube-rbac-proxy-web/0.log"
Aug 05 17:22:24.926646 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.926619    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6ab1825-4475-4acb-b329-1a9e592463c1/kube-rbac-proxy/0.log"
Aug 05 17:22:24.954981 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.954962    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6ab1825-4475-4acb-b329-1a9e592463c1/kube-rbac-proxy-thanos/0.log"
Aug 05 17:22:24.986619 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:24.986599    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6ab1825-4475-4acb-b329-1a9e592463c1/init-config-reloader/0.log"
Aug 05 17:22:25.140392 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:25.140324    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f796fc9f9-75ccq_01565972-f35a-4332-8408-34ff199fa5d7/telemeter-client/0.log"
Aug 05 17:22:25.176919 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:25.176892    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f796fc9f9-75ccq_01565972-f35a-4332-8408-34ff199fa5d7/reload/0.log"
Aug 05 17:22:25.216752 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:25.216731    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f796fc9f9-75ccq_01565972-f35a-4332-8408-34ff199fa5d7/kube-rbac-proxy/0.log"
Aug 05 17:22:27.013463 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013435    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"]
Aug 05 17:22:27.013807 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013786    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330fd7b3-2b2d-43f0-8fbc-581390e5330a" containerName="maas-api"
Aug 05 17:22:27.013807 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013796    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="330fd7b3-2b2d-43f0-8fbc-581390e5330a" containerName="maas-api"
Aug 05 17:22:27.013807 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013804    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8" containerName="payload-pre-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013810    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8" containerName="payload-pre-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013819    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" containerName="maas-api"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013824    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" containerName="maas-api"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013841    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda34de9-bc81-4f55-a617-e8ec86f82fd1" containerName="payload-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013846    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda34de9-bc81-4f55-a617-e8ec86f82fd1" containerName="payload-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013852    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e78fbeda-b75d-4538-b4a7-5e2b5d861e08" containerName="payload-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013857    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e78fbeda-b75d-4538-b4a7-5e2b5d861e08" containerName="payload-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013869    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5db8fc-f683-4f9c-965a-3ce6ad663333" containerName="payload-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013875    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5db8fc-f683-4f9c-965a-3ce6ad663333" containerName="payload-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013884    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03db491d-5bca-46a1-a7df-9183c78b4ca7" containerName="payload-pre-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013889    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="03db491d-5bca-46a1-a7df-9183c78b4ca7" containerName="payload-pre-processing"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013895    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be9190c9-19e4-4be5-8bc3-3cda1a416563" containerName="maas-api"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013899    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be9190c9-19e4-4be5-8bc3-3cda1a416563" containerName="maas-api"
Aug 05 17:22:27.013914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013911    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a254087e-f0b2-40e2-a66d-35b1d5aebd17" containerName="payload-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013920    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a254087e-f0b2-40e2-a66d-35b1d5aebd17" containerName="payload-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013932    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="464fceb2-39c8-42da-a50e-9418fe442d20" containerName="payload-pre-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013937    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="464fceb2-39c8-42da-a50e-9418fe442d20" containerName="payload-pre-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.013992    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e5db8fc-f683-4f9c-965a-3ce6ad663333" containerName="payload-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014004    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="464fceb2-39c8-42da-a50e-9418fe442d20" containerName="payload-pre-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014012    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dda34de9-bc81-4f55-a617-e8ec86f82fd1" containerName="payload-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014019    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="330fd7b3-2b2d-43f0-8fbc-581390e5330a" containerName="maas-api"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014025    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a254087e-f0b2-40e2-a66d-35b1d5aebd17" containerName="payload-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014033    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="435c1a18-634e-49ab-9fb3-1ce98b0e8ff3" containerName="maas-api"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014039    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e78fbeda-b75d-4538-b4a7-5e2b5d861e08" containerName="payload-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014044    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ee1f06-20c7-417f-bf4f-b71f2eecdfc8" containerName="payload-pre-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014051    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="03db491d-5bca-46a1-a7df-9183c78b4ca7" containerName="payload-pre-processing"
Aug 05 17:22:27.014368 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.014056    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be9190c9-19e4-4be5-8bc3-3cda1a416563" containerName="maas-api"
Aug 05 17:22:27.018948 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.018929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.021793 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.021771    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjxd8\"/\"kube-root-ca.crt\""
Aug 05 17:22:27.022973 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.022950    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjxd8\"/\"openshift-service-ca.crt\""
Aug 05 17:22:27.023066 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.022957    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjxd8\"/\"default-dockercfg-mnzst\""
Aug 05 17:22:27.028482 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.028462    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"]
Aug 05 17:22:27.089133 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.089102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-podres\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.089133 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.089137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-proc\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.089320 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.089230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-sys\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.089320 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.089266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-lib-modules\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.089320 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.089308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trxrn\" (UniqueName: \"kubernetes.io/projected/6e1e09c3-165a-461e-a6ad-026049b6d782-kube-api-access-trxrn\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.191023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trxrn\" (UniqueName: \"kubernetes.io/projected/6e1e09c3-165a-461e-a6ad-026049b6d782-kube-api-access-trxrn\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.191143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-podres\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.191183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-proc\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.191247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-sys\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.191284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-lib-modules\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.191593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-lib-modules\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.191997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-podres\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.192064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-proc\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.192589 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.192127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e1e09c3-165a-461e-a6ad-026049b6d782-sys\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.202244 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.202215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trxrn\" (UniqueName: \"kubernetes.io/projected/6e1e09c3-165a-461e-a6ad-026049b6d782-kube-api-access-trxrn\") pod \"perf-node-gather-daemonset-jgkdm\" (UID: \"6e1e09c3-165a-461e-a6ad-026049b6d782\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.330171 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.330103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.465340 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.465316    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"]
Aug 05 17:22:27.467880 ip-10-0-133-70 kubenswrapper[2579]: W0805 17:22:27.467852    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6e1e09c3_165a_461e_a6ad_026049b6d782.slice/crio-bb28531179feaae7651d67f40ef3ef7dad777c060da5560517949fe4b1adbfee WatchSource:0}: Error finding container bb28531179feaae7651d67f40ef3ef7dad777c060da5560517949fe4b1adbfee: Status 404 returned error can't find the container with id bb28531179feaae7651d67f40ef3ef7dad777c060da5560517949fe4b1adbfee
Aug 05 17:22:27.844882 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.844844    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm" event={"ID":"6e1e09c3-165a-461e-a6ad-026049b6d782","Type":"ContainerStarted","Data":"82c62a96d03d73b74b40551c97fa2355aaa3040ac419820bcc4963a136cf7875"}
Aug 05 17:22:27.845054 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.844905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm" event={"ID":"6e1e09c3-165a-461e-a6ad-026049b6d782","Type":"ContainerStarted","Data":"bb28531179feaae7651d67f40ef3ef7dad777c060da5560517949fe4b1adbfee"}
Aug 05 17:22:27.845054 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.844933    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:27.884221 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:27.884174    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm" podStartSLOduration=1.884156018 podStartE2EDuration="1.884156018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:27.883727881 +0000 UTC m=+3669.219525826" watchObservedRunningTime="2026-08-05 17:22:27.884156018 +0000 UTC m=+3669.219953963"
Aug 05 17:22:28.067147 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:28.067115    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-hhkgn_96d3242f-c007-4890-92de-1a9aa935f287/download-server/0.log"
Aug 05 17:22:29.802883 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:29.802856    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hz9xq_d0a65919-baf3-43b4-a28a-2b9e0a8f85f5/dns/0.log"
Aug 05 17:22:29.827515 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:29.827492    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hz9xq_d0a65919-baf3-43b4-a28a-2b9e0a8f85f5/kube-rbac-proxy/0.log"
Aug 05 17:22:29.903551 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:29.903526    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7pkr_c329924c-ec37-43dc-8e22-088c197381ea/dns-node-resolver/0.log"
Aug 05 17:22:30.551151 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:30.551119    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gbfjb_5bebfabf-dc9a-4acd-9ed6-0f6663195f74/node-ca/0.log"
Aug 05 17:22:31.716976 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:31.716946    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f6d6f675-rqjgd_3476ed57-c461-47e2-b3c4-82526b6aa45b/kube-auth-proxy/0.log"
Aug 05 17:22:31.797914 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:31.797880    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-g467b_fceeaf1f-afc2-4488-9b8e-da65f5d7c100/payload-pre-processing/0.log"
Aug 05 17:22:31.831043 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:31.831024    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-x5xxr_8c133297-2e88-47bb-9524-b3d6fd175987/payload-processing/0.log"
Aug 05 17:22:32.707096 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:32.707071    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8h86p_12eb06cb-2535-4f84-9367-fa5191f444dc/serve-healthcheck-canary/0.log"
Aug 05 17:22:33.252289 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:33.252249    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bpnrc_a77f5879-0acc-4a4f-8202-6f1a0cf29b88/kube-rbac-proxy/0.log"
Aug 05 17:22:33.279298 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:33.279271    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bpnrc_a77f5879-0acc-4a4f-8202-6f1a0cf29b88/exporter/0.log"
Aug 05 17:22:33.306910 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:33.306886    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bpnrc_a77f5879-0acc-4a4f-8202-6f1a0cf29b88/extractor/0.log"
Aug 05 17:22:33.860118 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:33.860093    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-jgkdm"
Aug 05 17:22:36.291463 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:36.291421    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7764f5fb7b-mppdg_8328252f-6ff8-4b4b-8524-f6d08d4520c8/manager/0.log"
Aug 05 17:22:36.545762 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:36.545660    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9778877d8-rdz48_cb18316d-cafd-4441-bbdb-b7aa719a4d44/manager/0.log"
Aug 05 17:22:36.565661 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:36.565635    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9778877d8-rdz48_cb18316d-cafd-4441-bbdb-b7aa719a4d44/copy-manifests/0.log"
Aug 05 17:22:37.874619 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:37.874588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6677bbd944-6fns9_5f1e34e4-d7bd-4ee6-8976-dcb8636f2bab/manager/0.log"
Aug 05 17:22:38.002938 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:38.002912    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f6d6f675-rqjgd_3476ed57-c461-47e2-b3c4-82526b6aa45b/kube-auth-proxy/0.log"
Aug 05 17:22:38.082946 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:38.082922    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-g467b_fceeaf1f-afc2-4488-9b8e-da65f5d7c100/payload-pre-processing/0.log"
Aug 05 17:22:38.107264 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:38.107243    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-x5xxr_8c133297-2e88-47bb-9524-b3d6fd175987/payload-processing/0.log"
Aug 05 17:22:39.707567 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:39.707537    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f6d6f675-rqjgd_3476ed57-c461-47e2-b3c4-82526b6aa45b/kube-auth-proxy/0.log"
Aug 05 17:22:39.785853 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:39.785822    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-g467b_fceeaf1f-afc2-4488-9b8e-da65f5d7c100/payload-pre-processing/0.log"
Aug 05 17:22:39.809270 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:39.809248    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-x5xxr_8c133297-2e88-47bb-9524-b3d6fd175987/payload-processing/0.log"
Aug 05 17:22:42.961486 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:42.961461    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-zrt74_ded1f5c2-630e-474e-a537-fe7b0b0a0042/migrator/0.log"
Aug 05 17:22:42.987871 ip-10-0-133-70 kubenswrapper[2579]: I0805 17:22:42.987842    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-zrt74_ded1f5c2-630e-474e-a537-fe7b0b0a0042/graceful-termination/0.log"