Aug 04 17:46:44.403334 ip-10-0-140-41 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 17:46:44.783634 ip-10-0-140-41 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:44.783634 ip-10-0-140-41 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 17:46:44.783634 ip-10-0-140-41 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:44.783634 ip-10-0-140-41 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 17:46:44.783634 ip-10-0-140-41 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 17:46:44.784193 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.783693    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 17:46:44.789477 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789446    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:44.789620 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789605    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789622    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789627    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789632    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789636    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789640    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789645    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789650    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789654    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789658    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:44.789660 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789662    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789667    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789671    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789675    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789679    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789683    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789687    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789691    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789695    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789700    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789703    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789707    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789713    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789719    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789724    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789728    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789731    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789736    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789740    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:44.789905 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789744    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789748    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789753    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789757    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789761    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789764    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789766    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789769    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789771    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789774    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789776    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789779    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789781    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789783    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789786    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789789    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789792    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789794    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789797    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789801    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:44.790358 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789803    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789806    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789809    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789811    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789813    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789818    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789820    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789823    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789826    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789828    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789831    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789833    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789836    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789838    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789841    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789843    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789847    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789851    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789855    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:44.790831 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789858    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789861    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789863    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789866    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789869    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789871    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789874    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789876    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789881    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789884    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789887    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789890    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789893    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789896    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789900    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789903    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789906    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789908    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789911    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789914    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:44.791283 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789916    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789919    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789921    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789924    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789926    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789929    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789931    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789934    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789936    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.789939    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790647    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790655    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790658    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790661    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790665    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790668    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790670    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790673    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790676    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:44.791764 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790678    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790683    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790686    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790688    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790691    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790694    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790696    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790701    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790704    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790708    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790710    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790713    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790716    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790719    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790722    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790725    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790727    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790731    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790734    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790736    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:44.792218 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790739    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790741    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790744    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790746    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790749    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790751    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790754    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790757    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790759    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790761    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790764    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790766    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790768    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790772    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790774    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790777    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790780    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790782    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790785    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790787    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:44.792692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790790    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790793    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790796    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790798    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790800    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790803    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790805    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790809    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790811    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790814    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790816    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790819    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790821    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790824    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790826    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790829    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790831    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790834    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790837    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790839    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:44.793179 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790842    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790846    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790849    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790853    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790856    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790859    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790862    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790864    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790867    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790869    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790871    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790874    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790876    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790879    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790882    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790884    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790887    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790889    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790892    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:44.793665 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790894    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790896    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790899    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790902    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790905    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790909    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790912    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790915    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790917    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790920    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.790923    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791325    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791332    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791334    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791337    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791340    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791343    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791346    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791349    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:44.794239 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791351    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791354    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791357    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791359    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791362    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791364    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791367    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791370    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791373    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791375    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791378    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791380    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791382    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791385    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791388    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791390    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791393    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791396    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791398    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791401    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:44.794682 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791403    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791406    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791408    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791410    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791413    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791415    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791418    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791420    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791422    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791425    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791427    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791430    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791433    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791435    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791438    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791440    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791443    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791447    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791450    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791453    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:44.795151 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791456    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791459    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791461    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791464    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791466    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791469    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791471    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791473    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791476    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791479    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791481    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791484    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791486    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791490    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791493    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791496    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791499    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791501    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791504    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:44.795669 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791507    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791510    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791513    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791516    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791519    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791521    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791524    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791526    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791528    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791531    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791533    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791536    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791539    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791541    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791543    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791546    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791549    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791551    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791553    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791556    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:44.796126 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791558    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791561    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791564    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791566    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791568    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791571    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791573    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791576    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791578    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791580    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791584    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.791588    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791658    2565 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791667    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791678    2565 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791684    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791690    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791695    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791704    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791708    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791711    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 17:46:44.796594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791714    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791718    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791721    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791724    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791727    2565 flags.go:64] FLAG: --cgroup-root=""
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791730    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791733    2565 flags.go:64] FLAG: --client-ca-file=""
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791736    2565 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791739    2565 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791743    2565 flags.go:64] FLAG: --cluster-domain=""
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791746    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791749    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791752    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791755    2565 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791759    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791761    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791764    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791767    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791770    2565 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791773    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791776    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791783    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791786    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791791    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 17:46:44.797129 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791794    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791797    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791799    2565 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791802    2565 flags.go:64] FLAG: --enable-server="true"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791805    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791810    2565 flags.go:64] FLAG: --event-burst="100"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791813    2565 flags.go:64] FLAG: --event-qps="50"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791815    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791818    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791821    2565 flags.go:64] FLAG: --eviction-hard=""
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791825    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791828    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791831    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791834    2565 flags.go:64] FLAG: --eviction-soft=""
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791837    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791839    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791843    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791846    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791848    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791851    2565 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791854    2565 flags.go:64] FLAG: --feature-gates=""
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791858    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791861    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791864    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791867    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791870    2565 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 17:46:44.797686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791872    2565 flags.go:64] FLAG: --help="false"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791875    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-140-41.ec2.internal"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791878    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791882    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791885    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791889    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791892    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791895    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791898    2565 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791901    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791903    2565 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791906    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791909    2565 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791912    2565 flags.go:64] FLAG: --kube-reserved=""
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791915    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791917    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791920    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791923    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791926    2565 flags.go:64] FLAG: --lock-file=""
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791928    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791931    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791934    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791939    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 17:46:44.798771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791942    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791945    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791947    2565 flags.go:64] FLAG: --logging-format="text"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791950    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791953    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791956    2565 flags.go:64] FLAG: --manifest-url=""
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791958    2565 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791962    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791965    2565 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791969    2565 flags.go:64] FLAG: --max-pods="110"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791972    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791975    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791979    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791982    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791986    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791989    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791992    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.791999    2565 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792002    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792005    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792008    2565 flags.go:64] FLAG: --pod-cidr=""
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792010    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792015    2565 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792018    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 17:46:44.799725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792021    2565 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792024    2565 flags.go:64] FLAG: --port="10250"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792027    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792029    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f54cb5cd647ec3b0"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792033    2565 flags.go:64] FLAG: --qos-reserved=""
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792035    2565 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792038    2565 flags.go:64] FLAG: --register-node="true"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792041    2565 flags.go:64] FLAG: --register-with-taints=""
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792049    2565 flags.go:64] FLAG: --registry-burst="10"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792052    2565 flags.go:64] FLAG: --registry-qps="5"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792055    2565 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792058    2565 flags.go:64] FLAG: --reserved-memory=""
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792074    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792078    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792081    2565 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792083    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792086    2565 flags.go:64] FLAG: --runonce="false"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792089    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792092    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792095    2565 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792097    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792101    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792105    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792108    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792111    2565 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792114    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 17:46:44.800734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792117    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792119    2565 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792122    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792125    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792128    2565 flags.go:64] FLAG: --system-cgroups=""
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792130    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792136    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792138    2565 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792141    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792145    2565 flags.go:64] FLAG: --tls-min-version=""
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792147    2565 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792150    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792153    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792155    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792158    2565 flags.go:64] FLAG: --v="2"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792162    2565 flags.go:64] FLAG: --version="false"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792166    2565 flags.go:64] FLAG: --vmodule=""
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792169    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.792172    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792289    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792294    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792297    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792300    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792303    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:44.801691 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792306    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792308    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792311    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792316    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792321    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792324    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792327    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792330    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792333    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792336    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792339    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792342    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792344    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792347    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792350    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792352    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792355    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792357    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792360    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:44.802692 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792362    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792365    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792368    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792370    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792373    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792375    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792378    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792380    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792383    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792385    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792388    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792390    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792393    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792395    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792398    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792400    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792404    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792408    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792411    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792413    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:44.803434 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792416    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792418    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792421    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792424    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792426    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792429    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792431    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792433    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792436    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792438    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792441    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792443    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792446    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792448    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792451    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792453    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792456    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792458    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792460    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792463    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:44.804026 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792465    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792468    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792470    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792473    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792475    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792478    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792480    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792482    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792486    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792492    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792495    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792498    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792501    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792504    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792507    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792510    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792513    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792516    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792519    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:44.804576 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792521    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792524    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792526    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792529    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792531    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792533    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792536    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792538    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792541    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792543    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792546    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792549    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792551    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792554    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792557    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:44.805021 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.792559    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.793214    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.799942    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.799960    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.799984    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.799997    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800095    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800104    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800108    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800112    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800117    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800121    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800125    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800129    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800133    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:44.805470 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800138    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800142    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800147    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800151    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800156    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800160    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800164    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800168    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800174    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800180    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800185    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800190    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800194    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800199    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800203    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800209    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800214    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800218    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800222    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800226    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:44.805837 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800231    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800236    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800240    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800244    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800248    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800253    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800257    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800262    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800266    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800270    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800274    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800279    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800283    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800286    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800290    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800294    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800299    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800303    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800309    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:44.806466 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800314    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800318    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800323    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800327    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800331    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800336    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800340    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800345    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800349    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800359    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800363    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800367    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800371    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800376    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800381    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800385    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800389    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800393    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800397    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:44.806940 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800401    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800406    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800410    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800415    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800419    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800423    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800428    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800432    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800436    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800440    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800444    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800449    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800453    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800456    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800461    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800465    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800469    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800473    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800477    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800481    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:44.807443 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800486    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800490    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800494    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800498    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800503    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800507    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800512    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800516    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800520    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800524    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800528    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800534    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.800543    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800722    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800729    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 17:46:44.808268 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800733    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800738    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800742    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800746    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800750    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800755    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800759    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800763    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800767    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800771    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800776    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800780    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800784    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800788    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800794    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800801    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800805    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800810    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800814    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800818    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 17:46:44.808664 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800822    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800827    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800832    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800836    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800840    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800845    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800849    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800853    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800857    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800861    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800865    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800869    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800873    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800877    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800881    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800885    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800889    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800893    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800898    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800902    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 17:46:44.809157 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800906    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800910    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800914    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800918    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800922    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800927    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800931    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800935    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800939    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800943    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800947    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800951    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800955    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800960    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800965    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800969    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800973    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800977    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800982    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800986    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 17:46:44.809633 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800990    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800994    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.800998    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801002    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801006    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801010    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801014    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801018    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801022    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801028    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801034    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801039    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801043    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801048    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801052    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801057    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801078    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801083    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801087    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801092    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 17:46:44.810243 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801096    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801101    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801105    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801109    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801113    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801117    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801122    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801127    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801132    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801136    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801140    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801144    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801148    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801152    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801157    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801163    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 17:46:44.810931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:44.801169    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 17:46:44.811349 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.801177    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 17:46:44.811349 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.801345    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 17:46:44.811349 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.803886    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 17:46:44.811349 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.805267    2565 server.go:1019] "Starting client certificate rotation"
Aug 04 17:46:44.811349 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.805368    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 17:46:44.811349 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.805405    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 17:46:44.811349 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.807996    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 17:46:44.811981 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.811958    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 17:46:44.820946 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.820927    2565 log.go:25] "Validated CRI v1 runtime API"
Aug 04 17:46:44.823570 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.823558    2565 log.go:25] "Validated CRI v1 image API"
Aug 04 17:46:44.825481 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.825466    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 17:46:44.827788 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.827769    2565 fs.go:135] Filesystem UUIDs: map[4991ab85-4dbc-4596-b0ef-fe3c1195d7c9:/dev/nvme0n1p4 71969b5b-c587-491d-bb2a-a3f95ff6ab2c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Aug 04 17:46:44.827842 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.827787    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 17:46:44.832756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.832644    2565 manager.go:216] Machine: {Timestamp:2026-08-04 17:46:44.831571931 +0000 UTC m=+0.317262673 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200539 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fd46bc23dc590fc422c8c664004ab SystemUUID:ec2fd46b-c23d-c590-fc42-2c8c664004ab BootID:dc3819cb-2299-412c-ac8b-676e859d3486 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:87:61:6e:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:87:61:6e:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:10:05:97:b1:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 17:46:44.832756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.832751    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 17:46:44.832872 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.832819    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 17:46:44.832949 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.832934    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 17:46:44.835533 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.835508    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 17:46:44.835678 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.835535    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 17:46:44.836303 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.836291    2565 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 17:46:44.836364 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.836308    2565 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 17:46:44.836364 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.836318    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 17:46:44.837196 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.837184    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 17:46:44.837914 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.837903    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 17:46:44.842146 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842132    2565 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 17:46:44.842283 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842272    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 17:46:44.842344 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842307    2565 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 17:46:44.842344 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842320    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 17:46:44.842344 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842333    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 17:46:44.842458 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842346    2565 kubelet.go:398] "Adding apiserver pod source"
Aug 04 17:46:44.842458 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842359    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 17:46:44.842672 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842659    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 17:46:44.842762 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.842680    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 17:46:44.844982 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.844959    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 17:46:44.846265 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.846252    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 17:46:44.846308 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.846283    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 17:46:44.847298 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847288    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 17:46:44.847339 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847303    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 17:46:44.847339 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847309    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 17:46:44.847339 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847315    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 17:46:44.847339 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847324    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 17:46:44.847339 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847332    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 17:46:44.847462 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847343    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 17:46:44.847462 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847351    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 17:46:44.847462 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847358    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 17:46:44.847462 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847364    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 17:46:44.847462 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847377    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 17:46:44.847462 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.847382    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 17:46:44.848115 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.848102    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 17:46:44.848173 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.848116    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 17:46:44.850935 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.850922    2565 server.go:1268] "Started kubelet"
Aug 04 17:46:44.851107 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.850996    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 17:46:44.851107 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.851021    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 17:46:44.851258 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.851124    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 17:46:44.851728 ip-10-0-140-41 systemd[1]: Started Kubernetes Kubelet.
Aug 04 17:46:44.852173 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.852156    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 17:46:44.856475 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.856454    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 17:46:44.856989 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.856962    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 17:46:44.857127 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.857080    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 17:46:44.857521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.857494    2565 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 17:46:44.857967 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.857947    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-df5fr"
Aug 04 17:46:44.858601 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.858578    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 17:46:44.859582 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.858521    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-41.ec2.internal.18c8ab4e41b9d352  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-41.ec2.internal,UID:ip-10-0-140-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-41.ec2.internal,},FirstTimestamp:2026-08-04 17:46:44.850897746 +0000 UTC m=+0.336588488,LastTimestamp:2026-08-04 17:46:44.850897746 +0000 UTC m=+0.336588488,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-41.ec2.internal,}"
Aug 04 17:46:44.861407 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.861393    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 17:46:44.861466 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.861404    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 17:46:44.861713 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.861553    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:44.861935 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.861911    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 17:46:44.861935 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.861931    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 17:46:44.862036 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.861919    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 17:46:44.862036 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862013    2565 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 17:46:44.862036 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862020    2565 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 17:46:44.862438 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862423    2565 factory.go:153] Registering CRI-O factory
Aug 04 17:46:44.862438 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862439    2565 factory.go:223] Registration of the crio container factory successfully
Aug 04 17:46:44.862566 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862484    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 17:46:44.862566 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862493    2565 factory.go:55] Registering systemd factory
Aug 04 17:46:44.862566 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862500    2565 factory.go:223] Registration of the systemd container factory successfully
Aug 04 17:46:44.862566 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862520    2565 factory.go:103] Registering Raw factory
Aug 04 17:46:44.862566 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862532    2565 manager.go:1196] Started watching for new ooms in manager
Aug 04 17:46:44.862884 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.862871    2565 manager.go:349] Starting recovery of all containers
Aug 04 17:46:44.864985 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.864964    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-df5fr"
Aug 04 17:46:44.869561 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.869538    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 17:46:44.873175 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.873161    2565 manager.go:354] Recovery completed
Aug 04 17:46:44.873271 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.873252    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:44.875148 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.875119    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Aug 04 17:46:44.875810 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.875793    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-41.ec2.internal\" not found" node="ip-10-0-140-41.ec2.internal"
Aug 04 17:46:44.877965 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.877954    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:44.879568 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.879554    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:44.879568 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.879578    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:44.879671 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.879588    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:44.880002 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.879981    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 17:46:44.880002 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.879993    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 17:46:44.880128 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.879995    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:44.880128 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.880016    2565 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 17:46:44.880645 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.880630    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:44.880734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.880655    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:44.880734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.880668    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:44.882057 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.882045    2565 policy_none.go:49] "None policy: Start"
Aug 04 17:46:44.882113 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.882060    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 17:46:44.882113 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.882083    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 17:46:44.884122 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.884110    2565 policy_none.go:47] "Start"
Aug 04 17:46:44.914687 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.914551    2565 manager.go:337] "Starting Device Plugin manager"
Aug 04 17:46:44.914766 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.914708    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 17:46:44.914766 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.914721    2565 server.go:87] "Starting device plugin registration server"
Aug 04 17:46:44.914958 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.914946    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 17:46:44.914992 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.914963    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 17:46:44.915087 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.915053    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 17:46:44.915148 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.915142    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 17:46:44.915209 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.915150    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 17:46:44.915619 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.915600    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 17:46:44.915695 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.915648    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:44.949257 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.949240    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 17:46:44.962450 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.949271    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 17:46:44.962450 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.949287    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 17:46:44.962450 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:44.949316    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 17:46:44.962450 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:44.951297    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:45.015267 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.015237    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:45.016837 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.016821    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:45.016894 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.016851    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:45.016894 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.016860    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:45.016894 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.016881    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-41.ec2.internal"
Aug 04 17:46:45.024997 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.024983    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-41.ec2.internal"
Aug 04 17:46:45.025071 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:45.025001    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-41.ec2.internal\": node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:45.038929 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:45.038863    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:45.049489 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.049471    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal"]
Aug 04 17:46:45.049561 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.049536    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:45.050256 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.050241    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:45.050313 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.050268    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:45.050313 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.050279    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:45.052518 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.052505    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:45.052621 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.052607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:45.052662 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.052635    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:45.053170 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.053154    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:45.053243 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.053179    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:45.053243 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.053188    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:45.053243 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.053155    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:45.053343 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.053263    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:45.053343 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.053274    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:45.055308 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.055294    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:45.055375 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.055320    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 17:46:45.056044 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.056028    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 17:46:45.056140 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.056056    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 17:46:45.056140 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.056084    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeHasSufficientPID"
Aug 04 17:46:45.062158 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.062140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5af2cfc59ad1e2d7e01dde9759d0ab89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"5af2cfc59ad1e2d7e01dde9759d0ab89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:45.062224 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.062164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5af2cfc59ad1e2d7e01dde9759d0ab89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"5af2cfc59ad1e2d7e01dde9759d0ab89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:45.062224 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:45.062181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24c79eaecf472aa8b18dbcd77a42fa38-config\") pod \"kube-apiserver-proxy-ip-10-0-140-41.ec2.internal\" (UID: \"24c79eaecf472aa8b18dbcd77a42fa38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:45.088715 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:45.088697    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-41.ec2.internal\" not found" node="ip-10-0-140-41.ec2.internal"
Aug 04 17:46:45.092755 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:45.092741    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-41.ec2.internal\" not found" node="ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.249242 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:46.249224    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:46.272946 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.272924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5af2cfc59ad1e2d7e01dde9759d0ab89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"5af2cfc59ad1e2d7e01dde9759d0ab89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.273021 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.272957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5af2cfc59ad1e2d7e01dde9759d0ab89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"5af2cfc59ad1e2d7e01dde9759d0ab89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.273021 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.272983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24c79eaecf472aa8b18dbcd77a42fa38-config\") pod \"kube-apiserver-proxy-ip-10-0-140-41.ec2.internal\" (UID: \"24c79eaecf472aa8b18dbcd77a42fa38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.273106 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.273021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5af2cfc59ad1e2d7e01dde9759d0ab89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"5af2cfc59ad1e2d7e01dde9759d0ab89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.273106 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.273036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24c79eaecf472aa8b18dbcd77a42fa38-config\") pod \"kube-apiserver-proxy-ip-10-0-140-41.ec2.internal\" (UID: \"24c79eaecf472aa8b18dbcd77a42fa38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.273106 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.273036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5af2cfc59ad1e2d7e01dde9759d0ab89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal\" (UID: \"5af2cfc59ad1e2d7e01dde9759d0ab89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.349789 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:46.349757    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:46.450359 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:46.450311    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:46.501004 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.500987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.505078 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.505060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:46.551433 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:46.551408    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:46.651930 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:46.651903    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:46.752389 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:46.752335    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:46.852946 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:46.852922    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:46.914377 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.914355    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 17:46:46.914718 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.914504    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 17:46:46.914718 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.914504    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 17:46:46.953707 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:46.953682    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-41.ec2.internal\" not found"
Aug 04 17:46:46.979257 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.979226    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 17:41:45 +0000 UTC" deadline="2028-04-05 10:10:16.738429216 +0000 UTC"
Aug 04 17:46:46.979257 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.979249    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14632h23m29.759183352s"
Aug 04 17:46:46.980172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:46.980156    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:47.071574 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.071521    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:47.082398 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.082377    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 17:46:47.084085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.084072    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal"
Aug 04 17:46:47.090873 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.090858    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 17:46:47.212708 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:47.212676    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c79eaecf472aa8b18dbcd77a42fa38.slice/crio-949a9ead978de568eec176ff3097122ac94caa054b1d3a1fa01dc8ec55e5d1fa WatchSource:0}: Error finding container 949a9ead978de568eec176ff3097122ac94caa054b1d3a1fa01dc8ec55e5d1fa: Status 404 returned error can't find the container with id 949a9ead978de568eec176ff3097122ac94caa054b1d3a1fa01dc8ec55e5d1fa
Aug 04 17:46:47.213699 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.213680    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:47.217702 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.217687    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 17:46:47.222317 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:47.222299    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af2cfc59ad1e2d7e01dde9759d0ab89.slice/crio-fb73b3819f741a30c70e89c5e8004548bcce3536456871c95de36b29bc21a4a0 WatchSource:0}: Error finding container fb73b3819f741a30c70e89c5e8004548bcce3536456871c95de36b29bc21a4a0: Status 404 returned error can't find the container with id fb73b3819f741a30c70e89c5e8004548bcce3536456871c95de36b29bc21a4a0
Aug 04 17:46:47.953202 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.953163    2565 apiserver.go:52] "Watching apiserver"
Aug 04 17:46:47.961361 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.961339    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 17:46:47.963016 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.962977    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-pkt8g","openshift-network-operator/iptables-alerter-2w4ml","openshift-ovn-kubernetes/ovnkube-node-jbsc4","kube-system/global-pull-secret-syncer-klx4c","kube-system/konnectivity-agent-6f6dw","kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wk577","openshift-image-registry/node-ca-gqsbj","openshift-multus/multus-additional-cni-plugins-cdgb2","openshift-multus/network-metrics-daemon-npn9x","openshift-network-diagnostics/network-check-target-4xbcd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5","openshift-dns/node-resolver-4qr9v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal"]
Aug 04 17:46:47.966422 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.966287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.968690 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.968550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:47.968830 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.968694    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 17:46:47.968830 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.968714    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:46:47.968973 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.968954    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tt9dx\""
Aug 04 17:46:47.971035 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.971015    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 17:46:47.971130 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.971039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6thpr\""
Aug 04 17:46:47.971184 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.971023    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 17:46:47.971351 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.971334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.971521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.971506    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 17:46:47.973320 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.973303    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 17:46:47.973507 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.973479    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 17:46:47.973767 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.973746    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qjgcm\""
Aug 04 17:46:47.973856 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.973819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:47.973918 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:47.973878    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:46:47.974276 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.974258    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 17:46:47.974341 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.974286    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 17:46:47.975470 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.975020    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 17:46:47.975470 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.975240    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 17:46:47.976187 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.975679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:46:47.977949 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.977927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 17:46:47.978995 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.978146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j4jj8\""
Aug 04 17:46:47.978995 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.978337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:47.978995 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.978360    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 17:46:47.980318 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.980299    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 17:46:47.980825 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.980789    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 17:46:47.981074 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.980798    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g25ld\""
Aug 04 17:46:47.981215 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.980857    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 17:46:47.981548 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.981487    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:47.981660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.981644    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 17:46:47.982559 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.982472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:47.983073 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.982950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-cni-bin\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983073 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.982973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983073 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.982990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovnkube-config\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983073 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-env-overrides\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983073 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e562400-1f9a-4afc-a619-692f88f28a7c-dbus\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:47.983073 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-modprobe-d\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.983073 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysconfig\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.983073 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-run-netns\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svcf\" (UniqueName: \"kubernetes.io/projected/b4a73f01-afac-4068-a7ca-90cfc5465bf5-kube-api-access-2svcf\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-lib-modules\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-slash\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-cni-netd\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e562400-1f9a-4afc-a619-692f88f28a7c-kubelet-config\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6pw6\" (UniqueName: \"kubernetes.io/projected/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-kube-api-access-s6pw6\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-hosts-file\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-etc-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-ovn\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovn-node-metrics-cert\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-sys\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-tuned\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5j4m\" (UniqueName: \"kubernetes.io/projected/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-kube-api-access-b5j4m\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-kubelet\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.983553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-var-lib-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-node-log\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-kubernetes\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-systemd-units\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-systemd\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-run\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-tmp-dir\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.983996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-systemd\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysctl-conf\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysctl-d\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-log-socket\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovnkube-script-lib\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-var-lib-kubelet\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984192    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-host\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-tmp\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:47.984417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984312    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 17:46:47.985330 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984355    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 17:46:47.985330 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984404    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 17:46:47.985330 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.984661    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 17:46:47.985330 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.985012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bnhrq\""
Aug 04 17:46:47.985330 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.985308    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 17:46:47.985547 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.985442    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-49hhh\""
Aug 04 17:46:47.985682 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.985653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:47.988342 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.988097    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-67nsf\""
Aug 04 17:46:47.988342 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.988118    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 17:46:47.988342 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.988208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:47.988342 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.988301    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:46:47.988530 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.988393    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 17:46:47.988709 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:47.988689    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:46:47.992311 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.990291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:47.992311 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:47.990371    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:46:47.993605 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.993585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:47.995657 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.995640    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 17:46:47.995734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.995704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bjc57\""
Aug 04 17:46:47.995795 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.995752    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 17:46:47.995966 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:47.995942    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 17:46:48.005547 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.005527    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qxz56"
Aug 04 17:46:48.013907 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.013888    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qxz56"
Aug 04 17:46:48.064250 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.064195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" event={"ID":"5af2cfc59ad1e2d7e01dde9759d0ab89","Type":"ContainerStarted","Data":"fb73b3819f741a30c70e89c5e8004548bcce3536456871c95de36b29bc21a4a0"}
Aug 04 17:46:48.065772 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.065744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" event={"ID":"24c79eaecf472aa8b18dbcd77a42fa38","Type":"ContainerStarted","Data":"949a9ead978de568eec176ff3097122ac94caa054b1d3a1fa01dc8ec55e5d1fa"}
Aug 04 17:46:48.072755 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.072737    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-sys\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-kubelet\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-var-lib-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-sys\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-node-log\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-k8s-cni-cncf-io\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-kubelet\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-var-lib-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqflc\" (UniqueName: \"kubernetes.io/projected/73af7eef-da57-4f85-afd7-03d2afd93fa5-kube-api-access-rqflc\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-node-log\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-systemd-units\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-tmp-dir\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-systemd\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-systemd-units\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.084915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e53d194-23f4-4468-aadc-7ed60f31d5f9-host\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-cni-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-systemd\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcpfq\" (UniqueName: \"kubernetes.io/projected/ca29ce06-81c9-4d98-b118-924023787566-kube-api-access-qcpfq\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-registration-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysctl-d\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-log-socket\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ca29ce06-81c9-4d98-b118-924023787566-iptables-alerter-script\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.084988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkstq\" (UniqueName: \"kubernetes.io/projected/4e559837-8dd8-48d2-979d-b0dd4c207878-kube-api-access-hkstq\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysctl-d\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-tmp-dir\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-cni-bin\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-log-socket\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovnkube-config\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.085791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-cni-bin\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-env-overrides\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-multus-certs\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-os-release\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysconfig\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-run-netns\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysconfig\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svcf\" (UniqueName: \"kubernetes.io/projected/b4a73f01-afac-4068-a7ca-90cfc5465bf5-kube-api-access-2svcf\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-run-netns\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-env-overrides\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovnkube-config\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-cnibin\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmhhc\" (UniqueName: \"kubernetes.io/projected/a004816b-7a77-4c0d-b216-55cc1a10c5ad-kube-api-access-tmhhc\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-socket-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-slash\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-cni-netd\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.086660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-slash\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.085995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-system-cni-dir\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-cni-netd\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkx84\" (UniqueName: \"kubernetes.io/projected/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-kube-api-access-lkx84\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6pw6\" (UniqueName: \"kubernetes.io/projected/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-kube-api-access-s6pw6\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-hosts-file\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-etc-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.086172    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-ovn\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovn-node-metrics-cert\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.086242    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret podName:8e562400-1f9a-4afc-a619-692f88f28a7c nodeName:}" failed. No retries permitted until 2026-08-04 17:46:48.586212373 +0000 UTC m=+2.962158466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret") pod "global-pull-secret-syncer-klx4c" (UID: "8e562400-1f9a-4afc-a619-692f88f28a7c") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57a3cc32-de81-472c-9981-4ebb1727ebb7-konnectivity-ca\") pod \"konnectivity-agent-6f6dw\" (UID: \"57a3cc32-de81-472c-9981-4ebb1727ebb7\") " pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-system-cni-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086321    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-tuned\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5j4m\" (UniqueName: \"kubernetes.io/projected/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-kube-api-access-b5j4m\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e53d194-23f4-4468-aadc-7ed60f31d5f9-serviceca\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.087420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-conf-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-daemon-config\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cnibin\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-kubernetes\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-socket-dir-parent\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-cni-bin\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086520    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca29ce06-81c9-4d98-b118-924023787566-host-slash\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-device-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-sys-fs\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-systemd\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-run\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-etc-openvswitch\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-netns\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-hostroot\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.088172 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-run\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-systemd\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-kubernetes\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysctl-conf\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.086985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-hosts-file\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-sysctl-conf\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovnkube-script-lib\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57a3cc32-de81-472c-9981-4ebb1727ebb7-agent-certs\") pod \"konnectivity-agent-6f6dw\" (UID: \"57a3cc32-de81-472c-9981-4ebb1727ebb7\") " pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-var-lib-kubelet\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-host\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-tmp\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq768\" (UniqueName: \"kubernetes.io/projected/9e53d194-23f4-4468-aadc-7ed60f31d5f9-kube-api-access-gq768\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-cni-multus\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-etc-kubernetes\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-run-ovn\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.089027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-os-release\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e562400-1f9a-4afc-a619-692f88f28a7c-dbus\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-modprobe-d\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-lib-modules\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-kubelet\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e562400-1f9a-4afc-a619-692f88f28a7c-kubelet-config\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73af7eef-da57-4f85-afd7-03d2afd93fa5-cni-binary-copy\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a73f01-afac-4068-a7ca-90cfc5465bf5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e562400-1f9a-4afc-a619-692f88f28a7c-dbus\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-modprobe-d\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e562400-1f9a-4afc-a619-692f88f28a7c-kubelet-config\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-lib-modules\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.087982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-var-lib-kubelet\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.088026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-host\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.089751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.088338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovnkube-script-lib\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.090582 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.090400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-etc-tuned\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.090582 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.090448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-tmp\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.092142 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.092109    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4a73f01-afac-4068-a7ca-90cfc5465bf5-ovn-node-metrics-cert\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.094651 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.094630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svcf\" (UniqueName: \"kubernetes.io/projected/b4a73f01-afac-4068-a7ca-90cfc5465bf5-kube-api-access-2svcf\") pod \"ovnkube-node-jbsc4\" (UID: \"b4a73f01-afac-4068-a7ca-90cfc5465bf5\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.096894 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.096840    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6pw6\" (UniqueName: \"kubernetes.io/projected/8a40c5cb-9c64-4bfb-af95-9d27e5148c6a-kube-api-access-s6pw6\") pod \"tuned-wk577\" (UID: \"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.101538 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.101511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5j4m\" (UniqueName: \"kubernetes.io/projected/275a9e0e-2f45-401e-9fdc-718d96ed4b4f-kube-api-access-b5j4m\") pod \"node-resolver-4qr9v\" (UID: \"275a9e0e-2f45-401e-9fdc-718d96ed4b4f\") " pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:48.188512 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73af7eef-da57-4f85-afd7-03d2afd93fa5-cni-binary-copy\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.188654 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-k8s-cni-cncf-io\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.188654 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqflc\" (UniqueName: \"kubernetes.io/projected/73af7eef-da57-4f85-afd7-03d2afd93fa5-kube-api-access-rqflc\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.188654 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e53d194-23f4-4468-aadc-7ed60f31d5f9-host\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.188654 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-cni-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.188654 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcpfq\" (UniqueName: \"kubernetes.io/projected/ca29ce06-81c9-4d98-b118-924023787566-kube-api-access-qcpfq\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.188654 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-registration-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.188654 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e53d194-23f4-4468-aadc-7ed60f31d5f9-host\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-cni-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ca29ce06-81c9-4d98-b118-924023787566-iptables-alerter-script\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkstq\" (UniqueName: \"kubernetes.io/projected/4e559837-8dd8-48d2-979d-b0dd4c207878-kube-api-access-hkstq\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.188837    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-k8s-cni-cncf-io\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-multus-certs\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.188901    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:48.688883106 +0000 UTC m=+3.064829194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-registration-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-os-release\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-multus-certs\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-cnibin\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.188998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmhhc\" (UniqueName: \"kubernetes.io/projected/a004816b-7a77-4c0d-b216-55cc1a10c5ad-kube-api-access-tmhhc\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-os-release\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-socket-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73af7eef-da57-4f85-afd7-03d2afd93fa5-cni-binary-copy\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-system-cni-dir\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-cnibin\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkx84\" (UniqueName: \"kubernetes.io/projected/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-kube-api-access-lkx84\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-system-cni-dir\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57a3cc32-de81-472c-9981-4ebb1727ebb7-konnectivity-ca\") pod \"konnectivity-agent-6f6dw\" (UID: \"57a3cc32-de81-472c-9981-4ebb1727ebb7\") " pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ca29ce06-81c9-4d98-b118-924023787566-iptables-alerter-script\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-system-cni-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e53d194-23f4-4468-aadc-7ed60f31d5f9-serviceca\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189255    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-system-cni-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-conf-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-socket-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-daemon-config\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cnibin\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.189839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-conf-dir\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-socket-dir-parent\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cnibin\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-cni-bin\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca29ce06-81c9-4d98-b118-924023787566-host-slash\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-socket-dir-parent\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-cni-bin\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-device-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca29ce06-81c9-4d98-b118-924023787566-host-slash\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-sys-fs\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-device-dir\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-sys-fs\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-netns\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-run-netns\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-hostroot\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.190521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-hostroot\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57a3cc32-de81-472c-9981-4ebb1727ebb7-agent-certs\") pod \"konnectivity-agent-6f6dw\" (UID: \"57a3cc32-de81-472c-9981-4ebb1727ebb7\") " pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq768\" (UniqueName: \"kubernetes.io/projected/9e53d194-23f4-4468-aadc-7ed60f31d5f9-kube-api-access-gq768\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e53d194-23f4-4468-aadc-7ed60f31d5f9-serviceca\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-cni-multus\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-cni-multus\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57a3cc32-de81-472c-9981-4ebb1727ebb7-konnectivity-ca\") pod \"konnectivity-agent-6f6dw\" (UID: \"57a3cc32-de81-472c-9981-4ebb1727ebb7\") " pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73af7eef-da57-4f85-afd7-03d2afd93fa5-multus-daemon-config\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-etc-kubernetes\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-os-release\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-etc-kubernetes\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-kubelet\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.191195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.189956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a004816b-7a77-4c0d-b216-55cc1a10c5ad-os-release\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.191790 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.190010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73af7eef-da57-4f85-afd7-03d2afd93fa5-host-var-lib-kubelet\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.191790 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.190180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.191790 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.190868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a004816b-7a77-4c0d-b216-55cc1a10c5ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.191947 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.191928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57a3cc32-de81-472c-9981-4ebb1727ebb7-agent-certs\") pod \"konnectivity-agent-6f6dw\" (UID: \"57a3cc32-de81-472c-9981-4ebb1727ebb7\") " pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:46:48.197681 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.197631    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:48.197681 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.197652    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:48.197681 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.197666    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bb5v7 for pod openshift-network-diagnostics/network-check-target-4xbcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:48.197909 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.197752    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7 podName:6a7bc222-d17b-45c5-ab7e-1417931a7340 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:48.697715013 +0000 UTC m=+3.073661098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5v7" (UniqueName: "kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7") pod "network-check-target-4xbcd" (UID: "6a7bc222-d17b-45c5-ab7e-1417931a7340") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:48.199931 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.199907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkx84\" (UniqueName: \"kubernetes.io/projected/f58acc7e-19da-4d0c-b1b3-3cfef8415d1e-kube-api-access-lkx84\") pod \"aws-ebs-csi-driver-node-5f9d5\" (UID: \"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.200102 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.200081    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkstq\" (UniqueName: \"kubernetes.io/projected/4e559837-8dd8-48d2-979d-b0dd4c207878-kube-api-access-hkstq\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:48.200193 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.200171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqflc\" (UniqueName: \"kubernetes.io/projected/73af7eef-da57-4f85-afd7-03d2afd93fa5-kube-api-access-rqflc\") pod \"multus-pkt8g\" (UID: \"73af7eef-da57-4f85-afd7-03d2afd93fa5\") " pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.200604 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.200581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcpfq\" (UniqueName: \"kubernetes.io/projected/ca29ce06-81c9-4d98-b118-924023787566-kube-api-access-qcpfq\") pod \"iptables-alerter-2w4ml\" (UID: \"ca29ce06-81c9-4d98-b118-924023787566\") " pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.201160 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.201141    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq768\" (UniqueName: \"kubernetes.io/projected/9e53d194-23f4-4468-aadc-7ed60f31d5f9-kube-api-access-gq768\") pod \"node-ca-gqsbj\" (UID: \"9e53d194-23f4-4468-aadc-7ed60f31d5f9\") " pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.201717 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.201696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmhhc\" (UniqueName: \"kubernetes.io/projected/a004816b-7a77-4c0d-b216-55cc1a10c5ad-kube-api-access-tmhhc\") pod \"multus-additional-cni-plugins-cdgb2\" (UID: \"a004816b-7a77-4c0d-b216-55cc1a10c5ad\") " pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.264085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.264021    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:48.278917 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.278890    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wk577"
Aug 04 17:46:48.288035 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.288018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qr9v"
Aug 04 17:46:48.298854 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.298836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:46:48.305437 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.305420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:46:48.312330 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.312309    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gqsbj"
Aug 04 17:46:48.319661 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.319646    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 17:46:48.321265 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.321246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cdgb2"
Aug 04 17:46:48.328739 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.328723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pkt8g"
Aug 04 17:46:48.338277 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.338262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2w4ml"
Aug 04 17:46:48.343821 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.343797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5"
Aug 04 17:46:48.593081 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.593014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:48.593220 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.593112    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:48.593220 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.593169    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret podName:8e562400-1f9a-4afc-a619-692f88f28a7c nodeName:}" failed. No retries permitted until 2026-08-04 17:46:49.593154848 +0000 UTC m=+3.969100919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret") pod "global-pull-secret-syncer-klx4c" (UID: "8e562400-1f9a-4afc-a619-692f88f28a7c") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:48.693982 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.693953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:48.694133 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.694087    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:48.694185 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.694147    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:49.694133177 +0000 UTC m=+4.070079245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:48.794738 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:48.794705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:48.794907 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.794872    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:48.794907 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.794888    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:48.794907 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.794897    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bb5v7 for pod openshift-network-diagnostics/network-check-target-4xbcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:48.795019 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:48.794946    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7 podName:6a7bc222-d17b-45c5-ab7e-1417931a7340 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:49.794933942 +0000 UTC m=+4.170880009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5v7" (UniqueName: "kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7") pod "network-check-target-4xbcd" (UID: "6a7bc222-d17b-45c5-ab7e-1417931a7340") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:49.018752 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:49.018670    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:41:48 +0000 UTC" deadline="2028-05-10 21:59:22.319804658 +0000 UTC"
Aug 04 17:46:49.018752 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:49.018705    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15484h12m33.301104736s"
Aug 04 17:46:49.248323 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.248294    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a3cc32_de81_472c_9981_4ebb1727ebb7.slice/crio-10e31d5718c3ed9a85388d4a105047737c5d1bd11a2a0c3ffec8b629fed21b6e WatchSource:0}: Error finding container 10e31d5718c3ed9a85388d4a105047737c5d1bd11a2a0c3ffec8b629fed21b6e: Status 404 returned error can't find the container with id 10e31d5718c3ed9a85388d4a105047737c5d1bd11a2a0c3ffec8b629fed21b6e
Aug 04 17:46:49.249747 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.249724    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275a9e0e_2f45_401e_9fdc_718d96ed4b4f.slice/crio-f71ca49d505640a192a92eb89b177b5d99a596680c24f8593de350d82fd20fc4 WatchSource:0}: Error finding container f71ca49d505640a192a92eb89b177b5d99a596680c24f8593de350d82fd20fc4: Status 404 returned error can't find the container with id f71ca49d505640a192a92eb89b177b5d99a596680c24f8593de350d82fd20fc4
Aug 04 17:46:49.250423 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.250400    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a73f01_afac_4068_a7ca_90cfc5465bf5.slice/crio-54522ffcd0c689b92787d010100c6a6612872457d2a7a7718039e9b4f1441fc6 WatchSource:0}: Error finding container 54522ffcd0c689b92787d010100c6a6612872457d2a7a7718039e9b4f1441fc6: Status 404 returned error can't find the container with id 54522ffcd0c689b92787d010100c6a6612872457d2a7a7718039e9b4f1441fc6
Aug 04 17:46:49.251796 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.251773    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58acc7e_19da_4d0c_b1b3_3cfef8415d1e.slice/crio-9c7155180ab66e59cb7520738da5d71a4cdf1a42f2883b26c4646bca0747f57d WatchSource:0}: Error finding container 9c7155180ab66e59cb7520738da5d71a4cdf1a42f2883b26c4646bca0747f57d: Status 404 returned error can't find the container with id 9c7155180ab66e59cb7520738da5d71a4cdf1a42f2883b26c4646bca0747f57d
Aug 04 17:46:49.254597 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.254574    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda004816b_7a77_4c0d_b216_55cc1a10c5ad.slice/crio-6462bde8d311150fa3636fba8639b30c1c73fe2bc2c938b7988b64e1a01a71e1 WatchSource:0}: Error finding container 6462bde8d311150fa3636fba8639b30c1c73fe2bc2c938b7988b64e1a01a71e1: Status 404 returned error can't find the container with id 6462bde8d311150fa3636fba8639b30c1c73fe2bc2c938b7988b64e1a01a71e1
Aug 04 17:46:49.255546 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.255340    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a40c5cb_9c64_4bfb_af95_9d27e5148c6a.slice/crio-a04fa650e60ad0139c7517160b0aab16e3d71782438b776644d44d106d5bbf8a WatchSource:0}: Error finding container a04fa650e60ad0139c7517160b0aab16e3d71782438b776644d44d106d5bbf8a: Status 404 returned error can't find the container with id a04fa650e60ad0139c7517160b0aab16e3d71782438b776644d44d106d5bbf8a
Aug 04 17:46:49.256574 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.256490    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca29ce06_81c9_4d98_b118_924023787566.slice/crio-06975dfd24c8f194550d54b122f38dc1babbb52379a8262c6ca53b1ba7490c48 WatchSource:0}: Error finding container 06975dfd24c8f194550d54b122f38dc1babbb52379a8262c6ca53b1ba7490c48: Status 404 returned error can't find the container with id 06975dfd24c8f194550d54b122f38dc1babbb52379a8262c6ca53b1ba7490c48
Aug 04 17:46:49.257656 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.257573    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73af7eef_da57_4f85_afd7_03d2afd93fa5.slice/crio-ee7d6b2866d14d4e28ff82b1c1e6a63f672d9826db9f69f275aa654ff58750f6 WatchSource:0}: Error finding container ee7d6b2866d14d4e28ff82b1c1e6a63f672d9826db9f69f275aa654ff58750f6: Status 404 returned error can't find the container with id ee7d6b2866d14d4e28ff82b1c1e6a63f672d9826db9f69f275aa654ff58750f6
Aug 04 17:46:49.258755 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:46:49.258733    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e53d194_23f4_4468_aadc_7ed60f31d5f9.slice/crio-623cbb3aa89fba6ece4b57fbf8d146c76f8d573fbaf72d45d4508a8b962b9d37 WatchSource:0}: Error finding container 623cbb3aa89fba6ece4b57fbf8d146c76f8d573fbaf72d45d4508a8b962b9d37: Status 404 returned error can't find the container with id 623cbb3aa89fba6ece4b57fbf8d146c76f8d573fbaf72d45d4508a8b962b9d37
Aug 04 17:46:49.600677 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:49.600479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:49.600677 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:49.600632    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:49.600792 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:49.600687    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret podName:8e562400-1f9a-4afc-a619-692f88f28a7c nodeName:}" failed. No retries permitted until 2026-08-04 17:46:51.600672743 +0000 UTC m=+5.976618815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret") pod "global-pull-secret-syncer-klx4c" (UID: "8e562400-1f9a-4afc-a619-692f88f28a7c") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:49.702302 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:49.701903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:49.702302 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:49.702054    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:49.702302 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:49.702113    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:51.702094197 +0000 UTC m=+6.078040267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:49.802230 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:49.802193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:49.802405 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:49.802389    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:49.802473 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:49.802412    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:49.802473 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:49.802424    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bb5v7 for pod openshift-network-diagnostics/network-check-target-4xbcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:49.802583 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:49.802484    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7 podName:6a7bc222-d17b-45c5-ab7e-1417931a7340 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:51.802466075 +0000 UTC m=+6.178412147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5v7" (UniqueName: "kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7") pod "network-check-target-4xbcd" (UID: "6a7bc222-d17b-45c5-ab7e-1417931a7340") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:50.021428 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.021296    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:41:48 +0000 UTC" deadline="2028-04-08 00:58:09.457048847 +0000 UTC"
Aug 04 17:46:50.021428 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.021352    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14695h11m19.435700397s"
Aug 04 17:46:50.067295 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.066371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:50.067295 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:50.066494    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:46:50.067295 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.066892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:50.067295 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:50.066993    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:46:50.067295 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.067057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:50.067295 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:50.067123    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:46:50.079436 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.079371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wk577" event={"ID":"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a","Type":"ContainerStarted","Data":"a04fa650e60ad0139c7517160b0aab16e3d71782438b776644d44d106d5bbf8a"}
Aug 04 17:46:50.082371 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.082144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" event={"ID":"a004816b-7a77-4c0d-b216-55cc1a10c5ad","Type":"ContainerStarted","Data":"6462bde8d311150fa3636fba8639b30c1c73fe2bc2c938b7988b64e1a01a71e1"}
Aug 04 17:46:50.093896 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.093869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5" event={"ID":"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e","Type":"ContainerStarted","Data":"9c7155180ab66e59cb7520738da5d71a4cdf1a42f2883b26c4646bca0747f57d"}
Aug 04 17:46:50.099511 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.099458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6f6dw" event={"ID":"57a3cc32-de81-472c-9981-4ebb1727ebb7","Type":"ContainerStarted","Data":"10e31d5718c3ed9a85388d4a105047737c5d1bd11a2a0c3ffec8b629fed21b6e"}
Aug 04 17:46:50.109204 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.109180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gqsbj" event={"ID":"9e53d194-23f4-4468-aadc-7ed60f31d5f9","Type":"ContainerStarted","Data":"623cbb3aa89fba6ece4b57fbf8d146c76f8d573fbaf72d45d4508a8b962b9d37"}
Aug 04 17:46:50.118638 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.118615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pkt8g" event={"ID":"73af7eef-da57-4f85-afd7-03d2afd93fa5","Type":"ContainerStarted","Data":"ee7d6b2866d14d4e28ff82b1c1e6a63f672d9826db9f69f275aa654ff58750f6"}
Aug 04 17:46:50.135464 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.135360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"54522ffcd0c689b92787d010100c6a6612872457d2a7a7718039e9b4f1441fc6"}
Aug 04 17:46:50.148106 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.148048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qr9v" event={"ID":"275a9e0e-2f45-401e-9fdc-718d96ed4b4f","Type":"ContainerStarted","Data":"f71ca49d505640a192a92eb89b177b5d99a596680c24f8593de350d82fd20fc4"}
Aug 04 17:46:50.154912 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.154887    2565 generic.go:356] "Generic (PLEG): container finished" podID="5af2cfc59ad1e2d7e01dde9759d0ab89" containerID="fd3218f378c3262b38cc826be4fa96e4d40859a340586afad0bc9778c6387749" exitCode=0
Aug 04 17:46:50.155036 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.154960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" event={"ID":"5af2cfc59ad1e2d7e01dde9759d0ab89","Type":"ContainerDied","Data":"fd3218f378c3262b38cc826be4fa96e4d40859a340586afad0bc9778c6387749"}
Aug 04 17:46:50.176980 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.176955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" event={"ID":"24c79eaecf472aa8b18dbcd77a42fa38","Type":"ContainerStarted","Data":"2ed268ed293cf25aa2c40945ecfbe25ba7477ffbce4884aae9a012ce2e24e3f8"}
Aug 04 17:46:50.186884 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.186853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2w4ml" event={"ID":"ca29ce06-81c9-4d98-b118-924023787566","Type":"ContainerStarted","Data":"06975dfd24c8f194550d54b122f38dc1babbb52379a8262c6ca53b1ba7490c48"}
Aug 04 17:46:50.190793 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:50.190747    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-41.ec2.internal" podStartSLOduration=3.190731175 podStartE2EDuration="3.190731175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:50.190062279 +0000 UTC m=+4.566008370" watchObservedRunningTime="2026-08-04 17:46:50.190731175 +0000 UTC m=+4.566677268"
Aug 04 17:46:51.205143 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:51.205078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" event={"ID":"5af2cfc59ad1e2d7e01dde9759d0ab89","Type":"ContainerStarted","Data":"2fa07fd00179f48a254d965d2028ae59be5c7b2f60c65e231232d6c744392ef3"}
Aug 04 17:46:51.218456 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:51.218257    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-41.ec2.internal" podStartSLOduration=4.218238637 podStartE2EDuration="4.218238637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:46:51.217733192 +0000 UTC m=+5.593679282" watchObservedRunningTime="2026-08-04 17:46:51.218238637 +0000 UTC m=+5.594184729"
Aug 04 17:46:51.616259 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:51.616156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:51.616410 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:51.616305    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:51.616410 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:51.616366    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret podName:8e562400-1f9a-4afc-a619-692f88f28a7c nodeName:}" failed. No retries permitted until 2026-08-04 17:46:55.616346441 +0000 UTC m=+9.992292509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret") pod "global-pull-secret-syncer-klx4c" (UID: "8e562400-1f9a-4afc-a619-692f88f28a7c") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:51.717511 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:51.716950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:51.717511 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:51.717132    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:51.717511 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:51.717190    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:55.717172912 +0000 UTC m=+10.093118987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:51.818151 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:51.817441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:51.818151 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:51.817607    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:51.818151 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:51.817628    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:51.818151 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:51.817641    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bb5v7 for pod openshift-network-diagnostics/network-check-target-4xbcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:51.818151 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:51.817695    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7 podName:6a7bc222-d17b-45c5-ab7e-1417931a7340 nodeName:}" failed. No retries permitted until 2026-08-04 17:46:55.817676782 +0000 UTC m=+10.193622866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5v7" (UniqueName: "kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7") pod "network-check-target-4xbcd" (UID: "6a7bc222-d17b-45c5-ab7e-1417931a7340") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:52.068997 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:52.068916    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:52.069157 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:52.069079    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:46:52.069219 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:52.069177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:52.069330 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:52.069310    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:46:52.069764 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:52.069743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:52.069911 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:52.069889    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:46:54.060912 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:54.060875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:54.061336 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:54.060876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:54.061336 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:54.061022    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:46:54.061336 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:54.061115    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:46:54.061336 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:54.061169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:54.061336 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:54.061270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:46:55.648151 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:55.648051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:55.648614 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:55.648235    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:55.648614 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:55.648313    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret podName:8e562400-1f9a-4afc-a619-692f88f28a7c nodeName:}" failed. No retries permitted until 2026-08-04 17:47:03.648290908 +0000 UTC m=+18.024236978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret") pod "global-pull-secret-syncer-klx4c" (UID: "8e562400-1f9a-4afc-a619-692f88f28a7c") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:46:55.749442 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:55.749398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:55.749603 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:55.749520    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:55.749603 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:55.749590    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:03.749572397 +0000 UTC m=+18.125518472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:46:55.850792 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:55.850760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:55.850963 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:55.850912    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:46:55.850963 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:55.850933    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:46:55.850963 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:55.850944    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bb5v7 for pod openshift-network-diagnostics/network-check-target-4xbcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:55.851128 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:55.851007    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7 podName:6a7bc222-d17b-45c5-ab7e-1417931a7340 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:03.850988795 +0000 UTC m=+18.226934885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5v7" (UniqueName: "kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7") pod "network-check-target-4xbcd" (UID: "6a7bc222-d17b-45c5-ab7e-1417931a7340") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:46:56.060929 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:56.060849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:56.061096 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:56.060983    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:46:56.061096 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:56.061067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:56.061214 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:56.061162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:56.061258 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:56.061238    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:46:56.061317 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:56.061281    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:46:58.060253 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:58.059537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:46:58.060253 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:58.059688    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:46:58.060253 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:58.060110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:46:58.060253 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:58.060205    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:46:58.060734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:46:58.060357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:46:58.060734 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:46:58.060436    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:00.059866 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:00.059835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:00.060316 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:00.059838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:00.060316 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:00.059843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:00.060316 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:00.059971    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:00.060316 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:00.060087    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:00.060316 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:00.060162    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:02.059671 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:02.059635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:02.059671 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:02.059654    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:02.060213 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:02.059635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:02.060213 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:02.059777    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:02.060213 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:02.059871    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:02.060213 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:02.059953    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:03.709241 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:03.709211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:03.709767 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:03.709383    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:03.709767 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:03.709459    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret podName:8e562400-1f9a-4afc-a619-692f88f28a7c nodeName:}" failed. No retries permitted until 2026-08-04 17:47:19.709437305 +0000 UTC m=+34.085383386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret") pod "global-pull-secret-syncer-klx4c" (UID: "8e562400-1f9a-4afc-a619-692f88f28a7c") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:03.809799 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:03.809769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:03.809964 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:03.809941    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:03.810022 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:03.810010    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:19.809988937 +0000 UTC m=+34.185935011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:03.910656 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:03.910629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:03.910798 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:03.910759    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:47:03.910798 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:03.910775    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:47:03.910798 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:03.910783    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bb5v7 for pod openshift-network-diagnostics/network-check-target-4xbcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:03.910973 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:03.910844    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7 podName:6a7bc222-d17b-45c5-ab7e-1417931a7340 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:19.910826458 +0000 UTC m=+34.286772548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5v7" (UniqueName: "kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7") pod "network-check-target-4xbcd" (UID: "6a7bc222-d17b-45c5-ab7e-1417931a7340") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:04.059527 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:04.059448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:04.059527 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:04.059480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:04.059722 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:04.059448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:04.059722 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:04.059553    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:04.059722 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:04.059629    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:04.059722 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:04.059701    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:06.060645 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:06.060614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:06.061103 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:06.060731    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:06.061103 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:06.060787    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:06.061103 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:06.060852    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:06.061103 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:06.060894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:06.061103 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:06.060980    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:08.060532 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.060177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:08.061180 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.060449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:08.061180 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:08.060640    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:08.061180 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.060492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:08.061180 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:08.060704    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:08.061180 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:08.060767    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:08.237185 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.237149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wk577" event={"ID":"8a40c5cb-9c64-4bfb-af95-9d27e5148c6a","Type":"ContainerStarted","Data":"feaaae5c9f6542a2f9819211eadef10b44819bcfe443d2f33dcdd436af014f52"}
Aug 04 17:47:08.238462 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.238441    2565 generic.go:356] "Generic (PLEG): container finished" podID="a004816b-7a77-4c0d-b216-55cc1a10c5ad" containerID="bf1a539d5a36a144b732349c34e0f8f7efb862a1a98340590ddafdbf405fbf2f" exitCode=0
Aug 04 17:47:08.238577 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.238511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" event={"ID":"a004816b-7a77-4c0d-b216-55cc1a10c5ad","Type":"ContainerDied","Data":"bf1a539d5a36a144b732349c34e0f8f7efb862a1a98340590ddafdbf405fbf2f"}
Aug 04 17:47:08.239924 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.239903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5" event={"ID":"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e","Type":"ContainerStarted","Data":"3712eede848486ebf67541bbb873d6c466d2d2a479c84f0701bbaa1a26fa7792"}
Aug 04 17:47:08.241218 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.241195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6f6dw" event={"ID":"57a3cc32-de81-472c-9981-4ebb1727ebb7","Type":"ContainerStarted","Data":"155bbe846da1fc0f8618ec26e7ea35f00c5d159cbc183a189a425d2233cfb811"}
Aug 04 17:47:08.242649 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.242631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gqsbj" event={"ID":"9e53d194-23f4-4468-aadc-7ed60f31d5f9","Type":"ContainerStarted","Data":"d3aaa280be6b1f2073ea9bc9f9315955442854dcd01da2126e2303f0c91bfa10"}
Aug 04 17:47:08.244040 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.244020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pkt8g" event={"ID":"73af7eef-da57-4f85-afd7-03d2afd93fa5","Type":"ContainerStarted","Data":"831fa63309fe9c095db717fba2b6721e28ac25907f6d78c603b9a22c95656afa"}
Aug 04 17:47:08.245978 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.245962    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:47:08.246616 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.246599    2565 generic.go:356] "Generic (PLEG): container finished" podID="b4a73f01-afac-4068-a7ca-90cfc5465bf5" containerID="970e9b630f134519389cf2471ce9c59f966e1c41bad353298f48b7cdc0b29b5f" exitCode=1
Aug 04 17:47:08.246684 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.246656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"c535d9ab7b2ace770ddd166b1c284df176eda2fa7ba80313e54eca2ade5e2ea2"}
Aug 04 17:47:08.246719 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.246702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"c1e63bd5fe0397caefb6906088675fb2ce6b4dfc41ad259dd1e6365064926f1a"}
Aug 04 17:47:08.246756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.246743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerDied","Data":"970e9b630f134519389cf2471ce9c59f966e1c41bad353298f48b7cdc0b29b5f"}
Aug 04 17:47:08.246787 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.246776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"47c98cb54862333bed2bffb8319fc09d670d302855e5a4d4806fe371cef866c5"}
Aug 04 17:47:08.247792 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.247775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qr9v" event={"ID":"275a9e0e-2f45-401e-9fdc-718d96ed4b4f","Type":"ContainerStarted","Data":"86a96af26939294c9925e11269c749b4480752b7b6d791e046413dd5a9c58e77"}
Aug 04 17:47:08.269346 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.269303    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wk577" podStartSLOduration=4.4120733229999995 podStartE2EDuration="22.269286474s" totalImagesPullingTime="17.857213151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:08.254031956 +0000 UTC m=+22.629978045" watchObservedRunningTime="2026-08-04 17:47:08.269286474 +0000 UTC m=+22.645232566"
Aug 04 17:47:08.269976 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.269941    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pkt8g" podStartSLOduration=4.393924257 podStartE2EDuration="22.269927422s" totalImagesPullingTime="17.876003165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:08.269432612 +0000 UTC m=+22.645378695" watchObservedRunningTime="2026-08-04 17:47:08.269927422 +0000 UTC m=+22.645873512"
Aug 04 17:47:08.282113 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.282084    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4qr9v" podStartSLOduration=4.422145135 podStartE2EDuration="22.282073431s" totalImagesPullingTime="17.859928296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:08.281645591 +0000 UTC m=+22.657591680" watchObservedRunningTime="2026-08-04 17:47:08.282073431 +0000 UTC m=+22.658019518"
Aug 04 17:47:08.294567 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.294511    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6f6dw" podStartSLOduration=12.248872863 podStartE2EDuration="22.294498761s" totalImagesPullingTime="10.045625898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:08.293975217 +0000 UTC m=+22.669921309" watchObservedRunningTime="2026-08-04 17:47:08.294498761 +0000 UTC m=+22.670444849"
Aug 04 17:47:08.306290 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.306261    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gqsbj" podStartSLOduration=4.454745979 podStartE2EDuration="22.306250359s" totalImagesPullingTime="17.85150438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:08.306217794 +0000 UTC m=+22.682163882" watchObservedRunningTime="2026-08-04 17:47:08.306250359 +0000 UTC m=+22.682196448"
Aug 04 17:47:08.418967 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.418940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:08.495292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.495270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:08.622712 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.622690    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 17:47:08.825757 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.825691    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:47:08.826152 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:08.826134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:47:09.037378 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.037254    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T17:47:08.62270727Z","UUID":"637bf3f3-754c-4964-b077-1bb78249c1c8","Handler":null,"Name":"","Endpoint":""}
Aug 04 17:47:09.038543 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.038525    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 17:47:09.038666 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.038560    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 17:47:09.253072 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.253039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5" event={"ID":"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e","Type":"ContainerStarted","Data":"47ed96ce30f13e40db6df0277abc1dd04fc66e733a51b79e09989ba1b836fb84"}
Aug 04 17:47:09.256713 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.256691    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:47:09.257160 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.257137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"56982c073b760227ff35b0372e0c7c0b8b14d122578b8f4e38d9a40b5b37d253"}
Aug 04 17:47:09.257302 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.257216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"c7fdef687dbf1802140341b6382c5b57a63ff739bdde3aac3e3aee3470468e52"}
Aug 04 17:47:09.259006 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.258981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2w4ml" event={"ID":"ca29ce06-81c9-4d98-b118-924023787566","Type":"ContainerStarted","Data":"5f704b0c0ad17181d660f19db4a7cc77344e7c183600841da14493fd9e752335"}
Aug 04 17:47:09.260289 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.260266    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:47:09.260394 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.260339    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6f6dw"
Aug 04 17:47:09.275558 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.275500    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2w4ml" podStartSLOduration=5.4525680770000005 podStartE2EDuration="23.275483106s" totalImagesPullingTime="17.822915029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:09.274885405 +0000 UTC m=+23.650831492" watchObservedRunningTime="2026-08-04 17:47:09.275483106 +0000 UTC m=+23.651429195"
Aug 04 17:47:09.332371 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.332340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:09.402407 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.402380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:09.503126 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:09.503051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:10.059791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:10.059768    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:10.059791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:10.059786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:10.059985 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:10.059768    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:10.059985 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:10.059899    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:10.060087 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:10.059997    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:10.060087 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:10.060048    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:10.262734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:10.262661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5" event={"ID":"f58acc7e-19da-4d0c-b1b3-3cfef8415d1e","Type":"ContainerStarted","Data":"1422e2d917280ef5e1042dd79eef1ff7f4c0359de29972010e85170e9935db12"}
Aug 04 17:47:10.279752 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:10.279707    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5f9d5" podStartSLOduration=3.951586508 podStartE2EDuration="24.279692861s" totalImagesPullingTime="20.328106353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:10.279139886 +0000 UTC m=+24.655085976" watchObservedRunningTime="2026-08-04 17:47:10.279692861 +0000 UTC m=+24.655638971"
Aug 04 17:47:11.271920 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:11.271727    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:47:11.272388 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:11.272301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"84142415f6635222a39dfcdaca130a8d859ad889761ee1efff9b23be30867ef5"}
Aug 04 17:47:12.060139 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:12.060109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:12.060316 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:12.060215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:12.060316 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:12.060219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:12.060316 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:12.060256    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:12.060478 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:12.060333    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:12.060478 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:12.060348    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:13.280133 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:13.280113    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:47:13.280609 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:13.280482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"c4bc8d2ac1141ecc9d75992e0a49acd635b58021a1cad0894e927babcfd22251"}
Aug 04 17:47:14.060000 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.059824    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:14.060136 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.059824    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:14.060136 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:14.060091    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:14.060247 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.059831    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:14.060247 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:14.060133    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:14.060247 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:14.060222    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:14.284707 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.284643    2565 generic.go:356] "Generic (PLEG): container finished" podID="a004816b-7a77-4c0d-b216-55cc1a10c5ad" containerID="74bac3a29abd146407d222a9cc28e3e322b020f0f47af5d89473472b49c3054b" exitCode=0
Aug 04 17:47:14.285116 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.284736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" event={"ID":"a004816b-7a77-4c0d-b216-55cc1a10c5ad","Type":"ContainerDied","Data":"74bac3a29abd146407d222a9cc28e3e322b020f0f47af5d89473472b49c3054b"}
Aug 04 17:47:14.285116 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.285003    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:47:14.285116 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.285078    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:47:14.285261 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.285124    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:47:14.285261 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.285131    2565 scope.go:117] "RemoveContainer" containerID="970e9b630f134519389cf2471ce9c59f966e1c41bad353298f48b7cdc0b29b5f"
Aug 04 17:47:14.301459 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.301435    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:47:14.301667 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:14.301650    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:47:15.242754 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.242726    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klx4c"]
Aug 04 17:47:15.242955 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.242863    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:15.242955 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:15.242938    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:15.246117 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.246088    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xbcd"]
Aug 04 17:47:15.246249 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.246197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:15.246317 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:15.246294    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:15.246577 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.246559    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-npn9x"]
Aug 04 17:47:15.246664 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.246643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:15.246733 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:15.246716    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:15.290342 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.290297    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:47:15.290653 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.290638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" event={"ID":"b4a73f01-afac-4068-a7ca-90cfc5465bf5","Type":"ContainerStarted","Data":"e05e2ad8f496f783017459872a59eac33899afbfe4671185d8e806b2788f57c7"}
Aug 04 17:47:15.315691 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:15.315651    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4" podStartSLOduration=10.998163938 podStartE2EDuration="29.315640222s" totalImagesPullingTime="18.317476284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:15.313995038 +0000 UTC m=+29.689941127" watchObservedRunningTime="2026-08-04 17:47:15.315640222 +0000 UTC m=+29.691586336"
Aug 04 17:47:16.294478 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:16.294315    2565 generic.go:356] "Generic (PLEG): container finished" podID="a004816b-7a77-4c0d-b216-55cc1a10c5ad" containerID="65395e32ef54fa27b44a274809a314bb2f9d2e776e4fdc12fd310212eca554c3" exitCode=0
Aug 04 17:47:16.294855 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:16.294398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" event={"ID":"a004816b-7a77-4c0d-b216-55cc1a10c5ad","Type":"ContainerDied","Data":"65395e32ef54fa27b44a274809a314bb2f9d2e776e4fdc12fd310212eca554c3"}
Aug 04 17:47:17.060186 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:17.060157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:17.060361 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:17.060254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:17.060361 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:17.060259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:17.060361 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:17.060281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:17.060488 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:17.060367    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:17.060488 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:17.060462    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:18.065554 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:18.065507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:18.165515 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:18.165491    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:18.219916 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:18.219887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:18.300670 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:18.300644    2565 generic.go:356] "Generic (PLEG): container finished" podID="a004816b-7a77-4c0d-b216-55cc1a10c5ad" containerID="8f3f698f63a3afcbaa24c75232f7df1973897489b006abe802271fafb70316c0" exitCode=0
Aug 04 17:47:18.300788 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:18.300696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" event={"ID":"a004816b-7a77-4c0d-b216-55cc1a10c5ad","Type":"ContainerDied","Data":"8f3f698f63a3afcbaa24c75232f7df1973897489b006abe802271fafb70316c0"}
Aug 04 17:47:19.059949 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:19.059921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:19.060112 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:19.059921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:19.060112 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.060029    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:47:19.060224 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.060122    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xbcd" podUID="6a7bc222-d17b-45c5-ab7e-1417931a7340"
Aug 04 17:47:19.060224 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:19.059921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:19.060312 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.060228    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klx4c" podUID="8e562400-1f9a-4afc-a619-692f88f28a7c"
Aug 04 17:47:19.345116 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:19.345027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:19.407120 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:19.407092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:19.730656 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:19.730625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:19.730852 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.730774    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:19.730914 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.730856    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret podName:8e562400-1f9a-4afc-a619-692f88f28a7c nodeName:}" failed. No retries permitted until 2026-08-04 17:47:51.73083729 +0000 UTC m=+66.106783375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret") pod "global-pull-secret-syncer-klx4c" (UID: "8e562400-1f9a-4afc-a619-692f88f28a7c") : object "kube-system"/"original-pull-secret" not registered
Aug 04 17:47:19.831437 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:19.831408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:19.831592 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.831565    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:19.831656 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.831641    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:51.831620695 +0000 UTC m=+66.207566781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 17:47:19.932724 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:19.932694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:19.932892 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.932828    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 17:47:19.932892 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.932847    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 17:47:19.932892 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.932859    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bb5v7 for pod openshift-network-diagnostics/network-check-target-4xbcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:19.933014 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:19.932923    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7 podName:6a7bc222-d17b-45c5-ab7e-1417931a7340 nodeName:}" failed. No retries permitted until 2026-08-04 17:47:51.932898951 +0000 UTC m=+66.308845033 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5v7" (UniqueName: "kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7") pod "network-check-target-4xbcd" (UID: "6a7bc222-d17b-45c5-ab7e-1417931a7340") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 17:47:20.936154 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.936127    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-41.ec2.internal" event="NodeReady"
Aug 04 17:47:20.936596 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.936252    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 17:47:20.979610 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.979580    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-24xzt"]
Aug 04 17:47:20.982142 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.982119    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:20.982142 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.982133    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2lw7t"]
Aug 04 17:47:20.983803 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.983783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2lw7t"
Aug 04 17:47:20.984434 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.984402    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 17:47:20.984538 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.984488    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 17:47:20.984693 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.984679    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56pss\""
Aug 04 17:47:20.986146 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.986127    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 17:47:20.986223 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.986163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 17:47:20.986431 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.986400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dvz98\""
Aug 04 17:47:20.986431 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.986406    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 17:47:20.991152 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.991139    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-24xzt"]
Aug 04 17:47:20.998524 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:20.998495    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2lw7t"]
Aug 04 17:47:21.047076 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.047053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:21.059915 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.059891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:21.060012 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.059918    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:21.060012 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.059895    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:21.062369 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.062349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 17:47:21.062369 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.062360    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wlqn\""
Aug 04 17:47:21.062510 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.062377    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfqn6\""
Aug 04 17:47:21.063367 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.063092    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 17:47:21.063367 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.063112    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 17:47:21.063367 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.063126    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 17:47:21.142828 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.142745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-config-volume\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.142828 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.142790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.142966 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.142825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755fn\" (UniqueName: \"kubernetes.io/projected/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-kube-api-access-755fn\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.142966 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.142914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881e50bc-0fb6-49af-8435-aa822c5a73a6-cert\") pod \"ingress-canary-2lw7t\" (UID: \"881e50bc-0fb6-49af-8435-aa822c5a73a6\") " pod="openshift-ingress-canary/ingress-canary-2lw7t"
Aug 04 17:47:21.142966 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.142947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-tmp-dir\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.143065 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.142998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frk9g\" (UniqueName: \"kubernetes.io/projected/881e50bc-0fb6-49af-8435-aa822c5a73a6-kube-api-access-frk9g\") pod \"ingress-canary-2lw7t\" (UID: \"881e50bc-0fb6-49af-8435-aa822c5a73a6\") " pod="openshift-ingress-canary/ingress-canary-2lw7t"
Aug 04 17:47:21.243545 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.243520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-config-volume\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.243668 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.243554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.243668 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.243579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755fn\" (UniqueName: \"kubernetes.io/projected/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-kube-api-access-755fn\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.243668 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.243619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881e50bc-0fb6-49af-8435-aa822c5a73a6-cert\") pod \"ingress-canary-2lw7t\" (UID: \"881e50bc-0fb6-49af-8435-aa822c5a73a6\") " pod="openshift-ingress-canary/ingress-canary-2lw7t"
Aug 04 17:47:21.243668 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.243643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-tmp-dir\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.243668 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.243660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frk9g\" (UniqueName: \"kubernetes.io/projected/881e50bc-0fb6-49af-8435-aa822c5a73a6-kube-api-access-frk9g\") pod \"ingress-canary-2lw7t\" (UID: \"881e50bc-0fb6-49af-8435-aa822c5a73a6\") " pod="openshift-ingress-canary/ingress-canary-2lw7t"
Aug 04 17:47:21.243947 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:21.243902    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:21.243999 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:21.243966    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:47:21.74394494 +0000 UTC m=+36.119891016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:21.244061 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.244022    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-tmp-dir\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.244170 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.244144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-config-volume\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.247887 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.247867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881e50bc-0fb6-49af-8435-aa822c5a73a6-cert\") pod \"ingress-canary-2lw7t\" (UID: \"881e50bc-0fb6-49af-8435-aa822c5a73a6\") " pod="openshift-ingress-canary/ingress-canary-2lw7t"
Aug 04 17:47:21.251695 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.251655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-755fn\" (UniqueName: \"kubernetes.io/projected/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-kube-api-access-755fn\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.253253 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.253229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frk9g\" (UniqueName: \"kubernetes.io/projected/881e50bc-0fb6-49af-8435-aa822c5a73a6-kube-api-access-frk9g\") pod \"ingress-canary-2lw7t\" (UID: \"881e50bc-0fb6-49af-8435-aa822c5a73a6\") " pod="openshift-ingress-canary/ingress-canary-2lw7t"
Aug 04 17:47:21.268398 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.268379    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:21.299351 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.299330    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2lw7t"
Aug 04 17:47:21.747655 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:21.747615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:21.747845 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:21.747791    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:21.747930 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:21.747880    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:47:22.747859618 +0000 UTC m=+37.123805705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:22.502901 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:22.502877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2lw7t"]
Aug 04 17:47:22.514133 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:47:22.514108    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881e50bc_0fb6_49af_8435_aa822c5a73a6.slice/crio-ef5b2f5b43a1914eb348605d1a4bd52041a7f814bbb8dd64bc44ae5a9999bf84 WatchSource:0}: Error finding container ef5b2f5b43a1914eb348605d1a4bd52041a7f814bbb8dd64bc44ae5a9999bf84: Status 404 returned error can't find the container with id ef5b2f5b43a1914eb348605d1a4bd52041a7f814bbb8dd64bc44ae5a9999bf84
Aug 04 17:47:22.756128 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:22.756101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:22.756235 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:22.756216    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:22.756284 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:22.756269    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:47:24.756254543 +0000 UTC m=+39.132200610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:23.313666 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:23.313636    2565 generic.go:356] "Generic (PLEG): container finished" podID="a004816b-7a77-4c0d-b216-55cc1a10c5ad" containerID="ee754fcec0682bed3fa88fdf9480f7b02c78a4ad67b44e37fa2c23ac1ac96ec0" exitCode=0
Aug 04 17:47:23.313865 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:23.313711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" event={"ID":"a004816b-7a77-4c0d-b216-55cc1a10c5ad","Type":"ContainerDied","Data":"ee754fcec0682bed3fa88fdf9480f7b02c78a4ad67b44e37fa2c23ac1ac96ec0"}
Aug 04 17:47:23.314692 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:23.314672    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2lw7t" event={"ID":"881e50bc-0fb6-49af-8435-aa822c5a73a6","Type":"ContainerStarted","Data":"ef5b2f5b43a1914eb348605d1a4bd52041a7f814bbb8dd64bc44ae5a9999bf84"}
Aug 04 17:47:24.320089 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:24.320045    2565 generic.go:356] "Generic (PLEG): container finished" podID="a004816b-7a77-4c0d-b216-55cc1a10c5ad" containerID="574649dd32aabce70ef12e4d80b920bb9ef5d0a0e8deb859d86afaaf6d940eb2" exitCode=0
Aug 04 17:47:24.320089 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:24.320088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" event={"ID":"a004816b-7a77-4c0d-b216-55cc1a10c5ad","Type":"ContainerDied","Data":"574649dd32aabce70ef12e4d80b920bb9ef5d0a0e8deb859d86afaaf6d940eb2"}
Aug 04 17:47:24.770198 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:24.770159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:24.770369 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:24.770323    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:24.770435 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:24.770397    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:47:28.770377504 +0000 UTC m=+43.146323590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:25.182850 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:25.182794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:25.324571 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:25.324543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" event={"ID":"a004816b-7a77-4c0d-b216-55cc1a10c5ad","Type":"ContainerStarted","Data":"3ca7a7666a98f21d76685a49378fcc942ad803f30e730dcbb90bf28c4c6ea157"}
Aug 04 17:47:25.345552 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:25.345501    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cdgb2" podStartSLOduration=9.738404241 podStartE2EDuration="39.345486795s" totalImagesPullingTime="29.607082554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:25.344307932 +0000 UTC m=+39.720254022" watchObservedRunningTime="2026-08-04 17:47:25.345486795 +0000 UTC m=+39.721432886"
Aug 04 17:47:25.594625 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:25.594595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:25.696235 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:25.696199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:26.328303 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:26.328273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2lw7t" event={"ID":"881e50bc-0fb6-49af-8435-aa822c5a73a6","Type":"ContainerStarted","Data":"b44c26ae5ea2f8474daf1bf249e9d0139013c2a0d3821004ce035ddd4613801e"}
Aug 04 17:47:26.343291 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:26.343244    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2lw7t" podStartSLOduration=3.365149762 podStartE2EDuration="6.343230978s" totalImagesPullingTime="2.978081216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:26.3419821 +0000 UTC m=+40.717928189" watchObservedRunningTime="2026-08-04 17:47:26.343230978 +0000 UTC m=+40.719177068"
Aug 04 17:47:28.796883 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:28.796847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:28.797250 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:28.796966    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:28.797250 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:28.797017    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:47:36.797004003 +0000 UTC m=+51.172950070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:30.572623 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:30.572590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:30.621196 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:30.621170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:34.813015 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:34.812989    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:34.865304 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:34.865278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:35.142562 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:35.142504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:35.243742 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:35.243715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:36.850604 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:36.850571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:36.850999 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:36.850758    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:36.850999 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:36.850832    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:47:52.850803625 +0000 UTC m=+67.226749696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:46.308653 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:46.308630    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbsc4"
Aug 04 17:47:46.465537 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:46.465511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:46.567482 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:46.567429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:51.745387 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.745350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:51.747998 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.747981    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 17:47:51.759330 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.759307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e562400-1f9a-4afc-a619-692f88f28a7c-original-pull-secret\") pod \"global-pull-secret-syncer-klx4c\" (UID: \"8e562400-1f9a-4afc-a619-692f88f28a7c\") " pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:51.846506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.846483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:47:51.848528 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.848514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 17:47:51.857371 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:51.857350    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 17:47:51.857439 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:51.857416    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:48:55.857399824 +0000 UTC m=+130.233345891 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : secret "metrics-daemon-secret" not found
Aug 04 17:47:51.947298 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.947278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:51.949948 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.949933    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 17:47:51.959643 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.959630    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 17:47:51.970344 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.970326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb5v7\" (UniqueName: \"kubernetes.io/projected/6a7bc222-d17b-45c5-ab7e-1417931a7340-kube-api-access-bb5v7\") pod \"network-check-target-4xbcd\" (UID: \"6a7bc222-d17b-45c5-ab7e-1417931a7340\") " pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:51.971096 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.971076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klx4c"
Aug 04 17:47:51.986632 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.986612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfqn6\""
Aug 04 17:47:51.995315 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:51.995298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:52.140617 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:52.140589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klx4c"]
Aug 04 17:47:52.149368 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:47:52.149337    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e562400_1f9a_4afc_a619_692f88f28a7c.slice/crio-cacb5ad9616186658580d61e19fadc4362fddd160fc44d559580a7bf2afd7dcb WatchSource:0}: Error finding container cacb5ad9616186658580d61e19fadc4362fddd160fc44d559580a7bf2afd7dcb: Status 404 returned error can't find the container with id cacb5ad9616186658580d61e19fadc4362fddd160fc44d559580a7bf2afd7dcb
Aug 04 17:47:52.155870 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:52.155851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xbcd"]
Aug 04 17:47:52.158541 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:47:52.158520    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7bc222_d17b_45c5_ab7e_1417931a7340.slice/crio-5627817b870b0d48fe6cf7d7e70b2ff5689c2522159a85a1a362fce6cdb8df89 WatchSource:0}: Error finding container 5627817b870b0d48fe6cf7d7e70b2ff5689c2522159a85a1a362fce6cdb8df89: Status 404 returned error can't find the container with id 5627817b870b0d48fe6cf7d7e70b2ff5689c2522159a85a1a362fce6cdb8df89
Aug 04 17:47:52.388034 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:52.387965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xbcd" event={"ID":"6a7bc222-d17b-45c5-ab7e-1417931a7340","Type":"ContainerStarted","Data":"5627817b870b0d48fe6cf7d7e70b2ff5689c2522159a85a1a362fce6cdb8df89"}
Aug 04 17:47:52.388913 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:52.388892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klx4c" event={"ID":"8e562400-1f9a-4afc-a619-692f88f28a7c","Type":"ContainerStarted","Data":"cacb5ad9616186658580d61e19fadc4362fddd160fc44d559580a7bf2afd7dcb"}
Aug 04 17:47:52.852730 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:52.852696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:47:52.853111 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:52.852825    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:47:52.853111 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:47:52.852880    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:48:24.85286735 +0000 UTC m=+99.228813417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:47:57.107643 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:57.107566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:57.164013 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:57.163987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:47:57.402166 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:57.402100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xbcd" event={"ID":"6a7bc222-d17b-45c5-ab7e-1417931a7340","Type":"ContainerStarted","Data":"43d9dce6a1b15359c01bc67d7c618d80dcd5b23df49a5295db47c433a83d9da5"}
Aug 04 17:47:57.402284 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:57.402237    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:47:57.403578 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:57.403554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klx4c" event={"ID":"8e562400-1f9a-4afc-a619-692f88f28a7c","Type":"ContainerStarted","Data":"8ccb5af21e6343c182424e243bf163adbbbe05f217d6f8beee1894b5622fb520"}
Aug 04 17:47:57.418153 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:57.418110    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4xbcd" podStartSLOduration=66.765968809 podStartE2EDuration="1m11.41809587s" totalImagesPullingTime="4.652127061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:57.417704535 +0000 UTC m=+71.793650624" watchObservedRunningTime="2026-08-04 17:47:57.41809587 +0000 UTC m=+71.794041959"
Aug 04 17:47:57.434888 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:47:57.434853    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-klx4c" podStartSLOduration=66.770684309 podStartE2EDuration="1m11.434840349s" totalImagesPullingTime="4.66415604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:47:57.434121165 +0000 UTC m=+71.810067254" watchObservedRunningTime="2026-08-04 17:47:57.434840349 +0000 UTC m=+71.810786438"
Aug 04 17:48:15.792996 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:48:15.792868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:48:24.947767 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:48:24.947734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:48:24.948114 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:48:24.947854    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:48:24.948114 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:48:24.947906    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:49:28.9478929 +0000 UTC m=+163.323838968 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:48:28.408664 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:48:28.408628    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4xbcd"
Aug 04 17:48:55.943431 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:48:55.943389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:48:55.943929 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:48:55.943534    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 17:48:55.943929 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:48:55.943609    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs podName:4e559837-8dd8-48d2-979d-b0dd4c207878 nodeName:}" failed. No retries permitted until 2026-08-04 17:50:57.943590663 +0000 UTC m=+252.319536731 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs") pod "network-metrics-daemon-npn9x" (UID: "4e559837-8dd8-48d2-979d-b0dd4c207878") : secret "metrics-daemon-secret" not found
Aug 04 17:49:23.994298 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:49:23.994239    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-24xzt" podUID="c88e9a87-eb1f-4b5b-850b-6b875d47aeaf"
Aug 04 17:49:24.078488 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:49:24.078454    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-npn9x" podUID="4e559837-8dd8-48d2-979d-b0dd4c207878"
Aug 04 17:49:24.609464 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:49:24.609434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24xzt"
Aug 04 17:49:28.953697 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:49:28.953656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:49:28.954176 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:49:28.953798    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 17:49:28.954176 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:49:28.953883    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls podName:c88e9a87-eb1f-4b5b-850b-6b875d47aeaf nodeName:}" failed. No retries permitted until 2026-08-04 17:51:30.953867008 +0000 UTC m=+285.329813079 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls") pod "dns-default-24xzt" (UID: "c88e9a87-eb1f-4b5b-850b-6b875d47aeaf") : secret "dns-default-metrics-tls" not found
Aug 04 17:49:37.059611 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:49:37.059571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:50:11.216954 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:11.216917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:33.951562 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.951530    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz"]
Aug 04 17:50:33.953695 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.953672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz"
Aug 04 17:50:33.955863 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.955838    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 04 17:50:33.955863 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.955839    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nn9xm\""
Aug 04 17:50:33.956597 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.956579    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:50:33.958383 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.958351    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"]
Aug 04 17:50:33.960664 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.960645    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-nwjch"]
Aug 04 17:50:33.960794 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.960778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:33.962427 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.962407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:33.964485 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.964466    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 17:50:33.964726 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.964709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s5xzc\""
Aug 04 17:50:33.964826 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.964766    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 04 17:50:33.965041 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.965018    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 17:50:33.965200 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.965165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz"]
Aug 04 17:50:33.965749 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.965730    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 04 17:50:33.965903 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.965784    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nkmr8\""
Aug 04 17:50:33.965903 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.965799    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 04 17:50:33.966051 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.965946    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 04 17:50:33.966565 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.966545    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:50:33.966702 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.966546    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 04 17:50:33.971800 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.971779    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 04 17:50:33.978465 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.978446    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-nwjch"]
Aug 04 17:50:33.984036 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:33.984016    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"]
Aug 04 17:50:34.052920 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.052899    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"]
Aug 04 17:50:34.054904 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.054889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.058389 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.058364    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 04 17:50:34.058389 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.058367    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-njrpz\""
Aug 04 17:50:34.058526 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.058441    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:50:34.058709 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.058694    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 04 17:50:34.058918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.058904    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 04 17:50:34.063003 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.062986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496ml\" (UniqueName: \"kubernetes.io/projected/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-kube-api-access-496ml\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.063076 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.063009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-config\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.063076 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.063024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gdpl\" (UniqueName: \"kubernetes.io/projected/8d15cd03-d6ca-4ccf-9bdf-e218d90df70e-kube-api-access-8gdpl\") pod \"volume-data-source-validator-5b8776669-2jzgz\" (UID: \"8d15cd03-d6ca-4ccf-9bdf-e218d90df70e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz"
Aug 04 17:50:34.063076 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.063072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-serving-cert\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.063176 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.063088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-trusted-ca\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.063176 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.063105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdf59\" (UniqueName: \"kubernetes.io/projected/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-kube-api-access-qdf59\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.063176 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.063121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.063263 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.063181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.069174 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.069157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"]
Aug 04 17:50:34.164252 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-serving-cert\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.164331 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-trusted-ca\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.164331 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bc3391c-d508-4056-bc0f-4543d0af0ad0-serving-cert\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.164331 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdf59\" (UniqueName: \"kubernetes.io/projected/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-kube-api-access-qdf59\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.164554 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bc3391c-d508-4056-bc0f-4543d0af0ad0-config\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.164590 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.164623 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.164663 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-496ml\" (UniqueName: \"kubernetes.io/projected/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-kube-api-access-496ml\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.164723 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-config\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.164723 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gdpl\" (UniqueName: \"kubernetes.io/projected/8d15cd03-d6ca-4ccf-9bdf-e218d90df70e-kube-api-access-8gdpl\") pod \"volume-data-source-validator-5b8776669-2jzgz\" (UID: \"8d15cd03-d6ca-4ccf-9bdf-e218d90df70e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz"
Aug 04 17:50:34.164723 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.164703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvtv\" (UniqueName: \"kubernetes.io/projected/1bc3391c-d508-4056-bc0f-4543d0af0ad0-kube-api-access-vnvtv\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.165022 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:34.164998    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:34.165094 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:34.165077    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls podName:a5314310-d5cd-4777-8d51-a03cb7e8cdaf nodeName:}" failed. No retries permitted until 2026-08-04 17:50:34.665057424 +0000 UTC m=+229.041003525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqkb2" (UID: "a5314310-d5cd-4777-8d51-a03cb7e8cdaf") : secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:34.165232 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.165211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-trusted-ca\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.165286 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.165276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.165343 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.165276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-config\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.166609 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.166590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-serving-cert\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.171987 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.171967    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdf59\" (UniqueName: \"kubernetes.io/projected/8e8bb1ad-3b9e-4daf-863b-3005f885d1a3-kube-api-access-qdf59\") pod \"console-operator-5ccd6b445f-nwjch\" (UID: \"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3\") " pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.173626 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.173607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-496ml\" (UniqueName: \"kubernetes.io/projected/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-kube-api-access-496ml\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.173715 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.173694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gdpl\" (UniqueName: \"kubernetes.io/projected/8d15cd03-d6ca-4ccf-9bdf-e218d90df70e-kube-api-access-8gdpl\") pod \"volume-data-source-validator-5b8776669-2jzgz\" (UID: \"8d15cd03-d6ca-4ccf-9bdf-e218d90df70e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz"
Aug 04 17:50:34.205300 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.205256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:34.263364 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.263346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz"
Aug 04 17:50:34.265464 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.265443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvtv\" (UniqueName: \"kubernetes.io/projected/1bc3391c-d508-4056-bc0f-4543d0af0ad0-kube-api-access-vnvtv\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.265537 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.265490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bc3391c-d508-4056-bc0f-4543d0af0ad0-serving-cert\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.265537 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.265510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bc3391c-d508-4056-bc0f-4543d0af0ad0-config\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.266030 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.265968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bc3391c-d508-4056-bc0f-4543d0af0ad0-config\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.267484 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.267466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bc3391c-d508-4056-bc0f-4543d0af0ad0-serving-cert\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.272398 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.272373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvtv\" (UniqueName: \"kubernetes.io/projected/1bc3391c-d508-4056-bc0f-4543d0af0ad0-kube-api-access-vnvtv\") pod \"service-ca-operator-784f97bcf6-jzchr\" (UID: \"1bc3391c-d508-4056-bc0f-4543d0af0ad0\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.277389 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.277367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:34.305534 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.305498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:34.363146 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.362961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"
Aug 04 17:50:34.387241 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.387215    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz"]
Aug 04 17:50:34.390141 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:50:34.390118    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d15cd03_d6ca_4ccf_9bdf_e218d90df70e.slice/crio-1e561793721f590c6e6a6ca6e6ff50f18c6cbd0a96132337b694649c8bc5c6bb WatchSource:0}: Error finding container 1e561793721f590c6e6a6ca6e6ff50f18c6cbd0a96132337b694649c8bc5c6bb: Status 404 returned error can't find the container with id 1e561793721f590c6e6a6ca6e6ff50f18c6cbd0a96132337b694649c8bc5c6bb
Aug 04 17:50:34.403623 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.403597    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-nwjch"]
Aug 04 17:50:34.406086 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:50:34.406059    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8bb1ad_3b9e_4daf_863b_3005f885d1a3.slice/crio-60201fd49c95a6658eb5ec3de7a514fe92312781c5051083f767cc41e42a19b3 WatchSource:0}: Error finding container 60201fd49c95a6658eb5ec3de7a514fe92312781c5051083f767cc41e42a19b3: Status 404 returned error can't find the container with id 60201fd49c95a6658eb5ec3de7a514fe92312781c5051083f767cc41e42a19b3
Aug 04 17:50:34.484226 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.484206    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr"]
Aug 04 17:50:34.485405 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:50:34.485383    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc3391c_d508_4056_bc0f_4543d0af0ad0.slice/crio-ef91904e1f89ac109c5a4ed266b74347bd2d36985c8fbf3adf2b75a0e2da27c5 WatchSource:0}: Error finding container ef91904e1f89ac109c5a4ed266b74347bd2d36985c8fbf3adf2b75a0e2da27c5: Status 404 returned error can't find the container with id ef91904e1f89ac109c5a4ed266b74347bd2d36985c8fbf3adf2b75a0e2da27c5
Aug 04 17:50:34.670892 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.670870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:34.671001 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:34.670960    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:34.671041 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:34.671006    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls podName:a5314310-d5cd-4777-8d51-a03cb7e8cdaf nodeName:}" failed. No retries permitted until 2026-08-04 17:50:35.67099288 +0000 UTC m=+230.046938947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqkb2" (UID: "a5314310-d5cd-4777-8d51-a03cb7e8cdaf") : secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:34.776049 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.775989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch" event={"ID":"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3","Type":"ContainerStarted","Data":"60201fd49c95a6658eb5ec3de7a514fe92312781c5051083f767cc41e42a19b3"}
Aug 04 17:50:34.777019 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.776992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr" event={"ID":"1bc3391c-d508-4056-bc0f-4543d0af0ad0","Type":"ContainerStarted","Data":"ef91904e1f89ac109c5a4ed266b74347bd2d36985c8fbf3adf2b75a0e2da27c5"}
Aug 04 17:50:34.777958 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:34.777940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz" event={"ID":"8d15cd03-d6ca-4ccf-9bdf-e218d90df70e","Type":"ContainerStarted","Data":"1e561793721f590c6e6a6ca6e6ff50f18c6cbd0a96132337b694649c8bc5c6bb"}
Aug 04 17:50:35.679545 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:35.679497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:35.679974 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:35.679665    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:35.679974 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:35.679759    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls podName:a5314310-d5cd-4777-8d51-a03cb7e8cdaf nodeName:}" failed. No retries permitted until 2026-08-04 17:50:37.679735463 +0000 UTC m=+232.055681545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqkb2" (UID: "a5314310-d5cd-4777-8d51-a03cb7e8cdaf") : secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:35.783852 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:35.783775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz" event={"ID":"8d15cd03-d6ca-4ccf-9bdf-e218d90df70e","Type":"ContainerStarted","Data":"691f019b7ae841b42af82d5718bf764e4a662f3919ebbd1e76139dbf7ec86d77"}
Aug 04 17:50:35.799417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:35.799365    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2jzgz" podStartSLOduration=1.509045493 podStartE2EDuration="2.799346454s" totalImagesPullingTime="1.290300961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:35.797585339 +0000 UTC m=+230.173531430" watchObservedRunningTime="2026-08-04 17:50:35.799346454 +0000 UTC m=+230.175292546"
Aug 04 17:50:35.875958 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:35.875927    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:35.931453 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:35.931380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:37.692029 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:37.692005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:37.692319 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:37.692116    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:37.692319 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:37.692169    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls podName:a5314310-d5cd-4777-8d51-a03cb7e8cdaf nodeName:}" failed. No retries permitted until 2026-08-04 17:50:41.692155119 +0000 UTC m=+236.068101187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqkb2" (UID: "a5314310-d5cd-4777-8d51-a03cb7e8cdaf") : secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:37.790507 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:37.790486    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/0.log"
Aug 04 17:50:37.790623 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:37.790521    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e8bb1ad-3b9e-4daf-863b-3005f885d1a3" containerID="18f470b8c80783bdd07daac6bd0828756c4b09b2535df7bf48bfce0480be2cb2" exitCode=255
Aug 04 17:50:37.790623 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:37.790552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch" event={"ID":"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3","Type":"ContainerDied","Data":"18f470b8c80783bdd07daac6bd0828756c4b09b2535df7bf48bfce0480be2cb2"}
Aug 04 17:50:37.790843 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:37.790802    2565 scope.go:117] "RemoveContainer" containerID="18f470b8c80783bdd07daac6bd0828756c4b09b2535df7bf48bfce0480be2cb2"
Aug 04 17:50:37.792015 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:37.791993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr" event={"ID":"1bc3391c-d508-4056-bc0f-4543d0af0ad0","Type":"ContainerStarted","Data":"2c67a6813493dd229b41db2b5fb0d528705703d613394fcaa0bf4897cbc1df57"}
Aug 04 17:50:37.819011 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:37.818971    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr" podStartSLOduration=1.014828211 podStartE2EDuration="3.818951869s" totalImagesPullingTime="2.804123658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:37.818692548 +0000 UTC m=+232.194638638" watchObservedRunningTime="2026-08-04 17:50:37.818951869 +0000 UTC m=+232.194897956"
Aug 04 17:50:38.468557 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.468526    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w89xx"]
Aug 04 17:50:38.471471 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.471453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.473962 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.473941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tv89b\""
Aug 04 17:50:38.474072 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.474053    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 17:50:38.474751 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.474735    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 17:50:38.474849 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.474788    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 17:50:38.474849 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.474838    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 17:50:38.481972 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.481952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w89xx"]
Aug 04 17:50:38.497400 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.497379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.497478 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.497418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d36ed11-34b6-4eb0-bb57-1274343ee28e-data-volume\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.497478 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.497441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.497558 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.497542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d36ed11-34b6-4eb0-bb57-1274343ee28e-crio-socket\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.497594 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.497565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzljp\" (UniqueName: \"kubernetes.io/projected/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-api-access-qzljp\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.597878 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.597845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.598005 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.597884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d36ed11-34b6-4eb0-bb57-1274343ee28e-data-volume\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.598005 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.597902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.598005 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.597937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d36ed11-34b6-4eb0-bb57-1274343ee28e-crio-socket\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.598005 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.597961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzljp\" (UniqueName: \"kubernetes.io/projected/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-api-access-qzljp\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.598187 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:38.598063    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:38.598187 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.598063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d36ed11-34b6-4eb0-bb57-1274343ee28e-crio-socket\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.598187 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:38.598139    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:39.098123824 +0000 UTC m=+233.474069890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:38.598187 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:38.598064    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:38.598313 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.598219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d36ed11-34b6-4eb0-bb57-1274343ee28e-data-volume\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.598313 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:38.598227    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:39.09820937 +0000 UTC m=+233.474155455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:38.605373 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.605353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzljp\" (UniqueName: \"kubernetes.io/projected/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-api-access-qzljp\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:38.797420 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.797358    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 17:50:38.797717 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.797703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/0.log"
Aug 04 17:50:38.797776 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.797734    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e8bb1ad-3b9e-4daf-863b-3005f885d1a3" containerID="169ce8d7d09ffb646bc5447f97d9c2b9d70cbf327b14d6268fba6851e9a2a62f" exitCode=255
Aug 04 17:50:38.797860 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.797837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch" event={"ID":"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3","Type":"ContainerDied","Data":"169ce8d7d09ffb646bc5447f97d9c2b9d70cbf327b14d6268fba6851e9a2a62f"}
Aug 04 17:50:38.797925 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.797894    2565 scope.go:117] "RemoveContainer" containerID="18f470b8c80783bdd07daac6bd0828756c4b09b2535df7bf48bfce0480be2cb2"
Aug 04 17:50:38.798111 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.798077    2565 scope.go:117] "RemoveContainer" containerID="169ce8d7d09ffb646bc5447f97d9c2b9d70cbf327b14d6268fba6851e9a2a62f"
Aug 04 17:50:38.798289 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:38.798265    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-nwjch_openshift-console-operator(8e8bb1ad-3b9e-4daf-863b-3005f885d1a3)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch" podUID="8e8bb1ad-3b9e-4daf-863b-3005f885d1a3"
Aug 04 17:50:38.841058 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.841035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:38.889698 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:38.889663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:39.102128 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.102072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:39.102128 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.102113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:39.102261 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:39.102177    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:39.102261 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:39.102206    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:39.102261 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:39.102235    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:40.102220293 +0000 UTC m=+234.478166360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:39.102261 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:39.102251    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:40.102241095 +0000 UTC m=+234.478187162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:39.406207 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.406184    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f"]
Aug 04 17:50:39.410258 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.410241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f"
Aug 04 17:50:39.412403 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.412381    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 04 17:50:39.412549 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.412534    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 04 17:50:39.413347 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.413330    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k4zsd\""
Aug 04 17:50:39.420137 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.420121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f"]
Aug 04 17:50:39.445586 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.445563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:39.500825 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.500773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:39.505884 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.505867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cggnf\" (UniqueName: \"kubernetes.io/projected/f21a9ee4-e688-48a4-9ab3-6544dcb6cb39-kube-api-access-cggnf\") pod \"migrator-68bc745d87-4n45f\" (UID: \"f21a9ee4-e688-48a4-9ab3-6544dcb6cb39\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f"
Aug 04 17:50:39.606698 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.606675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cggnf\" (UniqueName: \"kubernetes.io/projected/f21a9ee4-e688-48a4-9ab3-6544dcb6cb39-kube-api-access-cggnf\") pod \"migrator-68bc745d87-4n45f\" (UID: \"f21a9ee4-e688-48a4-9ab3-6544dcb6cb39\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f"
Aug 04 17:50:39.618303 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.618274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cggnf\" (UniqueName: \"kubernetes.io/projected/f21a9ee4-e688-48a4-9ab3-6544dcb6cb39-kube-api-access-cggnf\") pod \"migrator-68bc745d87-4n45f\" (UID: \"f21a9ee4-e688-48a4-9ab3-6544dcb6cb39\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f"
Aug 04 17:50:39.718585 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.718521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f"
Aug 04 17:50:39.801881 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.801861    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 17:50:39.802281 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.802260    2565 scope.go:117] "RemoveContainer" containerID="169ce8d7d09ffb646bc5447f97d9c2b9d70cbf327b14d6268fba6851e9a2a62f"
Aug 04 17:50:39.802499 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:39.802476    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-nwjch_openshift-console-operator(8e8bb1ad-3b9e-4daf-863b-3005f885d1a3)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch" podUID="8e8bb1ad-3b9e-4daf-863b-3005f885d1a3"
Aug 04 17:50:39.834698 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:39.834676    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f"]
Aug 04 17:50:39.837532 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:50:39.837508    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21a9ee4_e688_48a4_9ab3_6544dcb6cb39.slice/crio-a3f6cc3b06a6d9c04aeee104af5dfccb660a5f3839d357f0bb462e515c38c907 WatchSource:0}: Error finding container a3f6cc3b06a6d9c04aeee104af5dfccb660a5f3839d357f0bb462e515c38c907: Status 404 returned error can't find the container with id a3f6cc3b06a6d9c04aeee104af5dfccb660a5f3839d357f0bb462e515c38c907
Aug 04 17:50:40.110165 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.110115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:40.110165 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.110151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:40.110296 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:40.110214    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:40.110296 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:40.110234    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:40.110296 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:40.110263    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:42.110249052 +0000 UTC m=+236.486195119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:40.110296 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:40.110277    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:42.110269736 +0000 UTC m=+236.486215803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:40.234938 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.234920    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qr9v_275a9e0e-2f45-401e-9fdc-718d96ed4b4f/dns-node-resolver/0.log"
Aug 04 17:50:40.804867 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.804837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f" event={"ID":"f21a9ee4-e688-48a4-9ab3-6544dcb6cb39","Type":"ContainerStarted","Data":"a3f6cc3b06a6d9c04aeee104af5dfccb660a5f3839d357f0bb462e515c38c907"}
Aug 04 17:50:40.992996 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.992967    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-nv7wd"]
Aug 04 17:50:40.996963 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.996942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:40.999305 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.999287    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 04 17:50:40.999305 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.999290    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 04 17:50:40.999455 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.999308    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 04 17:50:40.999455 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.999397    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nqp4p\""
Aug 04 17:50:40.999528 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:40.999507    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 04 17:50:41.004770 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.004750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-nv7wd"]
Aug 04 17:50:41.017398 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.017368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-signing-cabundle\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.017556 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.017418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-signing-key\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.018181 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.018155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8h6t\" (UniqueName: \"kubernetes.io/projected/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-kube-api-access-d8h6t\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.025163 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.025143    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:41.081725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.081674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:41.119309 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.119288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-signing-cabundle\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.119381 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.119316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-signing-key\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.119381 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.119372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8h6t\" (UniqueName: \"kubernetes.io/projected/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-kube-api-access-d8h6t\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.119894 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.119873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-signing-cabundle\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.121630 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.121613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-signing-key\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.126748 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.126728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8h6t\" (UniqueName: \"kubernetes.io/projected/2af705c3-2be0-4ea6-a07e-fea3bef9b52d-kube-api-access-d8h6t\") pod \"service-ca-98c88fbb5-nv7wd\" (UID: \"2af705c3-2be0-4ea6-a07e-fea3bef9b52d\") " pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.306321 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.306293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd"
Aug 04 17:50:41.435072 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.435019    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-nv7wd"]
Aug 04 17:50:41.437897 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:50:41.437869    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af705c3_2be0_4ea6_a07e_fea3bef9b52d.slice/crio-593fcbe31b90ed9499e4cce66116d1c90972ef38c9955cbea771866564fad4d4 WatchSource:0}: Error finding container 593fcbe31b90ed9499e4cce66116d1c90972ef38c9955cbea771866564fad4d4: Status 404 returned error can't find the container with id 593fcbe31b90ed9499e4cce66116d1c90972ef38c9955cbea771866564fad4d4
Aug 04 17:50:41.458097 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.458074    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gqsbj_9e53d194-23f4-4468-aadc-7ed60f31d5f9/node-ca/0.log"
Aug 04 17:50:41.723760 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.723724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:41.723948 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:41.723894    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:41.724005 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:41.723969    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls podName:a5314310-d5cd-4777-8d51-a03cb7e8cdaf nodeName:}" failed. No retries permitted until 2026-08-04 17:50:49.723951605 +0000 UTC m=+244.099897675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqkb2" (UID: "a5314310-d5cd-4777-8d51-a03cb7e8cdaf") : secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:41.810489 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.810451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd" event={"ID":"2af705c3-2be0-4ea6-a07e-fea3bef9b52d","Type":"ContainerStarted","Data":"2a7eb3331153f69d5e466a7cba1d4990076adefe7b3c639c20b773a6a6ed5b4b"}
Aug 04 17:50:41.810846 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.810510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd" event={"ID":"2af705c3-2be0-4ea6-a07e-fea3bef9b52d","Type":"ContainerStarted","Data":"593fcbe31b90ed9499e4cce66116d1c90972ef38c9955cbea771866564fad4d4"}
Aug 04 17:50:41.830784 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.830743    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-nv7wd" podStartSLOduration=1.830729818 podStartE2EDuration="1.830729818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:41.829973081 +0000 UTC m=+236.205919161" watchObservedRunningTime="2026-08-04 17:50:41.830729818 +0000 UTC m=+236.206675907"
Aug 04 17:50:41.976589 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:41.976536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:42.034707 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:42.034685    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2lw7t_881e50bc-0fb6-49af-8435-aa822c5a73a6/serve-healthcheck-canary/0.log"
Aug 04 17:50:42.127517 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:42.127494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:42.127706 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:42.127534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:42.127706 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:42.127596    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:42.127706 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:42.127625    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:42.127706 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:42.127657    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:46.127639226 +0000 UTC m=+240.503585294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:42.127706 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:42.127676    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:46.127666526 +0000 UTC m=+240.503612598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:42.815496 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:42.815462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f" event={"ID":"f21a9ee4-e688-48a4-9ab3-6544dcb6cb39","Type":"ContainerStarted","Data":"8201a4327862a5f73ced629d6df474ce5a21138b332aac27559eac39aeb8e817"}
Aug 04 17:50:42.815907 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:42.815520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f" event={"ID":"f21a9ee4-e688-48a4-9ab3-6544dcb6cb39","Type":"ContainerStarted","Data":"a88390dafd91b461ffb4e3edcdc6dfb3dee6f1aa905bb40f9169d970ddb06fa1"}
Aug 04 17:50:42.831151 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:42.831004    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4n45f" podStartSLOduration=1.823992707 podStartE2EDuration="3.830989509s" totalImagesPullingTime="2.006996802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:42.83071868 +0000 UTC m=+237.206664768" watchObservedRunningTime="2026-08-04 17:50:42.830989509 +0000 UTC m=+237.206935598"
Aug 04 17:50:43.089126 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:43.089047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:43.325203 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:43.325168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:43.423634 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:43.423603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:43.523757 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:43.523733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:43.984938 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:43.984911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:44.033095 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:44.033074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:44.277716 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:44.277664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:44.277716 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:44.277705    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:44.278006 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:44.277994    2565 scope.go:117] "RemoveContainer" containerID="169ce8d7d09ffb646bc5447f97d9c2b9d70cbf327b14d6268fba6851e9a2a62f"
Aug 04 17:50:44.278136 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:44.278120    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-nwjch_openshift-console-operator(8e8bb1ad-3b9e-4daf-863b-3005f885d1a3)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch" podUID="8e8bb1ad-3b9e-4daf-863b-3005f885d1a3"
Aug 04 17:50:44.403531 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:44.403502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:45.004295 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:45.004270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:45.104857 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:45.104836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:45.383585 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:45.383523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:45.627608 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:45.627569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:46.157564 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:46.157532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:46.157953 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:46.157628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:46.157953 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:46.157672    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:46.157953 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:46.157708    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 17:50:46.157953 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:46.157742    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:54.157725664 +0000 UTC m=+248.533671930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : secret "insights-runtime-extractor-tls" not found
Aug 04 17:50:46.157953 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:46.157758    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm podName:9d36ed11-34b6-4eb0-bb57-1274343ee28e nodeName:}" failed. No retries permitted until 2026-08-04 17:50:54.157752033 +0000 UTC m=+248.533698100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w89xx" (UID: "9d36ed11-34b6-4eb0-bb57-1274343ee28e") : configmap "kube-rbac-proxy" not found
Aug 04 17:50:46.187696 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:46.187670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:46.585976 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:46.585908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:46.969978 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:46.969949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:47.028030 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:47.028001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:47.190182 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:47.190157    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:47.590965 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:47.590931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:48.182285 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:48.182258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:48.781539 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:48.781510    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:48.988010 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:48.987986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:49.181353 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:49.181332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:49.384274 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:49.384249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:49.576382 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:49.576309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:49.782128 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:49.782100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:50:49.782448 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:49.782210    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:49.782448 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:50:49.782282    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls podName:a5314310-d5cd-4777-8d51-a03cb7e8cdaf nodeName:}" failed. No retries permitted until 2026-08-04 17:51:05.782270133 +0000 UTC m=+260.158216201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqkb2" (UID: "a5314310-d5cd-4777-8d51-a03cb7e8cdaf") : secret "cluster-monitoring-operator-tls" not found
Aug 04 17:50:50.378964 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:50.378922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:50.781665 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:50.781636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:50.986854 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:50.986804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:51.181229 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:51.181201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:51.588164 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:51.588092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:51.771390 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:51.771358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:51.981883 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:51.981830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:52.596123 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:52.596091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:52.948063 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:52.948033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:53.045999 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:53.045972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:53.183284 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:53.183247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:53.593508 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:53.593479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:53.787369 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:53.787342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:54.217603 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.217577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:54.217741 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.217636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:54.218118 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.218089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d36ed11-34b6-4eb0-bb57-1274343ee28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:54.219991 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.219972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d36ed11-34b6-4eb0-bb57-1274343ee28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w89xx\" (UID: \"9d36ed11-34b6-4eb0-bb57-1274343ee28e\") " pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:54.381917 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.381886    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tv89b\""
Aug 04 17:50:54.390729 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.390706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w89xx"
Aug 04 17:50:54.508824 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.508790    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w89xx"]
Aug 04 17:50:54.510983 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:50:54.510951    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d36ed11_34b6_4eb0_bb57_1274343ee28e.slice/crio-a7e33da82408dd2bba982919fbae00b449e255e96a342e926584cedffebb27f1 WatchSource:0}: Error finding container a7e33da82408dd2bba982919fbae00b449e255e96a342e926584cedffebb27f1: Status 404 returned error can't find the container with id a7e33da82408dd2bba982919fbae00b449e255e96a342e926584cedffebb27f1
Aug 04 17:50:54.854223 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.854147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w89xx" event={"ID":"9d36ed11-34b6-4eb0-bb57-1274343ee28e","Type":"ContainerStarted","Data":"af99bda01038458647482b6abdf7c56b26b62b63941b46d494f34d17b0711804"}
Aug 04 17:50:54.854223 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:54.854203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w89xx" event={"ID":"9d36ed11-34b6-4eb0-bb57-1274343ee28e","Type":"ContainerStarted","Data":"a7e33da82408dd2bba982919fbae00b449e255e96a342e926584cedffebb27f1"}
Aug 04 17:50:55.858566 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:55.858536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w89xx" event={"ID":"9d36ed11-34b6-4eb0-bb57-1274343ee28e","Type":"ContainerStarted","Data":"665ffc529d59224f0eaf41e3463f8808f5fa4bb3fab98b4bdee92fdc3b732b9a"}
Aug 04 17:50:56.863139 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:56.863113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w89xx" event={"ID":"9d36ed11-34b6-4eb0-bb57-1274343ee28e","Type":"ContainerStarted","Data":"278f18d5c9168259d5bf0b1b631c152a2619ed5f74bccfd2ee7368670be1f628"}
Aug 04 17:50:56.880518 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:56.880475    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w89xx" podStartSLOduration=16.789766721 podStartE2EDuration="18.880458632s" totalImagesPullingTime="2.090691911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:50:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:56.880190074 +0000 UTC m=+251.256136177" watchObservedRunningTime="2026-08-04 17:50:56.880458632 +0000 UTC m=+251.256404720"
Aug 04 17:50:57.060385 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.060338    2565 scope.go:117] "RemoveContainer" containerID="169ce8d7d09ffb646bc5447f97d9c2b9d70cbf327b14d6268fba6851e9a2a62f"
Aug 04 17:50:57.827528 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.824376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:57.867684 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.867659    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 17:50:57.868029 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.867771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch" event={"ID":"8e8bb1ad-3b9e-4daf-863b-3005f885d1a3","Type":"ContainerStarted","Data":"2a3a0553e9bc3d84ac632dc9e5b367c664a285685a6f745e568b4fe82b4fa318"}
Aug 04 17:50:57.868118 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.868098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:57.872722 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.872704    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch"
Aug 04 17:50:57.883536 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.883499    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-nwjch" podStartSLOduration=21.999652304 podStartE2EDuration="24.883485241s" totalImagesPullingTime="2.883832937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:57.882396362 +0000 UTC m=+252.258342450" watchObservedRunningTime="2026-08-04 17:50:57.883485241 +0000 UTC m=+252.259431331"
Aug 04 17:50:57.886398 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.886381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:57.947643 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.947615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:50:57.949837 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:57.949804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e559837-8dd8-48d2-979d-b0dd4c207878-metrics-certs\") pod \"network-metrics-daemon-npn9x\" (UID: \"4e559837-8dd8-48d2-979d-b0dd4c207878\") " pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:50:58.062137 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.062118    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wlqn\""
Aug 04 17:50:58.070822 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.070793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn9x"
Aug 04 17:50:58.186431 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.186405    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-npn9x"]
Aug 04 17:50:58.189071 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:50:58.189049    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e559837_8dd8_48d2_979d_b0dd4c207878.slice/crio-365063e9f27d3dda44ab5ec7bf93780cf5319d2b1729edf3e169b17fdf51b713 WatchSource:0}: Error finding container 365063e9f27d3dda44ab5ec7bf93780cf5319d2b1729edf3e169b17fdf51b713: Status 404 returned error can't find the container with id 365063e9f27d3dda44ab5ec7bf93780cf5319d2b1729edf3e169b17fdf51b713
Aug 04 17:50:58.434582 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.434555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:58.535531 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.535497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:58.588234 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.588215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:58.873115 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.873043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npn9x" event={"ID":"4e559837-8dd8-48d2-979d-b0dd4c207878","Type":"ContainerStarted","Data":"365063e9f27d3dda44ab5ec7bf93780cf5319d2b1729edf3e169b17fdf51b713"}
Aug 04 17:50:58.907976 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.907941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:58.960467 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:58.960444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:59.301385 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:59.301350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:59.406632 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:59.406573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:50:59.878072 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:59.878042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npn9x" event={"ID":"4e559837-8dd8-48d2-979d-b0dd4c207878","Type":"ContainerStarted","Data":"325b3644cc9b1076a3281cee11fc8fb8307779f8222fd440946cee7b91f5a7e7"}
Aug 04 17:50:59.878438 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:59.878095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npn9x" event={"ID":"4e559837-8dd8-48d2-979d-b0dd4c207878","Type":"ContainerStarted","Data":"4a1f1d0ceaf989878b47ce4eb4bc837de4e79a8b0fd886588e260c0b7ff7539f"}
Aug 04 17:50:59.894133 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:50:59.894082    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-npn9x" podStartSLOduration=252.77298986 podStartE2EDuration="4m13.894063008s" totalImagesPullingTime="1.121073148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:50:59.891883544 +0000 UTC m=+254.267829632" watchObservedRunningTime="2026-08-04 17:50:59.894063008 +0000 UTC m=+254.270009098"
Aug 04 17:51:00.281218 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:00.281190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:00.336436 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:00.336413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:00.535203 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:00.535134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:00.730754 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:00.730722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:00.831112 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:00.831056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:00.931315 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:00.931292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:02.660997 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:02.660955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:02.714264 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:02.714237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:03.210118 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.210084    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6788467c67-bmdkk"]
Aug 04 17:51:03.213866 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.213835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.216576 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.216553    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 17:51:03.216705 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.216591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 17:51:03.216705 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.216649    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 17:51:03.217437 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.217424    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6z64c\""
Aug 04 17:51:03.221738 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.221722    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 17:51:03.225095 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.225071    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6788467c67-bmdkk"]
Aug 04 17:51:03.245954 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.245931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:03.286460 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.286438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-registry-tls\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.286550 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.286464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6463be9-90d7-481c-b761-daca4af7eb17-installation-pull-secrets\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.286550 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.286491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6463be9-90d7-481c-b761-daca4af7eb17-trusted-ca\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.286550 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.286514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6463be9-90d7-481c-b761-daca4af7eb17-image-registry-private-configuration\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.286686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.286573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6463be9-90d7-481c-b761-daca4af7eb17-registry-certificates\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.286686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.286597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-bound-sa-token\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.286686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.286653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6463be9-90d7-481c-b761-daca4af7eb17-ca-trust-extracted\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.286797 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.286712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7nsg\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-kube-api-access-r7nsg\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.357677 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.357642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:03.387621 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.387594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6463be9-90d7-481c-b761-daca4af7eb17-trusted-ca\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.387734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.387629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6463be9-90d7-481c-b761-daca4af7eb17-image-registry-private-configuration\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.387734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.387661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6463be9-90d7-481c-b761-daca4af7eb17-registry-certificates\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.387734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.387695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-bound-sa-token\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.387734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.387721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6463be9-90d7-481c-b761-daca4af7eb17-ca-trust-extracted\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.387962 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.387877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7nsg\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-kube-api-access-r7nsg\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.387962 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.387935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-registry-tls\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.388092 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.387967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6463be9-90d7-481c-b761-daca4af7eb17-installation-pull-secrets\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.388429 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.388405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6463be9-90d7-481c-b761-daca4af7eb17-ca-trust-extracted\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.388642 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.388617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6463be9-90d7-481c-b761-daca4af7eb17-trusted-ca\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.388726 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.388667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6463be9-90d7-481c-b761-daca4af7eb17-registry-certificates\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.390265 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.390236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-registry-tls\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.390366 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.390331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6463be9-90d7-481c-b761-daca4af7eb17-image-registry-private-configuration\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.390366 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.390354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6463be9-90d7-481c-b761-daca4af7eb17-installation-pull-secrets\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.395365 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.395346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-bound-sa-token\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.396917 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.396900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7nsg\" (UniqueName: \"kubernetes.io/projected/e6463be9-90d7-481c-b761-daca4af7eb17-kube-api-access-r7nsg\") pod \"image-registry-6788467c67-bmdkk\" (UID: \"e6463be9-90d7-481c-b761-daca4af7eb17\") " pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.451618 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.451596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:03.522603 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.522548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.645874 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.645843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6788467c67-bmdkk"]
Aug 04 17:51:03.648525 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:03.648498    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6463be9_90d7_481c_b761_daca4af7eb17.slice/crio-0827c5c77ae971451de618ac263f30831be0ae8baa85390e12bc34f99d6678fa WatchSource:0}: Error finding container 0827c5c77ae971451de618ac263f30831be0ae8baa85390e12bc34f99d6678fa: Status 404 returned error can't find the container with id 0827c5c77ae971451de618ac263f30831be0ae8baa85390e12bc34f99d6678fa
Aug 04 17:51:03.892128 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.892044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6788467c67-bmdkk" event={"ID":"e6463be9-90d7-481c-b761-daca4af7eb17","Type":"ContainerStarted","Data":"86ef0dac70846ab31f019b4a0fa289c8f6964cdf7b4c0cc2ed319642ef572367"}
Aug 04 17:51:03.892128 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.892099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6788467c67-bmdkk" event={"ID":"e6463be9-90d7-481c-b761-daca4af7eb17","Type":"ContainerStarted","Data":"0827c5c77ae971451de618ac263f30831be0ae8baa85390e12bc34f99d6678fa"}
Aug 04 17:51:03.892499 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.892178    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:03.910489 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:03.910444    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6788467c67-bmdkk" podStartSLOduration=0.910430372 podStartE2EDuration="910.430372ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:03.909749653 +0000 UTC m=+258.285695742" watchObservedRunningTime="2026-08-04 17:51:03.910430372 +0000 UTC m=+258.286376457"
Aug 04 17:51:05.804538 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:05.804504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:51:05.806841 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:05.806821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5314310-d5cd-4777-8d51-a03cb7e8cdaf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqkb2\" (UID: \"a5314310-d5cd-4777-8d51-a03cb7e8cdaf\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:51:06.075345 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:06.075274    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s5xzc\""
Aug 04 17:51:06.084075 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:06.084055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"
Aug 04 17:51:06.204194 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:06.204169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2"]
Aug 04 17:51:06.206718 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:06.206691    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5314310_d5cd_4777_8d51_a03cb7e8cdaf.slice/crio-12f53a764391c83edb25a820fececc8333f900288bb8a0e9ea0e9c986bdd4d7f WatchSource:0}: Error finding container 12f53a764391c83edb25a820fececc8333f900288bb8a0e9ea0e9c986bdd4d7f: Status 404 returned error can't find the container with id 12f53a764391c83edb25a820fececc8333f900288bb8a0e9ea0e9c986bdd4d7f
Aug 04 17:51:06.902171 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:06.902136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2" event={"ID":"a5314310-d5cd-4777-8d51-a03cb7e8cdaf","Type":"ContainerStarted","Data":"12f53a764391c83edb25a820fececc8333f900288bb8a0e9ea0e9c986bdd4d7f"}
Aug 04 17:51:08.587924 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.587852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:08.692998 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.692954    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:08.741948 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.741912    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"]
Aug 04 17:51:08.744982 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.744959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"
Aug 04 17:51:08.747312 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.747293    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 04 17:51:08.747462 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.747446    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9xvhv\""
Aug 04 17:51:08.756520 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.756501    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"]
Aug 04 17:51:08.778091 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.778067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:08.828308 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.828263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3a6165fd-ad6f-41da-b974-438d9298231a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-7dvmz\" (UID: \"3a6165fd-ad6f-41da-b974-438d9298231a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"
Aug 04 17:51:08.910132 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.910106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2" event={"ID":"a5314310-d5cd-4777-8d51-a03cb7e8cdaf","Type":"ContainerStarted","Data":"f9859961ad0d890835d8b6d1fdb2dc8546659dfd73b3ecc60b734004b4255817"}
Aug 04 17:51:08.929480 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:08.929443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3a6165fd-ad6f-41da-b974-438d9298231a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-7dvmz\" (UID: \"3a6165fd-ad6f-41da-b974-438d9298231a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"
Aug 04 17:51:08.929595 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:08.929565    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Aug 04 17:51:08.929644 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:08.929616    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a6165fd-ad6f-41da-b974-438d9298231a-tls-certificates podName:3a6165fd-ad6f-41da-b974-438d9298231a nodeName:}" failed. No retries permitted until 2026-08-04 17:51:09.42960243 +0000 UTC m=+263.805548497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3a6165fd-ad6f-41da-b974-438d9298231a-tls-certificates") pod "prometheus-operator-admission-webhook-66685ff6d4-7dvmz" (UID: "3a6165fd-ad6f-41da-b974-438d9298231a") : secret "prometheus-operator-admission-webhook-tls" not found
Aug 04 17:51:09.017986 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.017958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:09.432917 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.432889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3a6165fd-ad6f-41da-b974-438d9298231a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-7dvmz\" (UID: \"3a6165fd-ad6f-41da-b974-438d9298231a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"
Aug 04 17:51:09.435171 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.435143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3a6165fd-ad6f-41da-b974-438d9298231a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-7dvmz\" (UID: \"3a6165fd-ad6f-41da-b974-438d9298231a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"
Aug 04 17:51:09.655297 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.655264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"
Aug 04 17:51:09.737032 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.737006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:09.784507 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.784450    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqkb2" podStartSLOduration=34.734730823 podStartE2EDuration="36.784431827s" totalImagesPullingTime="2.049701004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:08.925280637 +0000 UTC m=+263.301226728" watchObservedRunningTime="2026-08-04 17:51:09.784431827 +0000 UTC m=+264.160377915"
Aug 04 17:51:09.784706 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.784608    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"]
Aug 04 17:51:09.787046 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:09.787022    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6165fd_ad6f_41da_b974_438d9298231a.slice/crio-751865c3d040917e641381c6f2c61bb9485d1fd9a0725e41be3fb06067d20010 WatchSource:0}: Error finding container 751865c3d040917e641381c6f2c61bb9485d1fd9a0725e41be3fb06067d20010: Status 404 returned error can't find the container with id 751865c3d040917e641381c6f2c61bb9485d1fd9a0725e41be3fb06067d20010
Aug 04 17:51:09.837084 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.837055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:09.914031 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:09.914005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz" event={"ID":"3a6165fd-ad6f-41da-b974-438d9298231a","Type":"ContainerStarted","Data":"751865c3d040917e641381c6f2c61bb9485d1fd9a0725e41be3fb06067d20010"}
Aug 04 17:51:10.875963 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:10.875900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:10.947992 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:10.947946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:11.019634 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:11.019581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:11.922894 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:11.922802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz" event={"ID":"3a6165fd-ad6f-41da-b974-438d9298231a","Type":"ContainerStarted","Data":"8b420ff2e17b0ed79f9ca3f043746c60385ce8f7067392a5216bac6e5f3c5d87"}
Aug 04 17:51:11.923278 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:11.922942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"
Aug 04 17:51:11.927328 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:11.927305    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz"
Aug 04 17:51:11.938867 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:11.938799    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7dvmz" podStartSLOduration=2.06524032 podStartE2EDuration="3.938786558s" totalImagesPullingTime="1.873546238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:11.938612678 +0000 UTC m=+266.314558766" watchObservedRunningTime="2026-08-04 17:51:11.938786558 +0000 UTC m=+266.314732647"
Aug 04 17:51:12.130051 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.130020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:12.765581 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.765551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:12.796215 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.796188    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-76jcl"]
Aug 04 17:51:12.798332 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.798305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:12.801485 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.801465    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 04 17:51:12.801603 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.801468    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 17:51:12.801603 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.801471    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lpcpt\""
Aug 04 17:51:12.801790 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.801775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 04 17:51:12.809276 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.809070    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-76jcl"]
Aug 04 17:51:12.829030 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.829002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:12.959568 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.959537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a287b924-fe8d-47ef-a949-9247f781aba7-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:12.960053 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.959586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:12.960053 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.959660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnrql\" (UniqueName: \"kubernetes.io/projected/a287b924-fe8d-47ef-a949-9247f781aba7-kube-api-access-hnrql\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:12.960053 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:12.959746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.060448 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.060375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnrql\" (UniqueName: \"kubernetes.io/projected/a287b924-fe8d-47ef-a949-9247f781aba7-kube-api-access-hnrql\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.060555 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.060526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.060627 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.060562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a287b924-fe8d-47ef-a949-9247f781aba7-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.060627 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.060597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.060724 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:13.060658    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 04 17:51:13.060757 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:13.060750    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-tls podName:a287b924-fe8d-47ef-a949-9247f781aba7 nodeName:}" failed. No retries permitted until 2026-08-04 17:51:13.560730653 +0000 UTC m=+267.936676720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-76jcl" (UID: "a287b924-fe8d-47ef-a949-9247f781aba7") : secret "prometheus-operator-tls" not found
Aug 04 17:51:13.061280 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.061263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a287b924-fe8d-47ef-a949-9247f781aba7-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.062990 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.062969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.068383 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.068362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnrql\" (UniqueName: \"kubernetes.io/projected/a287b924-fe8d-47ef-a949-9247f781aba7-kube-api-access-hnrql\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.137586 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.137558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:13.564540 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.564506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.566733 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.566713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a287b924-fe8d-47ef-a949-9247f781aba7-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-76jcl\" (UID: \"a287b924-fe8d-47ef-a949-9247f781aba7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.707085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.707053    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl"
Aug 04 17:51:13.825686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.825660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-76jcl"]
Aug 04 17:51:13.827728 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:13.827704    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda287b924_fe8d_47ef_a949_9247f781aba7.slice/crio-72e7240a7aa321c575fd165598aeaf2b013aaec518f3f1260449c21ed5141f78 WatchSource:0}: Error finding container 72e7240a7aa321c575fd165598aeaf2b013aaec518f3f1260449c21ed5141f78: Status 404 returned error can't find the container with id 72e7240a7aa321c575fd165598aeaf2b013aaec518f3f1260449c21ed5141f78
Aug 04 17:51:13.930005 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:13.929972    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl" event={"ID":"a287b924-fe8d-47ef-a949-9247f781aba7","Type":"ContainerStarted","Data":"72e7240a7aa321c575fd165598aeaf2b013aaec518f3f1260449c21ed5141f78"}
Aug 04 17:51:15.367102 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:15.367032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:15.534226 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:15.534193    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:15.589981 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:15.589958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:15.938498 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:15.938464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl" event={"ID":"a287b924-fe8d-47ef-a949-9247f781aba7","Type":"ContainerStarted","Data":"4c342fac797c3d9f06299961acc00f5f59a1d07259fbddb0ad8a0a7800be36f8"}
Aug 04 17:51:15.938676 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:15.938514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl" event={"ID":"a287b924-fe8d-47ef-a949-9247f781aba7","Type":"ContainerStarted","Data":"ee2843ac1ab4069753ece03f8bbb7674b6bbe54e6f3118eb8dabeba5a26ed693"}
Aug 04 17:51:15.954303 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:15.954261    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-76jcl" podStartSLOduration=2.702256871 podStartE2EDuration="3.954244908s" totalImagesPullingTime="1.251988037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:15.952823453 +0000 UTC m=+270.328769534" watchObservedRunningTime="2026-08-04 17:51:15.954244908 +0000 UTC m=+270.330190996"
Aug 04 17:51:17.892595 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:17.892564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:18.074760 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.074730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:18.134087 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.134053    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"]
Aug 04 17:51:18.138790 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.138758    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xvrsn"]
Aug 04 17:51:18.138947 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.138880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.141027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.141004    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 04 17:51:18.141732 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.141714    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7ljmn\""
Aug 04 17:51:18.141853 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.141752    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 04 17:51:18.141853 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.141753    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 04 17:51:18.143034 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.142987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.145003 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.144975    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 17:51:18.145113 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.145030    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 17:51:18.145113 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.145095    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 17:51:18.145450 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.145432    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hmd7r\""
Aug 04 17:51:18.148563 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.148544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"]
Aug 04 17:51:18.165449 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.165429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:18.236085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.236057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:18.299223 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-accelerators-collector-config\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.299327 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.299327 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54cfdead-6d17-4e5e-81da-741b32842ad1-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.299327 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-wtmp\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.299327 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c2td\" (UniqueName: \"kubernetes.io/projected/08e8855b-e6f6-488f-9b06-fec999662064-kube-api-access-7c2td\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.299506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/54cfdead-6d17-4e5e-81da-741b32842ad1-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.299506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-tls\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.299506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-root\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.299506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.299506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-textfile\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.299506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqzrz\" (UniqueName: \"kubernetes.io/projected/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-api-access-zqzrz\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.299506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.299739 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.299739 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-sys\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.299739 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.299593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e8855b-e6f6-488f-9b06-fec999662064-metrics-client-ca\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.336044 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.336019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:18.400695 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-root\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.400695 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400667    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.400695 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-textfile\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.400918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqzrz\" (UniqueName: \"kubernetes.io/projected/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-api-access-zqzrz\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.400918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.400918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-root\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.400918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.400918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-sys\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.400918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e8855b-e6f6-488f-9b06-fec999662064-metrics-client-ca\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.400918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-accelerators-collector-config\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.400918 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.401292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54cfdead-6d17-4e5e-81da-741b32842ad1-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.401292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.400978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-wtmp\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.401292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c2td\" (UniqueName: \"kubernetes.io/projected/08e8855b-e6f6-488f-9b06-fec999662064-kube-api-access-7c2td\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.401292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/54cfdead-6d17-4e5e-81da-741b32842ad1-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.401292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-textfile\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.401292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-tls\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.401292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-sys\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.401613 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-wtmp\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.401613 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.401613 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/54cfdead-6d17-4e5e-81da-741b32842ad1-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.401613 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:18.401582    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 17:51:18.401804 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:18.401636    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-tls podName:08e8855b-e6f6-488f-9b06-fec999662064 nodeName:}" failed. No retries permitted until 2026-08-04 17:51:18.90161949 +0000 UTC m=+273.277565565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-tls") pod "node-exporter-xvrsn" (UID: "08e8855b-e6f6-488f-9b06-fec999662064") : secret "node-exporter-tls" not found
Aug 04 17:51:18.401804 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-accelerators-collector-config\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.401958 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.401934    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e8855b-e6f6-488f-9b06-fec999662064-metrics-client-ca\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.402141 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.402121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54cfdead-6d17-4e5e-81da-741b32842ad1-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.403862 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.403840    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.403964 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.403884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.404049 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.404028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.408565 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.408535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c2td\" (UniqueName: \"kubernetes.io/projected/08e8855b-e6f6-488f-9b06-fec999662064-kube-api-access-7c2td\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.408732 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.408707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqzrz\" (UniqueName: \"kubernetes.io/projected/54cfdead-6d17-4e5e-81da-741b32842ad1-kube-api-access-zqzrz\") pod \"kube-state-metrics-6bd9664c4-lmzg7\" (UID: \"54cfdead-6d17-4e5e-81da-741b32842ad1\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.436201 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.436169    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:18.451153 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.451123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"
Aug 04 17:51:18.536384 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.536359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:18.581098 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.581005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7"]
Aug 04 17:51:18.582931 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:18.582901    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54cfdead_6d17_4e5e_81da_741b32842ad1.slice/crio-a1cd89d5d8a3d1530506ead9470ade8a023587ec060330a070ab608f98342037 WatchSource:0}: Error finding container a1cd89d5d8a3d1530506ead9470ade8a023587ec060330a070ab608f98342037: Status 404 returned error can't find the container with id a1cd89d5d8a3d1530506ead9470ade8a023587ec060330a070ab608f98342037
Aug 04 17:51:18.813606 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.813579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:18.905737 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.905713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-tls\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.907772 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.907755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08e8855b-e6f6-488f-9b06-fec999662064-node-exporter-tls\") pod \"node-exporter-xvrsn\" (UID: \"08e8855b-e6f6-488f-9b06-fec999662064\") " pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:18.948484 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:18.948464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7" event={"ID":"54cfdead-6d17-4e5e-81da-741b32842ad1","Type":"ContainerStarted","Data":"a1cd89d5d8a3d1530506ead9470ade8a023587ec060330a070ab608f98342037"}
Aug 04 17:51:19.057131 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:19.057103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xvrsn"
Aug 04 17:51:19.070485 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:19.070464    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e8855b_e6f6_488f_9b06_fec999662064.slice/crio-ef1132014e18d3049fd28763f006c4cb3692fcaf39bf982530c885396a4de3f1 WatchSource:0}: Error finding container ef1132014e18d3049fd28763f006c4cb3692fcaf39bf982530c885396a4de3f1: Status 404 returned error can't find the container with id ef1132014e18d3049fd28763f006c4cb3692fcaf39bf982530c885396a4de3f1
Aug 04 17:51:19.113004 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:19.112965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:19.187929 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:19.187896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:19.701371 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:19.701333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:19.955339 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:19.955275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xvrsn" event={"ID":"08e8855b-e6f6-488f-9b06-fec999662064","Type":"ContainerStarted","Data":"ef1132014e18d3049fd28763f006c4cb3692fcaf39bf982530c885396a4de3f1"}
Aug 04 17:51:19.957550 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:19.957519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7" event={"ID":"54cfdead-6d17-4e5e-81da-741b32842ad1","Type":"ContainerStarted","Data":"50988f970fd14dec4af96b3dbe17b273c04c0fd6693788d4edbbc7ff2806ab16"}
Aug 04 17:51:20.126431 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.126394    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"]
Aug 04 17:51:20.130266 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.130240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.132739 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.132657    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 04 17:51:20.132889 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.132774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 04 17:51:20.132889 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.132774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 04 17:51:20.133209 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.133191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7bng7\""
Aug 04 17:51:20.133289 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.133270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 04 17:51:20.133352 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.133328    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ds4gvb9a2bl7u\""
Aug 04 17:51:20.133407 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.133381    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 04 17:51:20.144047 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.144026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"]
Aug 04 17:51:20.217516 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.217445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-grpc-tls\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.217516 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.217485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmzcx\" (UniqueName: \"kubernetes.io/projected/21375c41-a4ec-4a0e-91c9-66a13d16b25b-kube-api-access-jmzcx\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.217683 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.217513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.217683 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.217623    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.217683 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.217665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21375c41-a4ec-4a0e-91c9-66a13d16b25b-metrics-client-ca\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.217841 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.217732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.217841 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.217793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.217937 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.217859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-tls\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.318845 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.318788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-tls\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.319020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.318876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-grpc-tls\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.319020 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.319000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmzcx\" (UniqueName: \"kubernetes.io/projected/21375c41-a4ec-4a0e-91c9-66a13d16b25b-kube-api-access-jmzcx\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.319138 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.319039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.319138 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.319110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.319226 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.319151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21375c41-a4ec-4a0e-91c9-66a13d16b25b-metrics-client-ca\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.319226 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.319197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.320145 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.319793    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.320340 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.320317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21375c41-a4ec-4a0e-91c9-66a13d16b25b-metrics-client-ca\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.321979 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.321952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.322168 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.322120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-tls\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.322272 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.322200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-grpc-tls\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.322730 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.322709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.322930 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.322906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.323355 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.323332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21375c41-a4ec-4a0e-91c9-66a13d16b25b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.327616 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.327596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmzcx\" (UniqueName: \"kubernetes.io/projected/21375c41-a4ec-4a0e-91c9-66a13d16b25b-kube-api-access-jmzcx\") pod \"thanos-querier-6dd876f8f4-4q7hm\" (UID: \"21375c41-a4ec-4a0e-91c9-66a13d16b25b\") " pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.440495 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.440469    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:20.594027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.594006    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"]
Aug 04 17:51:20.595857 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:20.595832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21375c41_a4ec_4a0e_91c9_66a13d16b25b.slice/crio-3243a8f61f6d493af383b52ca41faa7576477077be79eddfb81b750c39ee1d7b WatchSource:0}: Error finding container 3243a8f61f6d493af383b52ca41faa7576477077be79eddfb81b750c39ee1d7b: Status 404 returned error can't find the container with id 3243a8f61f6d493af383b52ca41faa7576477077be79eddfb81b750c39ee1d7b
Aug 04 17:51:20.961736 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.961705    2565 generic.go:356] "Generic (PLEG): container finished" podID="08e8855b-e6f6-488f-9b06-fec999662064" containerID="42f4b814aa62b83f90488a3361528f1782f7299489ec7fdf4628370bde14f83e" exitCode=0
Aug 04 17:51:20.962124 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.961772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xvrsn" event={"ID":"08e8855b-e6f6-488f-9b06-fec999662064","Type":"ContainerDied","Data":"42f4b814aa62b83f90488a3361528f1782f7299489ec7fdf4628370bde14f83e"}
Aug 04 17:51:20.963023 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.963001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm" event={"ID":"21375c41-a4ec-4a0e-91c9-66a13d16b25b","Type":"ContainerStarted","Data":"3243a8f61f6d493af383b52ca41faa7576477077be79eddfb81b750c39ee1d7b"}
Aug 04 17:51:20.964994 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.964957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7" event={"ID":"54cfdead-6d17-4e5e-81da-741b32842ad1","Type":"ContainerStarted","Data":"63ef083101e76eebb8da4d8a4939c9ed6b57c2253f37f1f5f89bf8e1ec03eec8"}
Aug 04 17:51:20.965093 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.965010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7" event={"ID":"54cfdead-6d17-4e5e-81da-741b32842ad1","Type":"ContainerStarted","Data":"4681e0a2c22b5e7992c0355a81ad0dc21e5baa020ef386b53d88624af1d2faad"}
Aug 04 17:51:20.993646 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:20.993608    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lmzg7" podStartSLOduration=1.730998605 podStartE2EDuration="2.993595552s" totalImagesPullingTime="1.262596947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:20.992541064 +0000 UTC m=+275.368487154" watchObservedRunningTime="2026-08-04 17:51:20.993595552 +0000 UTC m=+275.369541641"
Aug 04 17:51:21.064667 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.064641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:21.166149 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.166114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:21.265789 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.265723    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:21.366106 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.366076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:21.467001 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.466970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:21.567372 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.567291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:21.617085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.617050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:21.971785 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.971715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xvrsn" event={"ID":"08e8855b-e6f6-488f-9b06-fec999662064","Type":"ContainerStarted","Data":"a687c9f6b7e1d40be50c4a626afbcabeef8eacaf6d101760d559a2fee4dc0e33"}
Aug 04 17:51:21.971785 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.971779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xvrsn" event={"ID":"08e8855b-e6f6-488f-9b06-fec999662064","Type":"ContainerStarted","Data":"502c8e8e3c48947d534fc3108c9776773c96f620d2f8a1eddb2f7c9956a85e49"}
Aug 04 17:51:21.991071 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:21.991018    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xvrsn" podStartSLOduration=2.528390416 podStartE2EDuration="3.990998071s" totalImagesPullingTime="1.398254589s" totalInitContainerRuntime="64.353066ms" isStatefulPod=true podCreationTimestamp="2026-08-04 17:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:21.989111448 +0000 UTC m=+276.365057537" watchObservedRunningTime="2026-08-04 17:51:21.990998071 +0000 UTC m=+276.366944160"
Aug 04 17:51:22.437299 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.437271    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-bf96b58cb-mtrwb"]
Aug 04 17:51:22.440905 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.440875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.444208 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.444184    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 04 17:51:22.444208 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.444205    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 04 17:51:22.444396 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.444299    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b91vhdfq4tdud\""
Aug 04 17:51:22.444564 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.444550    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 17:51:22.444627 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.444614    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tjqcc\""
Aug 04 17:51:22.445188 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.445169    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 04 17:51:22.450757 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.450736    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bf96b58cb-mtrwb"]
Aug 04 17:51:22.539690 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.539656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/909414d5-2276-4709-a111-c1291d0e275c-metrics-server-audit-profiles\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.539690 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.539689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/909414d5-2276-4709-a111-c1291d0e275c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.539876 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.539718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-secret-metrics-server-tls\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.539876 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.539772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-client-ca-bundle\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.539876 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.539794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-secret-metrics-server-client-certs\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.539876 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.539871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/909414d5-2276-4709-a111-c1291d0e275c-audit-log\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.540001 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.539909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95lfz\" (UniqueName: \"kubernetes.io/projected/909414d5-2276-4709-a111-c1291d0e275c-kube-api-access-95lfz\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.640322 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95lfz\" (UniqueName: \"kubernetes.io/projected/909414d5-2276-4709-a111-c1291d0e275c-kube-api-access-95lfz\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.640322 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/909414d5-2276-4709-a111-c1291d0e275c-metrics-server-audit-profiles\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.640322 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/909414d5-2276-4709-a111-c1291d0e275c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.640322 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-secret-metrics-server-tls\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.640532 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-client-ca-bundle\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.640532 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-secret-metrics-server-client-certs\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.640532 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/909414d5-2276-4709-a111-c1291d0e275c-audit-log\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.640904 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/909414d5-2276-4709-a111-c1291d0e275c-audit-log\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.641002 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.640972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/909414d5-2276-4709-a111-c1291d0e275c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.641289 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.641268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/909414d5-2276-4709-a111-c1291d0e275c-metrics-server-audit-profiles\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.642841 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.642803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-secret-metrics-server-tls\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.643264 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.643241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-client-ca-bundle\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.643332 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.643315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/909414d5-2276-4709-a111-c1291d0e275c-secret-metrics-server-client-certs\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.646804 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.646785    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95lfz\" (UniqueName: \"kubernetes.io/projected/909414d5-2276-4709-a111-c1291d0e275c-kube-api-access-95lfz\") pod \"metrics-server-bf96b58cb-mtrwb\" (UID: \"909414d5-2276-4709-a111-c1291d0e275c\") " pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.751671 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.751648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:22.875960 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.875938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bf96b58cb-mtrwb"]
Aug 04 17:51:22.878192 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:22.878169    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909414d5_2276_4709_a111_c1291d0e275c.slice/crio-c4304a34af97d9a15a3f04e0986847904d385027d77ae943404662f4df25eb66 WatchSource:0}: Error finding container c4304a34af97d9a15a3f04e0986847904d385027d77ae943404662f4df25eb66: Status 404 returned error can't find the container with id c4304a34af97d9a15a3f04e0986847904d385027d77ae943404662f4df25eb66
Aug 04 17:51:22.911076 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.911048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:22.928429 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.928398    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"]
Aug 04 17:51:22.934279 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.934258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:22.936481 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.936460    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7f9vx\""
Aug 04 17:51:22.936481 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.936475    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 04 17:51:22.941334 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.941264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"]
Aug 04 17:51:22.978224 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.978189    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:22.982935 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.982907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm" event={"ID":"21375c41-a4ec-4a0e-91c9-66a13d16b25b","Type":"ContainerStarted","Data":"90580418d97d1448028b715107ef214901c8bbe3078f99413467abe3cf7914fa"}
Aug 04 17:51:22.983082 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.982981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm" event={"ID":"21375c41-a4ec-4a0e-91c9-66a13d16b25b","Type":"ContainerStarted","Data":"ac7ee04c8bd0c4acd64de8d19c3599561515aab07af39ac9947a978e88fd9d9d"}
Aug 04 17:51:22.983082 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.983023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm" event={"ID":"21375c41-a4ec-4a0e-91c9-66a13d16b25b","Type":"ContainerStarted","Data":"f45a92b0bee197417c23b8da21827e13ff74375ba949a247efd9f0d9233ca4da"}
Aug 04 17:51:22.984293 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:22.984268    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb" event={"ID":"909414d5-2276-4709-a111-c1291d0e275c","Type":"ContainerStarted","Data":"c4304a34af97d9a15a3f04e0986847904d385027d77ae943404662f4df25eb66"}
Aug 04 17:51:23.044170 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.044144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56t8f\" (UniqueName: \"kubernetes.io/projected/0e297c4b-e335-4108-bf83-fd805fcf090c-kube-api-access-56t8f\") pod \"monitoring-plugin-6dffbbd67-nxq4p\" (UID: \"0e297c4b-e335-4108-bf83-fd805fcf090c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:23.044292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.044241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-nxq4p\" (UID: \"0e297c4b-e335-4108-bf83-fd805fcf090c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:23.145328 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.145299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56t8f\" (UniqueName: \"kubernetes.io/projected/0e297c4b-e335-4108-bf83-fd805fcf090c-kube-api-access-56t8f\") pod \"monitoring-plugin-6dffbbd67-nxq4p\" (UID: \"0e297c4b-e335-4108-bf83-fd805fcf090c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:23.145470 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.145425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-nxq4p\" (UID: \"0e297c4b-e335-4108-bf83-fd805fcf090c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:23.145852 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:23.145529    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Aug 04 17:51:23.145852 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:23.145592    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert podName:0e297c4b-e335-4108-bf83-fd805fcf090c nodeName:}" failed. No retries permitted until 2026-08-04 17:51:23.645572001 +0000 UTC m=+278.021518071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-nxq4p" (UID: "0e297c4b-e335-4108-bf83-fd805fcf090c") : secret "monitoring-plugin-cert" not found
Aug 04 17:51:23.152885 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.152861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56t8f\" (UniqueName: \"kubernetes.io/projected/0e297c4b-e335-4108-bf83-fd805fcf090c-kube-api-access-56t8f\") pod \"monitoring-plugin-6dffbbd67-nxq4p\" (UID: \"0e297c4b-e335-4108-bf83-fd805fcf090c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:23.528145 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.528118    2565 patch_prober.go:28] interesting pod/image-registry-6788467c67-bmdkk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 17:51:23.528254 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.528181    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6788467c67-bmdkk" podUID="e6463be9-90d7-481c-b761-daca4af7eb17" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 17:51:23.649366 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.649205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-nxq4p\" (UID: \"0e297c4b-e335-4108-bf83-fd805fcf090c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:23.649366 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:23.649326    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Aug 04 17:51:23.649533 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:23.649385    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert podName:0e297c4b-e335-4108-bf83-fd805fcf090c nodeName:}" failed. No retries permitted until 2026-08-04 17:51:24.649366982 +0000 UTC m=+279.025313057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-nxq4p" (UID: "0e297c4b-e335-4108-bf83-fd805fcf090c") : secret "monitoring-plugin-cert" not found
Aug 04 17:51:23.717441 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.717415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:23.994779 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.994743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm" event={"ID":"21375c41-a4ec-4a0e-91c9-66a13d16b25b","Type":"ContainerStarted","Data":"7474a6100b3039a4d3235088e3c865bfa3947832e3ebabee54809d03874a8b82"}
Aug 04 17:51:23.995237 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.994845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm" event={"ID":"21375c41-a4ec-4a0e-91c9-66a13d16b25b","Type":"ContainerStarted","Data":"f7550e91c14038c611573f9998a3820a3c0de1e8828133106d00939f4bda70b2"}
Aug 04 17:51:23.995237 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.994892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm" event={"ID":"21375c41-a4ec-4a0e-91c9-66a13d16b25b","Type":"ContainerStarted","Data":"baae93f5d2c394c2e18f72b2f5795800199200d522ce6479f3b3f1f17713e881"}
Aug 04 17:51:23.995237 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:23.994943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:24.016277 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.016216    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm" podStartSLOduration=1.314382857 podStartE2EDuration="4.016198351s" totalImagesPullingTime="2.701815494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:24.014904043 +0000 UTC m=+278.390850155" watchObservedRunningTime="2026-08-04 17:51:24.016198351 +0000 UTC m=+278.392144438"
Aug 04 17:51:24.335315 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.335279    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 17:51:24.339821 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.339777    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.340955 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.340108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:24.342332 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.342311    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 17:51:24.342484 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.342464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 17:51:24.342766 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.342651    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 17:51:24.342766 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.342662    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 17:51:24.343730 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.343638    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7lzxg\""
Aug 04 17:51:24.344040 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344014    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 17:51:24.344307 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344118    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1htua396c79io\""
Aug 04 17:51:24.344307 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344217    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 17:51:24.344425 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344296    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 17:51:24.344425 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344381    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 17:51:24.344561 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344538    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 17:51:24.344617 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344577    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 17:51:24.345024 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344854    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 17:51:24.345024 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344886    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 17:51:24.345024 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.344954    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 17:51:24.346396 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.346342    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 17:51:24.355921 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.355842    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 17:51:24.457108 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457108 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457309 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfp6n\" (UniqueName: \"kubernetes.io/projected/2d436223-ab74-43ef-98df-ca5699e678e6-kube-api-access-zfp6n\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457309 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457184    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457309 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457309 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d436223-ab74-43ef-98df-ca5699e678e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457309 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d436223-ab74-43ef-98df-ca5699e678e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457414    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457904 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457904 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457904 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.457904 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.457664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-config\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558229 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d436223-ab74-43ef-98df-ca5699e678e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558229 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558229 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558229 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558519 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558519 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558519 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558519 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558519 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-config\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfp6n\" (UniqueName: \"kubernetes.io/projected/2d436223-ab74-43ef-98df-ca5699e678e6-kube-api-access-zfp6n\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.558756 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d436223-ab74-43ef-98df-ca5699e678e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.559104 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.559104 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.559104 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.559104 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.558888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.559301 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.559133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.559301 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.559205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.559301 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.559219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.560131 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.559954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.561900 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.561877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.562156 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.562127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.562595 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.562566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.562697 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.562593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.563365 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.563313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.564503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.564315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-config\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.564503 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.564454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d436223-ab74-43ef-98df-ca5699e678e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.564885 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.564846    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.565085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.565067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.565145 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.565086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.565488 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.565470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.565626 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.565606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.565772 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.565749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d436223-ab74-43ef-98df-ca5699e678e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.565955 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.565935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d436223-ab74-43ef-98df-ca5699e678e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.566027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.566010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d436223-ab74-43ef-98df-ca5699e678e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.566608 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.566589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfp6n\" (UniqueName: \"kubernetes.io/projected/2d436223-ab74-43ef-98df-ca5699e678e6-kube-api-access-zfp6n\") pod \"prometheus-k8s-0\" (UID: \"2d436223-ab74-43ef-98df-ca5699e678e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.650538 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.650506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:24.661214 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.661181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-nxq4p\" (UID: \"0e297c4b-e335-4108-bf83-fd805fcf090c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:24.663743 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.663716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e297c4b-e335-4108-bf83-fd805fcf090c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-nxq4p\" (UID: \"0e297c4b-e335-4108-bf83-fd805fcf090c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:24.746188 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.746150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:24.818070 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.816199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 17:51:24.821282 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:24.819200    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d436223_ab74_43ef_98df_ca5699e678e6.slice/crio-fac2f68c0edf3a346d157b6384e924227cc4dcc43340f038cf5804fdce9083ab WatchSource:0}: Error finding container fac2f68c0edf3a346d157b6384e924227cc4dcc43340f038cf5804fdce9083ab: Status 404 returned error can't find the container with id fac2f68c0edf3a346d157b6384e924227cc4dcc43340f038cf5804fdce9083ab
Aug 04 17:51:24.891393 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.891369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"]
Aug 04 17:51:24.893406 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:24.893381    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e297c4b_e335_4108_bf83_fd805fcf090c.slice/crio-cd5a4e23aa8925257467684397ac7eba7437bb88662955090ed2fa0cc6436834 WatchSource:0}: Error finding container cd5a4e23aa8925257467684397ac7eba7437bb88662955090ed2fa0cc6436834: Status 404 returned error can't find the container with id cd5a4e23aa8925257467684397ac7eba7437bb88662955090ed2fa0cc6436834
Aug 04 17:51:24.900496 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.900468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6788467c67-bmdkk"
Aug 04 17:51:24.971864 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.971838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:25.000012 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:24.999981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb" event={"ID":"909414d5-2276-4709-a111-c1291d0e275c","Type":"ContainerStarted","Data":"2d111307601ab93fccaaf529a87c612793ed187286470299a37e271fd93563a2"}
Aug 04 17:51:25.001277 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:25.001253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d436223-ab74-43ef-98df-ca5699e678e6","Type":"ContainerStarted","Data":"fac2f68c0edf3a346d157b6384e924227cc4dcc43340f038cf5804fdce9083ab"}
Aug 04 17:51:25.002277 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:25.002256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p" event={"ID":"0e297c4b-e335-4108-bf83-fd805fcf090c","Type":"ContainerStarted","Data":"cd5a4e23aa8925257467684397ac7eba7437bb88662955090ed2fa0cc6436834"}
Aug 04 17:51:25.021927 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:25.021888    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb" podStartSLOduration=1.673133641 podStartE2EDuration="3.021875583s" totalImagesPullingTime="1.348741942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:25.02114218 +0000 UTC m=+279.397088267" watchObservedRunningTime="2026-08-04 17:51:25.021875583 +0000 UTC m=+279.397821671"
Aug 04 17:51:25.039270 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:25.039249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:25.099639 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:25.099567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:25.186224 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:25.186202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:25.234347 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:25.234326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:27.011734 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:27.011699    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d436223-ab74-43ef-98df-ca5699e678e6" containerID="b6e40adaca8a9a3fd363f91efeb896b122821f8a4ca87b0937b85f488a1deced" exitCode=0
Aug 04 17:51:27.012112 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:27.011789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d436223-ab74-43ef-98df-ca5699e678e6","Type":"ContainerDied","Data":"b6e40adaca8a9a3fd363f91efeb896b122821f8a4ca87b0937b85f488a1deced"}
Aug 04 17:51:27.013372 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:27.013350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p" event={"ID":"0e297c4b-e335-4108-bf83-fd805fcf090c","Type":"ContainerStarted","Data":"1c096aeb41670da2dcfdb50cd31239d0e06636e08b8a148332d5df669cf6c426"}
Aug 04 17:51:27.013605 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:27.013587    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:27.018235 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:27.018218    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p"
Aug 04 17:51:27.058831 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:27.057903    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nxq4p" podStartSLOduration=3.47670323 podStartE2EDuration="5.057888471s" totalImagesPullingTime="1.581185241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:27.057175309 +0000 UTC m=+281.433121401" watchObservedRunningTime="2026-08-04 17:51:27.057888471 +0000 UTC m=+281.433834560"
Aug 04 17:51:27.610410 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:51:27.610371    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-24xzt" podUID="c88e9a87-eb1f-4b5b-850b-6b875d47aeaf"
Aug 04 17:51:28.017480 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:28.017452    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24xzt"
Aug 04 17:51:30.009494 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:30.009471    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6dd876f8f4-4q7hm"
Aug 04 17:51:30.027372 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:30.027350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d436223-ab74-43ef-98df-ca5699e678e6","Type":"ContainerStarted","Data":"9ad147ed8b6898427a0e187e0d2ab0838a742945a42d9ff25b29329a574027b1"}
Aug 04 17:51:31.021956 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.021922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:51:31.024159 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.024129    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c88e9a87-eb1f-4b5b-850b-6b875d47aeaf-metrics-tls\") pod \"dns-default-24xzt\" (UID: \"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf\") " pod="openshift-dns/dns-default-24xzt"
Aug 04 17:51:31.037481 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.037456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d436223-ab74-43ef-98df-ca5699e678e6","Type":"ContainerStarted","Data":"7dbf70a231d2dbc1e9e10609542b621b189b014391db3dafa7aea7c4d4951279"}
Aug 04 17:51:31.037585 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.037559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d436223-ab74-43ef-98df-ca5699e678e6","Type":"ContainerStarted","Data":"11dd8532a47dc87e0674c3ea9429be5d66ec3cf97d5d4df4502128180518819c"}
Aug 04 17:51:31.037641 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.037602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d436223-ab74-43ef-98df-ca5699e678e6","Type":"ContainerStarted","Data":"85dc7dacaf590cda849282fcf93d65d35b62d6901e5404c93e3b1f67d7f5643f"}
Aug 04 17:51:31.037708 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.037643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d436223-ab74-43ef-98df-ca5699e678e6","Type":"ContainerStarted","Data":"9f6067b500bda80a9573bd7451b271f80724c4d636fbe14a30120cc925cb925c"}
Aug 04 17:51:31.037708 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.037680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d436223-ab74-43ef-98df-ca5699e678e6","Type":"ContainerStarted","Data":"8128acaac8b8861cb83b924eb7049801528bb73f8c5499ce7106ad542b8601c1"}
Aug 04 17:51:31.064395 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.064348    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.993665453 podStartE2EDuration="7.064334821s" totalImagesPullingTime="4.051785832s" totalInitContainerRuntime="18.883536ms" isStatefulPod=false podCreationTimestamp="2026-08-04 17:51:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:31.062037021 +0000 UTC m=+285.437983110" watchObservedRunningTime="2026-08-04 17:51:31.064334821 +0000 UTC m=+285.440280909"
Aug 04 17:51:31.320580 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.320523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56pss\""
Aug 04 17:51:31.328616 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.328597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24xzt"
Aug 04 17:51:31.448644 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.448604    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-24xzt"]
Aug 04 17:51:31.450703 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:51:31.450676    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88e9a87_eb1f_4b5b_850b_6b875d47aeaf.slice/crio-76318b43e331914cb29acdb172a8049280d1891217176d4c24002e67bf5ff63f WatchSource:0}: Error finding container 76318b43e331914cb29acdb172a8049280d1891217176d4c24002e67bf5ff63f: Status 404 returned error can't find the container with id 76318b43e331914cb29acdb172a8049280d1891217176d4c24002e67bf5ff63f
Aug 04 17:51:31.538109 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:31.538073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:32.043280 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:32.043247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24xzt" event={"ID":"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf","Type":"ContainerStarted","Data":"76318b43e331914cb29acdb172a8049280d1891217176d4c24002e67bf5ff63f"}
Aug 04 17:51:32.980442 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:32.980417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:33.052081 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:33.052021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24xzt" event={"ID":"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf","Type":"ContainerStarted","Data":"56515fe4f3a5656d4bdcd7dd2ff7448fbd4c5776a43efd78de51fc8401dea032"}
Aug 04 17:51:34.058199 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:34.058168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24xzt" event={"ID":"c88e9a87-eb1f-4b5b-850b-6b875d47aeaf","Type":"ContainerStarted","Data":"355d10e259480353855289b4d1e25e45bef2c0106d31d3a916b86768b80e34b6"}
Aug 04 17:51:34.058537 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:34.058300    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-24xzt"
Aug 04 17:51:34.076107 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:34.076059    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-24xzt" podStartSLOduration=252.604268264 podStartE2EDuration="4m14.076046105s" totalImagesPullingTime="1.471777841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:51:34.074120185 +0000 UTC m=+288.450066273" watchObservedRunningTime="2026-08-04 17:51:34.076046105 +0000 UTC m=+288.451992193"
Aug 04 17:51:34.650720 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:34.650681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:51:34.848340 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:34.848292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:34.901665 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:34.901588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:34.957094 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:34.957063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:35.683070 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:35.683041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:35.755138 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:35.755113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:39.732095 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:39.732062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:39.833854 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:39.833828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:42.752630 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:42.752596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:42.753147 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:42.752670    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:51:44.068858 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:44.068828    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-24xzt"
Aug 04 17:51:44.763695 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:44.763660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:44.862560 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:44.862534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:45.998513 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:45.998483    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 17:51:45.999435 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:45.999411    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 17:51:46.006041 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:46.006018    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:51:46.006754 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:46.006735    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:51:46.009146 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:46.009128    2565 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 17:51:47.657421 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:47.657366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:47.708817 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:47.708775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:53.140269 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:53.140236    2565 generic.go:356] "Generic (PLEG): container finished" podID="1bc3391c-d508-4056-bc0f-4543d0af0ad0" containerID="2c67a6813493dd229b41db2b5fb0d528705703d613394fcaa0bf4897cbc1df57" exitCode=0
Aug 04 17:51:53.140552 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:53.140292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr" event={"ID":"1bc3391c-d508-4056-bc0f-4543d0af0ad0","Type":"ContainerDied","Data":"2c67a6813493dd229b41db2b5fb0d528705703d613394fcaa0bf4897cbc1df57"}
Aug 04 17:51:53.140592 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:53.140558    2565 scope.go:117] "RemoveContainer" containerID="2c67a6813493dd229b41db2b5fb0d528705703d613394fcaa0bf4897cbc1df57"
Aug 04 17:51:53.190897 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:53.190875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:53.291164 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:53.291133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:51:54.146449 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:51:54.146409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-jzchr" event={"ID":"1bc3391c-d508-4056-bc0f-4543d0af0ad0","Type":"ContainerStarted","Data":"433da9d8610bca3ff868f86da420e504455fba5d8883e66e247f9b6361dec4b0"}
Aug 04 17:52:02.662235 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:02.662202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:02.721886 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:02.721858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:02.757557 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:02.757534    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:52:02.761190 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:02.761165    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-bf96b58cb-mtrwb"
Aug 04 17:52:02.870011 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:02.869985    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:02.923926 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:02.923868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:24.651352 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:24.651321    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:52:24.669494 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:24.669472    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:52:25.288747 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:25.288715    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 17:52:37.348422 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:37.348373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:37.957847 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:37.957795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:39.138202 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:39.138168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:39.197302 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:39.197275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:46.133171 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:46.133141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:46.189622 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:46.189591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:52.639405 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:52.639373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:52.691859 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:52.691826    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:53.704609 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:53.704577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:54.312104 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:54.312073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:52:54.379671 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:52:54.379636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:04.205551 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:04.205507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:04.306765 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:04.306740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:04.359566 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:04.359540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:04.543252 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:04.543156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:04.595313 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:04.595288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:17.667328 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:17.667292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:17.767725 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:17.767691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:28.568955 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:28.568924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:53:28.623042 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:53:28.623017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:08.608334 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:08.608245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:22.487001 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:22.486968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:22.558791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:22.558764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:28.155853 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:28.155799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:28.254476 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:28.254446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:54.628900 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:54.628869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:54.776061 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:54.776019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:55.770104 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:55.770060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:58.783013 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:58.782968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:54:58.843655 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:54:58.843628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:00.378120 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:00.378089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:00.478428 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:00.478401    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:00.935668 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:00.935642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:01.036219 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:01.036171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:02.858106 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:02.858076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:02.986250 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:02.986224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:05.587331 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:05.587288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:05.687547 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:05.687521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:09.492511 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:09.492476    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:09.582894 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:09.582851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:10.583720 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:10.583690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:14.506460 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:14.506412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:14.607144 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:14.607117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:21.252077 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:21.252045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:21.353818 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:21.353790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:23.287181 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:23.287150    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:35.108523 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:35.108479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:35.309014 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:35.308982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:35.723945 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:35.723913    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:35.924434 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:35.924405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:36.030081 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.029997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:36.090753 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.090725    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"]
Aug 04 17:55:36.093029 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.093012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.096459 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.096443    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 17:55:36.096642 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.096619    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 17:55:36.096754 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.096732    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6m798\""
Aug 04 17:55:36.097011 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.096994    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 17:55:36.097195 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.097179    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 17:55:36.126507 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.126489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"]
Aug 04 17:55:36.203710 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.203684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e367b66c-ace3-405b-b891-1a0863821fc6-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.203872 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.203721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bddzl\" (UniqueName: \"kubernetes.io/projected/e367b66c-ace3-405b-b891-1a0863821fc6-kube-api-access-bddzl\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.203872 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.203759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e367b66c-ace3-405b-b891-1a0863821fc6-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.203872 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.203793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e367b66c-ace3-405b-b891-1a0863821fc6-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.204027 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.203906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e367b66c-ace3-405b-b891-1a0863821fc6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.304575 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.304513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e367b66c-ace3-405b-b891-1a0863821fc6-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.304575 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.304549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e367b66c-ace3-405b-b891-1a0863821fc6-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.304717 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.304595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e367b66c-ace3-405b-b891-1a0863821fc6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.304717 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.304638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e367b66c-ace3-405b-b891-1a0863821fc6-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.304717 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.304669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bddzl\" (UniqueName: \"kubernetes.io/projected/e367b66c-ace3-405b-b891-1a0863821fc6-kube-api-access-bddzl\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.305056 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.305033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e367b66c-ace3-405b-b891-1a0863821fc6-manifests\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.306853 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.306832    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e367b66c-ace3-405b-b891-1a0863821fc6-tmp\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.307072 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.307054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e367b66c-ace3-405b-b891-1a0863821fc6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.307190 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.307169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e367b66c-ace3-405b-b891-1a0863821fc6-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.318571 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.318549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bddzl\" (UniqueName: \"kubernetes.io/projected/e367b66c-ace3-405b-b891-1a0863821fc6-kube-api-access-bddzl\") pod \"opendatahub-operator-controller-manager-cddfbf4d9-kqd7g\" (UID: \"e367b66c-ace3-405b-b891-1a0863821fc6\") " pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.322038 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.322019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:36.403025 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.403001    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:36.420840 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.420793    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:36.516339 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.516308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:36.529538 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.529519    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"]
Aug 04 17:55:36.532223 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:55:36.532199    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode367b66c_ace3_405b_b891_1a0863821fc6.slice/crio-b835143d2d1ba73c63bff59d6728a384ccd91a25b43cdd29faf36f41f772a54e WatchSource:0}: Error finding container b835143d2d1ba73c63bff59d6728a384ccd91a25b43cdd29faf36f41f772a54e: Status 404 returned error can't find the container with id b835143d2d1ba73c63bff59d6728a384ccd91a25b43cdd29faf36f41f772a54e
Aug 04 17:55:36.533900 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.533885    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 17:55:36.587624 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.587572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:36.688506 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.688484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:36.790064 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.790041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:36.893509 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:36.893433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:37.026935 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:37.026913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g" event={"ID":"e367b66c-ace3-405b-b891-1a0863821fc6","Type":"ContainerStarted","Data":"b835143d2d1ba73c63bff59d6728a384ccd91a25b43cdd29faf36f41f772a54e"}
Aug 04 17:55:39.636673 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:39.636597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:39.725738 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:39.725704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:39.827056 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:39.827025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:40.047051 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:40.047025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g" event={"ID":"e367b66c-ace3-405b-b891-1a0863821fc6","Type":"ContainerStarted","Data":"bba32a480d0d5abaee94923baf1e82eb473f35449421381c1f5aa518b80e4b36"}
Aug 04 17:55:41.054600 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:41.054567    2565 generic.go:356] "Generic (PLEG): container finished" podID="e367b66c-ace3-405b-b891-1a0863821fc6" containerID="bba32a480d0d5abaee94923baf1e82eb473f35449421381c1f5aa518b80e4b36" exitCode=0
Aug 04 17:55:41.054989 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:41.054649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g" event={"ID":"e367b66c-ace3-405b-b891-1a0863821fc6","Type":"ContainerDied","Data":"bba32a480d0d5abaee94923baf1e82eb473f35449421381c1f5aa518b80e4b36"}
Aug 04 17:55:42.063933 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:42.063899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g" event={"ID":"e367b66c-ace3-405b-b891-1a0863821fc6","Type":"ContainerStarted","Data":"1d5550b5c477d2ce0898ef7ec64606fefccf211504955d5516a20ed9657d943b"}
Aug 04 17:55:42.064275 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:42.063956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:42.084971 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:42.084925    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g" podStartSLOduration=2.008851193 podStartE2EDuration="6.08491134s" totalImagesPullingTime="3.129593344s" totalInitContainerRuntime="946.466803ms" isStatefulPod=false podCreationTimestamp="2026-08-04 17:55:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:55:42.08389764 +0000 UTC m=+536.459843740" watchObservedRunningTime="2026-08-04 17:55:42.08491134 +0000 UTC m=+536.460857428"
Aug 04 17:55:45.265013 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:45.264980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:45.325240 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:45.325211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:53.066770 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:53.066741    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cddfbf4d9-kqd7g"
Aug 04 17:55:57.444896 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:57.444864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:57.548102 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:57.548065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:57.679316 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:57.679287    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:57.849059 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:57.848972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:58.122912 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:58.122818    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:58.216626 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:58.216594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:58.281085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:58.281050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:58.611771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:58.611735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:58.931598 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:58.931572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:59.085461 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:59.085424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:55:59.228291 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:55:59.228206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:00.106573 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:00.106537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:04.387954 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:04.387917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:04.488965 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:04.488933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:04.710588 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:04.710554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:04.854982 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:04.854950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:04.954100 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:04.954074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:05.053265 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.053184    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"]
Aug 04 17:56:05.064230 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.064203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.066931 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.066905    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 17:56:05.067085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.066935    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 17:56:05.067085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.066935    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vp6rf\""
Aug 04 17:56:05.067085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.067031    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 17:56:05.067085 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.067047    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 17:56:05.067293 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.067152    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 17:56:05.067293 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.067217    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 17:56:05.074483 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.074460    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"]
Aug 04 17:56:05.139733 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.139708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.139890 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.139735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.139890 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.139773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.139890 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.139797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.139991 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.139900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eab0375-0d78-40ed-824a-a94efcf0686d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.139991 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.139929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.139991 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.139946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcwnz\" (UniqueName: \"kubernetes.io/projected/1eab0375-0d78-40ed-824a-a94efcf0686d-kube-api-access-dcwnz\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.241011 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.240971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.241011 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.241010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.241202 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.241042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.241237 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.241214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.241316 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.241300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eab0375-0d78-40ed-824a-a94efcf0686d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.241353 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.241328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.241393 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.241356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcwnz\" (UniqueName: \"kubernetes.io/projected/1eab0375-0d78-40ed-824a-a94efcf0686d-kube-api-access-dcwnz\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.241963 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.241942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.243406 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.243385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.243490 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.243472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.243721 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.243701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eab0375-0d78-40ed-824a-a94efcf0686d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.243721 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.243712    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1eab0375-0d78-40ed-824a-a94efcf0686d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.257108 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.257088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcwnz\" (UniqueName: \"kubernetes.io/projected/1eab0375-0d78-40ed-824a-a94efcf0686d-kube-api-access-dcwnz\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.258524 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.258505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eab0375-0d78-40ed-824a-a94efcf0686d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q7n7r\" (UID: \"1eab0375-0d78-40ed-824a-a94efcf0686d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.376272 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.376219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:05.502043 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:05.502019    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"]
Aug 04 17:56:05.503915 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:56:05.503880    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eab0375_0d78_40ed_824a_a94efcf0686d.slice/crio-613b7f4ea8e141f47d1aac7726d4bb8caba7d53b14e4fb00e70bf9f3df9fd0ab WatchSource:0}: Error finding container 613b7f4ea8e141f47d1aac7726d4bb8caba7d53b14e4fb00e70bf9f3df9fd0ab: Status 404 returned error can't find the container with id 613b7f4ea8e141f47d1aac7726d4bb8caba7d53b14e4fb00e70bf9f3df9fd0ab
Aug 04 17:56:06.015626 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.015564    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"]
Aug 04 17:56:06.018429 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.018413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.020667 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.020649    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 17:56:06.021538 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.021503    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jbk9j\""
Aug 04 17:56:06.021538 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.021530    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 17:56:06.021690 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.021570    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 17:56:06.021796 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.021779    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 17:56:06.021796 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.021791    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 17:56:06.030551 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.030529    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"]
Aug 04 17:56:06.149087 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.149062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjf9\" (UniqueName: \"kubernetes.io/projected/b5a8e5c3-29b3-452f-9140-85c45408d382-kube-api-access-njjf9\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.149227 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.149140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5a8e5c3-29b3-452f-9140-85c45408d382-metrics-cert\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.149227 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.149163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5a8e5c3-29b3-452f-9140-85c45408d382-manager-config\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.149322 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.149228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a8e5c3-29b3-452f-9140-85c45408d382-cert\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.158723 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.158695    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r" event={"ID":"1eab0375-0d78-40ed-824a-a94efcf0686d","Type":"ContainerStarted","Data":"613b7f4ea8e141f47d1aac7726d4bb8caba7d53b14e4fb00e70bf9f3df9fd0ab"}
Aug 04 17:56:06.249972 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.249946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjf9\" (UniqueName: \"kubernetes.io/projected/b5a8e5c3-29b3-452f-9140-85c45408d382-kube-api-access-njjf9\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.250161 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.250012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5a8e5c3-29b3-452f-9140-85c45408d382-metrics-cert\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.250161 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.250034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5a8e5c3-29b3-452f-9140-85c45408d382-manager-config\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.250161 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.250088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a8e5c3-29b3-452f-9140-85c45408d382-cert\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.250769 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.250745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b5a8e5c3-29b3-452f-9140-85c45408d382-manager-config\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.252477 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.252448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5a8e5c3-29b3-452f-9140-85c45408d382-cert\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.252551 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.252483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5a8e5c3-29b3-452f-9140-85c45408d382-metrics-cert\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.275535 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.275490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjf9\" (UniqueName: \"kubernetes.io/projected/b5a8e5c3-29b3-452f-9140-85c45408d382-kube-api-access-njjf9\") pod \"lws-controller-manager-564c4ff8f7-8m4z4\" (UID: \"b5a8e5c3-29b3-452f-9140-85c45408d382\") " pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.328469 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.328449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:06.450842 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:06.450798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"]
Aug 04 17:56:06.454288 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:56:06.454256    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a8e5c3_29b3_452f_9140_85c45408d382.slice/crio-ca0ef66d80cf5b2ae624e784b20442af6ab5db4175fcac0855998087d6b8155e WatchSource:0}: Error finding container ca0ef66d80cf5b2ae624e784b20442af6ab5db4175fcac0855998087d6b8155e: Status 404 returned error can't find the container with id ca0ef66d80cf5b2ae624e784b20442af6ab5db4175fcac0855998087d6b8155e
Aug 04 17:56:07.164988 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:07.164951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4" event={"ID":"b5a8e5c3-29b3-452f-9140-85c45408d382","Type":"ContainerStarted","Data":"ca0ef66d80cf5b2ae624e784b20442af6ab5db4175fcac0855998087d6b8155e"}
Aug 04 17:56:07.754829 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:07.754716    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:07.840306 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:07.840242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:08.092213 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:08.092124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:08.258151 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:08.258108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:08.344589 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:08.344508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:08.578283 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:08.578253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:09.001207 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:09.001177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:09.092752 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:09.092706    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:09.590626 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:09.590587    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:56:09.591010 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:09.590691    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:56:10.183598 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:10.183562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r" event={"ID":"1eab0375-0d78-40ed-824a-a94efcf0686d","Type":"ContainerStarted","Data":"0ae861a76dbaf9723f179059068f122f37084893cf336aa6e75c71da9a0b8c52"}
Aug 04 17:56:10.183855 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:10.183822    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:10.185281 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:10.185252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4" event={"ID":"b5a8e5c3-29b3-452f-9140-85c45408d382","Type":"ContainerStarted","Data":"952334a3e969e58763a16a829b186b0d9d93ae0428050bf8d0dc86fb2e9d3ada"}
Aug 04 17:56:10.185399 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:10.185372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:10.185835 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:10.185796    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-q7n7r container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 17:56:10.185991 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:10.185874    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r" podUID="1eab0375-0d78-40ed-824a-a94efcf0686d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 17:56:10.205907 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:10.205870    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r" podStartSLOduration=1.121324569 podStartE2EDuration="5.205857308s" totalImagesPullingTime="4.084532739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:10.20375081 +0000 UTC m=+564.579696900" watchObservedRunningTime="2026-08-04 17:56:10.205857308 +0000 UTC m=+564.581803396"
Aug 04 17:56:10.221681 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:10.221642    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4" podStartSLOduration=2.032049345 podStartE2EDuration="5.221629802s" totalImagesPullingTime="3.189580457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:56:10.220823061 +0000 UTC m=+564.596769148" watchObservedRunningTime="2026-08-04 17:56:10.221629802 +0000 UTC m=+564.597575890"
Aug 04 17:56:11.191346 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:11.191320    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7n7r"
Aug 04 17:56:20.082743 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:20.082709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:20.182264 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:20.182235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:20.283232 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:20.283205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:21.192346 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:21.192317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-564c4ff8f7-8m4z4"
Aug 04 17:56:33.311566 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:33.311534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:46.026936 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:46.026906    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 17:56:46.028067 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:46.028045    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 17:56:46.033304 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:46.033286    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:56:46.034438 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:46.034420    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 17:56:48.391521 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:48.391488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:48.485786 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:48.485762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:50.345773 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:50.345738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:50.406766 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:50.406737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:59.533934 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:59.533899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:56:59.704830 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:56:59.704767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:18.995033 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:18.994932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:21.393344 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:21.393316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:21.800560 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:21.800502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:23.911370 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:23.911316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:24.013874 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:24.013844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:24.586297 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:24.586259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:25.004427 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:25.004400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:26.045953 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:26.045918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:27.058705 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:27.058674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:27.179781 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:27.179753    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:28.410940 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:28.410892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:29.062327 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:29.062297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:31.430903 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:31.430870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:31.521214 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:31.521187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:35.392338 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:35.392310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:35.492699 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:35.492672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:35.801985 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:35.801959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:35.902674 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:35.902642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:36.773971 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:36.773937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:36.978766 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:36.978734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:40.795210 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:40.795175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:40.911694 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:40.911669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:40.985685 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:40.985658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:46.616592 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.616559    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"]
Aug 04 17:57:46.619866 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.619850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:46.622945 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.622925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ttcms\""
Aug 04 17:57:46.623477 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.623458    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 17:57:46.623723 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.623708    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 17:57:46.641367 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.641343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d002f91c-b20f-496d-978b-fe4c75104342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-krrc4\" (UID: \"d002f91c-b20f-496d-978b-fe4c75104342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:46.641453 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.641401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmtx\" (UniqueName: \"kubernetes.io/projected/d002f91c-b20f-496d-978b-fe4c75104342-kube-api-access-6fmtx\") pod \"kuadrant-operator-controller-manager-96db98c47-krrc4\" (UID: \"d002f91c-b20f-496d-978b-fe4c75104342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:46.645867 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.645848    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"]
Aug 04 17:57:46.742626 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.742606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d002f91c-b20f-496d-978b-fe4c75104342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-krrc4\" (UID: \"d002f91c-b20f-496d-978b-fe4c75104342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:46.742727 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.742675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmtx\" (UniqueName: \"kubernetes.io/projected/d002f91c-b20f-496d-978b-fe4c75104342-kube-api-access-6fmtx\") pod \"kuadrant-operator-controller-manager-96db98c47-krrc4\" (UID: \"d002f91c-b20f-496d-978b-fe4c75104342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:46.742970 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.742953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d002f91c-b20f-496d-978b-fe4c75104342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-krrc4\" (UID: \"d002f91c-b20f-496d-978b-fe4c75104342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:46.750512 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.750495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmtx\" (UniqueName: \"kubernetes.io/projected/d002f91c-b20f-496d-978b-fe4c75104342-kube-api-access-6fmtx\") pod \"kuadrant-operator-controller-manager-96db98c47-krrc4\" (UID: \"d002f91c-b20f-496d-978b-fe4c75104342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:46.929201 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:46.929180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:47.061969 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.061948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"]
Aug 04 17:57:47.064172 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:57:47.064146    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd002f91c_b20f_496d_978b_fe4c75104342.slice/crio-b5b49ad15b526eb9c40439a578b3a206891875316472cb37a429f4aeb92e1028 WatchSource:0}: Error finding container b5b49ad15b526eb9c40439a578b3a206891875316472cb37a429f4aeb92e1028: Status 404 returned error can't find the container with id b5b49ad15b526eb9c40439a578b3a206891875316472cb37a429f4aeb92e1028
Aug 04 17:57:47.277255 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.277183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:47.376483 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.376449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:47.504082 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.504052    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"]
Aug 04 17:57:47.511840 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.511793    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"]
Aug 04 17:57:47.530011 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.529946    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"]
Aug 04 17:57:47.534561 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.534537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:47.550850 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.550793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-zv7b5\" (UID: \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:47.550972 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.550945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwvz2\" (UniqueName: \"kubernetes.io/projected/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-kube-api-access-cwvz2\") pod \"kuadrant-operator-controller-manager-96db98c47-zv7b5\" (UID: \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:47.551133 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.551115    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"]
Aug 04 17:57:47.651610 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.651580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwvz2\" (UniqueName: \"kubernetes.io/projected/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-kube-api-access-cwvz2\") pod \"kuadrant-operator-controller-manager-96db98c47-zv7b5\" (UID: \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:47.651981 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.651678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-zv7b5\" (UID: \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:47.652041 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.652024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-zv7b5\" (UID: \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:47.658905 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.658877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwvz2\" (UniqueName: \"kubernetes.io/projected/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-kube-api-access-cwvz2\") pod \"kuadrant-operator-controller-manager-96db98c47-zv7b5\" (UID: \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:47.846660 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.846601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:47.981079 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:47.981045    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"]
Aug 04 17:57:47.983981 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:57:47.983948    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b59fef1_583c_4ec8_95f1_fe1ac6188a8e.slice/crio-f2e53a6c0a4f77d4d43443893e2a626cefc1b61c5a620d97c49ff80a0baed026 WatchSource:0}: Error finding container f2e53a6c0a4f77d4d43443893e2a626cefc1b61c5a620d97c49ff80a0baed026: Status 404 returned error can't find the container with id f2e53a6c0a4f77d4d43443893e2a626cefc1b61c5a620d97c49ff80a0baed026
Aug 04 17:57:48.617345 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:48.617272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5" event={"ID":"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e","Type":"ContainerStarted","Data":"f2e53a6c0a4f77d4d43443893e2a626cefc1b61c5a620d97c49ff80a0baed026"}
Aug 04 17:57:51.443786 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.443754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:51.609049 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.609016    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:51.637710 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.637679    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4" podUID="d002f91c-b20f-496d-978b-fe4c75104342" containerName="manager" containerID="cri-o://f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4" gracePeriod=2
Aug 04 17:57:51.639443 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.639420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5" event={"ID":"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e","Type":"ContainerStarted","Data":"78292b67e94b39d09c9565010192522364fc76eb8ad2bb80c0ec6bba36183814"}
Aug 04 17:57:51.639549 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.639514    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:57:51.663823 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.663765    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5" podStartSLOduration=1.161177177 podStartE2EDuration="4.663752061s" totalImagesPullingTime="3.502574884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:57:51.661374513 +0000 UTC m=+666.037320604" watchObservedRunningTime="2026-08-04 17:57:51.663752061 +0000 UTC m=+666.039698150"
Aug 04 17:57:51.673754 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.673719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:51.888686 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.888661    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:51.890746 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:57:51.890717    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-krrc4\" is forbidden: User \"system:node:ip-10-0-140-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-41.ec2.internal' and this object" podUID="d002f91c-b20f-496d-978b-fe4c75104342" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:51.997879 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.997850    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fmtx\" (UniqueName: \"kubernetes.io/projected/d002f91c-b20f-496d-978b-fe4c75104342-kube-api-access-6fmtx\") pod \"d002f91c-b20f-496d-978b-fe4c75104342\" (UID: \"d002f91c-b20f-496d-978b-fe4c75104342\") "
Aug 04 17:57:51.998040 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.997900    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d002f91c-b20f-496d-978b-fe4c75104342-extensions-socket-volume\") pod \"d002f91c-b20f-496d-978b-fe4c75104342\" (UID: \"d002f91c-b20f-496d-978b-fe4c75104342\") "
Aug 04 17:57:51.998190 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.998168    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d002f91c-b20f-496d-978b-fe4c75104342-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d002f91c-b20f-496d-978b-fe4c75104342" (UID: "d002f91c-b20f-496d-978b-fe4c75104342"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:57:51.999932 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:51.999907    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d002f91c-b20f-496d-978b-fe4c75104342-kube-api-access-6fmtx" (OuterVolumeSpecName: "kube-api-access-6fmtx") pod "d002f91c-b20f-496d-978b-fe4c75104342" (UID: "d002f91c-b20f-496d-978b-fe4c75104342"). InnerVolumeSpecName "kube-api-access-6fmtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:57:52.065146 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:52.065083    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d002f91c-b20f-496d-978b-fe4c75104342" path="/var/lib/kubelet/pods/d002f91c-b20f-496d-978b-fe4c75104342/volumes"
Aug 04 17:57:52.099251 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:52.099230    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d002f91c-b20f-496d-978b-fe4c75104342-extensions-socket-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 17:57:52.099251 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:52.099251    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fmtx\" (UniqueName: \"kubernetes.io/projected/d002f91c-b20f-496d-978b-fe4c75104342-kube-api-access-6fmtx\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 17:57:52.644910 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:52.644879    2565 generic.go:356] "Generic (PLEG): container finished" podID="d002f91c-b20f-496d-978b-fe4c75104342" containerID="f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4" exitCode=2
Aug 04 17:57:52.645302 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:52.644924    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:52.645302 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:52.644982    2565 scope.go:117] "RemoveContainer" containerID="f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4"
Aug 04 17:57:52.649397 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:57:52.649373    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-krrc4\" is forbidden: User \"system:node:ip-10-0-140-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-41.ec2.internal' and this object" podUID="d002f91c-b20f-496d-978b-fe4c75104342" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-krrc4"
Aug 04 17:57:52.653368 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:52.653354    2565 scope.go:117] "RemoveContainer" containerID="f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4"
Aug 04 17:57:52.653634 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:57:52.653607    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4\": container with ID starting with f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4 not found: ID does not exist" containerID="f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4"
Aug 04 17:57:52.653679 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:52.653633    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4"} err="failed to get container status \"f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4\": rpc error: code = NotFound desc = could not find container \"f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4\": container with ID starting with f0dc996690e7b6346f84e07bce724541558d4a21d8f522d3f9fba46467ce32e4 not found: ID does not exist"
Aug 04 17:57:55.396925 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:55.396899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:55.497103 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:55.497079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:55.597515 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:55.597487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:55.651322 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:55.651253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:57:57.840053 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:57:57.840025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:00.998877 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:00.998839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:01.099442 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:01.099410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:01.199602 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:01.199572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:01.257681 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:01.257612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:01.398437 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:01.398412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:01.499123 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:01.499074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:02.647223 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:02.647201    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:58:10.690805 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:10.690771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:11.004417 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:11.004338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:14.615218 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.615187    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"]
Aug 04 17:58:14.615555 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.615374    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5" podUID="9b59fef1-583c-4ec8-95f1-fe1ac6188a8e" containerName="manager" containerID="cri-o://78292b67e94b39d09c9565010192522364fc76eb8ad2bb80c0ec6bba36183814" gracePeriod=10
Aug 04 17:58:14.751578 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.751546    2565 generic.go:356] "Generic (PLEG): container finished" podID="9b59fef1-583c-4ec8-95f1-fe1ac6188a8e" containerID="78292b67e94b39d09c9565010192522364fc76eb8ad2bb80c0ec6bba36183814" exitCode=0
Aug 04 17:58:14.751701 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.751615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5" event={"ID":"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e","Type":"ContainerDied","Data":"78292b67e94b39d09c9565010192522364fc76eb8ad2bb80c0ec6bba36183814"}
Aug 04 17:58:14.856518 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.856498    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:58:14.967351 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.967323    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-extensions-socket-volume\") pod \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\" (UID: \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\") "
Aug 04 17:58:14.967493 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.967426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwvz2\" (UniqueName: \"kubernetes.io/projected/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-kube-api-access-cwvz2\") pod \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\" (UID: \"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e\") "
Aug 04 17:58:14.967770 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.967749    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b59fef1-583c-4ec8-95f1-fe1ac6188a8e" (UID: "9b59fef1-583c-4ec8-95f1-fe1ac6188a8e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:58:14.969344 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:14.969319    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-kube-api-access-cwvz2" (OuterVolumeSpecName: "kube-api-access-cwvz2") pod "9b59fef1-583c-4ec8-95f1-fe1ac6188a8e" (UID: "9b59fef1-583c-4ec8-95f1-fe1ac6188a8e"). InnerVolumeSpecName "kube-api-access-cwvz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:58:15.068870 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.068834    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwvz2\" (UniqueName: \"kubernetes.io/projected/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-kube-api-access-cwvz2\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 17:58:15.068870 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.068868    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e-extensions-socket-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 17:58:15.516212 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.516182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:15.614875 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.614849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:15.757771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.757744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5" event={"ID":"9b59fef1-583c-4ec8-95f1-fe1ac6188a8e","Type":"ContainerDied","Data":"f2e53a6c0a4f77d4d43443893e2a626cefc1b61c5a620d97c49ff80a0baed026"}
Aug 04 17:58:15.757771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.757768    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"
Aug 04 17:58:15.758199 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.757826    2565 scope.go:117] "RemoveContainer" containerID="78292b67e94b39d09c9565010192522364fc76eb8ad2bb80c0ec6bba36183814"
Aug 04 17:58:15.780563 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.780517    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"]
Aug 04 17:58:15.790978 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:15.790957    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-zv7b5"]
Aug 04 17:58:16.065126 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:16.065058    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b59fef1-583c-4ec8-95f1-fe1ac6188a8e" path="/var/lib/kubelet/pods/9b59fef1-583c-4ec8-95f1-fe1ac6188a8e/volumes"
Aug 04 17:58:19.311714 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:19.311682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:19.548176 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:19.548146    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:29.033028 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:29.032990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:34.866261 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.866230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:34.878075 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.878045    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"]
Aug 04 17:58:34.878375 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.878364    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b59fef1-583c-4ec8-95f1-fe1ac6188a8e" containerName="manager"
Aug 04 17:58:34.878419 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.878377    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b59fef1-583c-4ec8-95f1-fe1ac6188a8e" containerName="manager"
Aug 04 17:58:34.878419 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.878399    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d002f91c-b20f-496d-978b-fe4c75104342" containerName="manager"
Aug 04 17:58:34.878419 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.878405    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d002f91c-b20f-496d-978b-fe4c75104342" containerName="manager"
Aug 04 17:58:34.878508 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.878456    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d002f91c-b20f-496d-978b-fe4c75104342" containerName="manager"
Aug 04 17:58:34.878508 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.878467    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b59fef1-583c-4ec8-95f1-fe1ac6188a8e" containerName="manager"
Aug 04 17:58:34.882763 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.882747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:34.885152 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.885130    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 17:58:34.885263 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.885199    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 17:58:34.885897 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.885879    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 17:58:34.886001 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.885879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rwkxm\""
Aug 04 17:58:34.890087 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.890069    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"]
Aug 04 17:58:34.973176 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.973148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"]
Aug 04 17:58:34.989167 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:34.989137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:35.026250 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.026222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfcnt\" (UniqueName: \"kubernetes.io/projected/301ffe63-8ceb-4d8c-83a4-ef28c0967637-kube-api-access-gfcnt\") pod \"limitador-limitador-859c4d96d6-6jr5g\" (UID: \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:35.026342 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.026288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/301ffe63-8ceb-4d8c-83a4-ef28c0967637-config-file\") pod \"limitador-limitador-859c4d96d6-6jr5g\" (UID: \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:35.085147 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.085120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:35.127157 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.127105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/301ffe63-8ceb-4d8c-83a4-ef28c0967637-config-file\") pod \"limitador-limitador-859c4d96d6-6jr5g\" (UID: \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:35.127263 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.127249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfcnt\" (UniqueName: \"kubernetes.io/projected/301ffe63-8ceb-4d8c-83a4-ef28c0967637-kube-api-access-gfcnt\") pod \"limitador-limitador-859c4d96d6-6jr5g\" (UID: \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:35.127688 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.127672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/301ffe63-8ceb-4d8c-83a4-ef28c0967637-config-file\") pod \"limitador-limitador-859c4d96d6-6jr5g\" (UID: \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:35.135145 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.135121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfcnt\" (UniqueName: \"kubernetes.io/projected/301ffe63-8ceb-4d8c-83a4-ef28c0967637-kube-api-access-gfcnt\") pod \"limitador-limitador-859c4d96d6-6jr5g\" (UID: \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:35.193684 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.193667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:35.318882 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.318792    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"]
Aug 04 17:58:35.321166 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:58:35.321139    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301ffe63_8ceb_4d8c_83a4_ef28c0967637.slice/crio-f642a11642e2c9c1f42ccbe93b540ecef3932ffc9d1cdd7e6253dce2904b0168 WatchSource:0}: Error finding container f642a11642e2c9c1f42ccbe93b540ecef3932ffc9d1cdd7e6253dce2904b0168: Status 404 returned error can't find the container with id f642a11642e2c9c1f42ccbe93b540ecef3932ffc9d1cdd7e6253dce2904b0168
Aug 04 17:58:35.717700 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.717669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:35.840473 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.840444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:35.849639 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:35.849613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g" event={"ID":"301ffe63-8ceb-4d8c-83a4-ef28c0967637","Type":"ContainerStarted","Data":"f642a11642e2c9c1f42ccbe93b540ecef3932ffc9d1cdd7e6253dce2904b0168"}
Aug 04 17:58:37.860913 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:37.860876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g" event={"ID":"301ffe63-8ceb-4d8c-83a4-ef28c0967637","Type":"ContainerStarted","Data":"43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048"}
Aug 04 17:58:37.861289 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:37.861066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:37.876065 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:37.876024    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g" podStartSLOduration=2.271715605 podStartE2EDuration="3.876012128s" totalImagesPullingTime="1.604296523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:58:37.874432069 +0000 UTC m=+712.250378161" watchObservedRunningTime="2026-08-04 17:58:37.876012128 +0000 UTC m=+712.251958216"
Aug 04 17:58:40.419696 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:40.419654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:48.790062 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:48.790029    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"]
Aug 04 17:58:48.790442 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:48.790251    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g" podUID="301ffe63-8ceb-4d8c-83a4-ef28c0967637" containerName="limitador" containerID="cri-o://43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048" gracePeriod=30
Aug 04 17:58:48.791013 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:48.790960    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:49.320451 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.320430    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:49.440975 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.440955    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfcnt\" (UniqueName: \"kubernetes.io/projected/301ffe63-8ceb-4d8c-83a4-ef28c0967637-kube-api-access-gfcnt\") pod \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\" (UID: \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\") "
Aug 04 17:58:49.441092 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.441001    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/301ffe63-8ceb-4d8c-83a4-ef28c0967637-config-file\") pod \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\" (UID: \"301ffe63-8ceb-4d8c-83a4-ef28c0967637\") "
Aug 04 17:58:49.441372 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.441353    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/301ffe63-8ceb-4d8c-83a4-ef28c0967637-config-file" (OuterVolumeSpecName: "config-file") pod "301ffe63-8ceb-4d8c-83a4-ef28c0967637" (UID: "301ffe63-8ceb-4d8c-83a4-ef28c0967637"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:58:49.442870 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.442848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301ffe63-8ceb-4d8c-83a4-ef28c0967637-kube-api-access-gfcnt" (OuterVolumeSpecName: "kube-api-access-gfcnt") pod "301ffe63-8ceb-4d8c-83a4-ef28c0967637" (UID: "301ffe63-8ceb-4d8c-83a4-ef28c0967637"). InnerVolumeSpecName "kube-api-access-gfcnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:58:49.541963 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.541938    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfcnt\" (UniqueName: \"kubernetes.io/projected/301ffe63-8ceb-4d8c-83a4-ef28c0967637-kube-api-access-gfcnt\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 17:58:49.541963 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.541959    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/301ffe63-8ceb-4d8c-83a4-ef28c0967637-config-file\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 17:58:49.919461 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.919434    2565 generic.go:356] "Generic (PLEG): container finished" podID="301ffe63-8ceb-4d8c-83a4-ef28c0967637" containerID="43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048" exitCode=0
Aug 04 17:58:49.919876 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.919491    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"
Aug 04 17:58:49.919876 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.919516    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g" event={"ID":"301ffe63-8ceb-4d8c-83a4-ef28c0967637","Type":"ContainerDied","Data":"43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048"}
Aug 04 17:58:49.919876 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.919580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6jr5g" event={"ID":"301ffe63-8ceb-4d8c-83a4-ef28c0967637","Type":"ContainerDied","Data":"f642a11642e2c9c1f42ccbe93b540ecef3932ffc9d1cdd7e6253dce2904b0168"}
Aug 04 17:58:49.919876 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.919602    2565 scope.go:117] "RemoveContainer" containerID="43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048"
Aug 04 17:58:49.928041 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.928024    2565 scope.go:117] "RemoveContainer" containerID="43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048"
Aug 04 17:58:49.928270 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:58:49.928251    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048\": container with ID starting with 43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048 not found: ID does not exist" containerID="43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048"
Aug 04 17:58:49.928308 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.928278    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048"} err="failed to get container status \"43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048\": rpc error: code = NotFound desc = could not find container \"43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048\": container with ID starting with 43282aec8f5a0c6b39e938b81325bab31cb3c06c4ad7f76572724c9984081048 not found: ID does not exist"
Aug 04 17:58:49.940146 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.940127    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"]
Aug 04 17:58:49.943692 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:49.943674    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6jr5g"]
Aug 04 17:58:50.064671 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:50.064647    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="301ffe63-8ceb-4d8c-83a4-ef28c0967637" path="/var/lib/kubelet/pods/301ffe63-8ceb-4d8c-83a4-ef28c0967637/volumes"
Aug 04 17:58:53.047781 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.047739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:53.148796 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.148770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:53.557579 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.557552    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"]
Aug 04 17:58:53.557921 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.557907    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301ffe63-8ceb-4d8c-83a4-ef28c0967637" containerName="limitador"
Aug 04 17:58:53.557974 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.557922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="301ffe63-8ceb-4d8c-83a4-ef28c0967637" containerName="limitador"
Aug 04 17:58:53.558012 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.557979    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="301ffe63-8ceb-4d8c-83a4-ef28c0967637" containerName="limitador"
Aug 04 17:58:53.560575 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.560554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:53.562936 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.562904    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 17:58:53.563048 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.563031    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nhgnr\""
Aug 04 17:58:53.563579 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.563563    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 17:58:53.563661 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.563591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 17:58:53.570634 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.570615    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"]
Aug 04 17:58:53.593771 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.593750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:58:53.675010 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.674983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8231a682-3694-435e-b6be-7ddacc9221b7-data\") pod \"postgres-69fb4594cf-lc6d9\" (UID: \"8231a682-3694-435e-b6be-7ddacc9221b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:53.675101 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.675014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5k85\" (UniqueName: \"kubernetes.io/projected/8231a682-3694-435e-b6be-7ddacc9221b7-kube-api-access-b5k85\") pod \"postgres-69fb4594cf-lc6d9\" (UID: \"8231a682-3694-435e-b6be-7ddacc9221b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:53.776311 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.776286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8231a682-3694-435e-b6be-7ddacc9221b7-data\") pod \"postgres-69fb4594cf-lc6d9\" (UID: \"8231a682-3694-435e-b6be-7ddacc9221b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:53.776396 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.776315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5k85\" (UniqueName: \"kubernetes.io/projected/8231a682-3694-435e-b6be-7ddacc9221b7-kube-api-access-b5k85\") pod \"postgres-69fb4594cf-lc6d9\" (UID: \"8231a682-3694-435e-b6be-7ddacc9221b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:53.776656 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.776639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8231a682-3694-435e-b6be-7ddacc9221b7-data\") pod \"postgres-69fb4594cf-lc6d9\" (UID: \"8231a682-3694-435e-b6be-7ddacc9221b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:53.783650 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.783625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5k85\" (UniqueName: \"kubernetes.io/projected/8231a682-3694-435e-b6be-7ddacc9221b7-kube-api-access-b5k85\") pod \"postgres-69fb4594cf-lc6d9\" (UID: \"8231a682-3694-435e-b6be-7ddacc9221b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:53.871833 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.871756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:53.994949 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:53.994919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"]
Aug 04 17:58:53.997888 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:58:53.997861    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8231a682_3694_435e_b6be_7ddacc9221b7.slice/crio-77068c2119979c6415a3abea6078b1eccefdd778361bcd7a2745073801ab4003 WatchSource:0}: Error finding container 77068c2119979c6415a3abea6078b1eccefdd778361bcd7a2745073801ab4003: Status 404 returned error can't find the container with id 77068c2119979c6415a3abea6078b1eccefdd778361bcd7a2745073801ab4003
Aug 04 17:58:54.946923 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:54.946845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9" event={"ID":"8231a682-3694-435e-b6be-7ddacc9221b7","Type":"ContainerStarted","Data":"77068c2119979c6415a3abea6078b1eccefdd778361bcd7a2745073801ab4003"}
Aug 04 17:58:58.970064 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:58.970033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9" event={"ID":"8231a682-3694-435e-b6be-7ddacc9221b7","Type":"ContainerStarted","Data":"87c03a39a89232cfacbb3a831b66a0f4c801d42b32bfacbd288f169d0af0cc6f"}
Aug 04 17:58:58.970406 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:58.970165    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:58:58.986418 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:58.986372    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9" podStartSLOduration=1.207425988 podStartE2EDuration="5.986357426s" totalImagesPullingTime="4.778931438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:58:58.984073815 +0000 UTC m=+733.360019904" watchObservedRunningTime="2026-08-04 17:58:58.986357426 +0000 UTC m=+733.362303515"
Aug 04 17:58:59.567046 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:58:59.567012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:05.002729 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:05.002664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lc6d9"
Aug 04 17:59:05.343194 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:05.343122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:05.801222 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:05.801187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:12.522690 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.522653    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:12.532012 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.531989    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bcf6dcd-gx2vh"]
Aug 04 17:59:12.534946 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.534930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:12.537122 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.537093    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 17:59:12.537222 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.537134    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 17:59:12.537222 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.537196    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ln5nk\""
Aug 04 17:59:12.544940 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.544915    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bcf6dcd-gx2vh"]
Aug 04 17:59:12.617380 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.617355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:12.635473 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.635455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d92r5\" (UniqueName: \"kubernetes.io/projected/63223acb-91fa-482a-a93b-d707c8e5d910-kube-api-access-d92r5\") pod \"maas-controller-bcf6dcd-gx2vh\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") " pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:12.635573 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.635508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert\") pod \"maas-controller-bcf6dcd-gx2vh\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") " pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:12.709844 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.709804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:12.713531 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.713511    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-jh4kd"]
Aug 04 17:59:12.716741 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.716728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:12.725498 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.725478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-jh4kd"]
Aug 04 17:59:12.735937 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.735916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d92r5\" (UniqueName: \"kubernetes.io/projected/63223acb-91fa-482a-a93b-d707c8e5d910-kube-api-access-d92r5\") pod \"maas-controller-bcf6dcd-gx2vh\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") " pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:12.736062 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.735968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert\") pod \"maas-controller-bcf6dcd-gx2vh\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") " pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:12.736121 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:59:12.736066    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Aug 04 17:59:12.736121 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:59:12.736113    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert podName:63223acb-91fa-482a-a93b-d707c8e5d910 nodeName:}" failed. No retries permitted until 2026-08-04 17:59:13.236098913 +0000 UTC m=+747.612044980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert") pod "maas-controller-bcf6dcd-gx2vh" (UID: "63223acb-91fa-482a-a93b-d707c8e5d910") : secret "maas-controller-webhook-cert" not found
Aug 04 17:59:12.743443 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.743425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d92r5\" (UniqueName: \"kubernetes.io/projected/63223acb-91fa-482a-a93b-d707c8e5d910-kube-api-access-d92r5\") pod \"maas-controller-bcf6dcd-gx2vh\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") " pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:12.836907 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.836852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/310b3064-e6cd-47a0-9935-65d17a88a5e5-webhook-cert\") pod \"maas-controller-59ccb7c8d4-jh4kd\" (UID: \"310b3064-e6cd-47a0-9935-65d17a88a5e5\") " pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:12.837039 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.837020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqldr\" (UniqueName: \"kubernetes.io/projected/310b3064-e6cd-47a0-9935-65d17a88a5e5-kube-api-access-fqldr\") pod \"maas-controller-59ccb7c8d4-jh4kd\" (UID: \"310b3064-e6cd-47a0-9935-65d17a88a5e5\") " pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:12.938211 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.938180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqldr\" (UniqueName: \"kubernetes.io/projected/310b3064-e6cd-47a0-9935-65d17a88a5e5-kube-api-access-fqldr\") pod \"maas-controller-59ccb7c8d4-jh4kd\" (UID: \"310b3064-e6cd-47a0-9935-65d17a88a5e5\") " pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:12.938320 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.938227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/310b3064-e6cd-47a0-9935-65d17a88a5e5-webhook-cert\") pod \"maas-controller-59ccb7c8d4-jh4kd\" (UID: \"310b3064-e6cd-47a0-9935-65d17a88a5e5\") " pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:12.940482 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.940463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/310b3064-e6cd-47a0-9935-65d17a88a5e5-webhook-cert\") pod \"maas-controller-59ccb7c8d4-jh4kd\" (UID: \"310b3064-e6cd-47a0-9935-65d17a88a5e5\") " pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:12.944699 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.944679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:12.945368 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:12.945348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqldr\" (UniqueName: \"kubernetes.io/projected/310b3064-e6cd-47a0-9935-65d17a88a5e5-kube-api-access-fqldr\") pod \"maas-controller-59ccb7c8d4-jh4kd\" (UID: \"310b3064-e6cd-47a0-9935-65d17a88a5e5\") " pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:13.027049 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:13.027028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:13.152735 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:13.152709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-jh4kd"]
Aug 04 17:59:13.154058 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:59:13.154033    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310b3064_e6cd_47a0_9935_65d17a88a5e5.slice/crio-87fa399dd06697255c9ba175984525741b229a7f07657b67a4b8aab80a3d3ec8 WatchSource:0}: Error finding container 87fa399dd06697255c9ba175984525741b229a7f07657b67a4b8aab80a3d3ec8: Status 404 returned error can't find the container with id 87fa399dd06697255c9ba175984525741b229a7f07657b67a4b8aab80a3d3ec8
Aug 04 17:59:13.241122 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:13.241096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert\") pod \"maas-controller-bcf6dcd-gx2vh\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") " pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:13.243146 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:13.243129    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert\") pod \"maas-controller-bcf6dcd-gx2vh\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") " pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:13.446740 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:13.446716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:13.568166 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:13.568143    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bcf6dcd-gx2vh"]
Aug 04 17:59:13.570095 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:59:13.570072    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63223acb_91fa_482a_a93b_d707c8e5d910.slice/crio-f04df822058bf930ff2d48f1816284add2edc3481c60464aa84eb2626ea822eb WatchSource:0}: Error finding container f04df822058bf930ff2d48f1816284add2edc3481c60464aa84eb2626ea822eb: Status 404 returned error can't find the container with id f04df822058bf930ff2d48f1816284add2edc3481c60464aa84eb2626ea822eb
Aug 04 17:59:14.053738 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:14.053706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd" event={"ID":"310b3064-e6cd-47a0-9935-65d17a88a5e5","Type":"ContainerStarted","Data":"87fa399dd06697255c9ba175984525741b229a7f07657b67a4b8aab80a3d3ec8"}
Aug 04 17:59:14.055021 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:14.054992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcf6dcd-gx2vh" event={"ID":"63223acb-91fa-482a-a93b-d707c8e5d910","Type":"ContainerStarted","Data":"f04df822058bf930ff2d48f1816284add2edc3481c60464aa84eb2626ea822eb"}
Aug 04 17:59:15.972553 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:15.972513    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:16.066267 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:16.066191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd" event={"ID":"310b3064-e6cd-47a0-9935-65d17a88a5e5","Type":"ContainerStarted","Data":"622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955"}
Aug 04 17:59:16.066414 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:16.066267    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:16.067637 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:16.067614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcf6dcd-gx2vh" event={"ID":"63223acb-91fa-482a-a93b-d707c8e5d910","Type":"ContainerStarted","Data":"e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26"}
Aug 04 17:59:16.067749 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:16.067687    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:16.072071 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:16.072051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:16.085275 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:16.085217    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd" podStartSLOduration=1.4532400380000001 podStartE2EDuration="4.085200624s" totalImagesPullingTime="2.631960586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:59:16.084146624 +0000 UTC m=+750.460092714" watchObservedRunningTime="2026-08-04 17:59:16.085200624 +0000 UTC m=+750.461146714"
Aug 04 17:59:16.101233 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:16.101185    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bcf6dcd-gx2vh" podStartSLOduration=1.87857195 podStartE2EDuration="4.1011688s" totalImagesPullingTime="2.22259685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:59:16.099917462 +0000 UTC m=+750.475863554" watchObservedRunningTime="2026-08-04 17:59:16.1011688 +0000 UTC m=+750.477114892"
Aug 04 17:59:27.074624 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.074585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:27.074992 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.074653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 17:59:27.135526 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.135495    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bcf6dcd-gx2vh"]
Aug 04 17:59:27.135707 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.135684    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bcf6dcd-gx2vh" podUID="63223acb-91fa-482a-a93b-d707c8e5d910" containerName="manager" containerID="cri-o://e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26" gracePeriod=30
Aug 04 17:59:27.381092 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.381070    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:27.462414 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.462389    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d92r5\" (UniqueName: \"kubernetes.io/projected/63223acb-91fa-482a-a93b-d707c8e5d910-kube-api-access-d92r5\") pod \"63223acb-91fa-482a-a93b-d707c8e5d910\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") "
Aug 04 17:59:27.462414 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.462417    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert\") pod \"63223acb-91fa-482a-a93b-d707c8e5d910\" (UID: \"63223acb-91fa-482a-a93b-d707c8e5d910\") "
Aug 04 17:59:27.464525 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.464498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "63223acb-91fa-482a-a93b-d707c8e5d910" (UID: "63223acb-91fa-482a-a93b-d707c8e5d910"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:59:27.464633 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.464548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63223acb-91fa-482a-a93b-d707c8e5d910-kube-api-access-d92r5" (OuterVolumeSpecName: "kube-api-access-d92r5") pod "63223acb-91fa-482a-a93b-d707c8e5d910" (UID: "63223acb-91fa-482a-a93b-d707c8e5d910"). InnerVolumeSpecName "kube-api-access-d92r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:59:27.563879 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.563854    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d92r5\" (UniqueName: \"kubernetes.io/projected/63223acb-91fa-482a-a93b-d707c8e5d910-kube-api-access-d92r5\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 17:59:27.563879 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:27.563876    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63223acb-91fa-482a-a93b-d707c8e5d910-webhook-cert\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 17:59:28.125259 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.125228    2565 generic.go:356] "Generic (PLEG): container finished" podID="63223acb-91fa-482a-a93b-d707c8e5d910" containerID="e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26" exitCode=0
Aug 04 17:59:28.125607 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.125268    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcf6dcd-gx2vh"
Aug 04 17:59:28.125607 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.125306    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcf6dcd-gx2vh" event={"ID":"63223acb-91fa-482a-a93b-d707c8e5d910","Type":"ContainerDied","Data":"e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26"}
Aug 04 17:59:28.125607 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.125352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcf6dcd-gx2vh" event={"ID":"63223acb-91fa-482a-a93b-d707c8e5d910","Type":"ContainerDied","Data":"f04df822058bf930ff2d48f1816284add2edc3481c60464aa84eb2626ea822eb"}
Aug 04 17:59:28.125607 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.125377    2565 scope.go:117] "RemoveContainer" containerID="e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26"
Aug 04 17:59:28.133345 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.133328    2565 scope.go:117] "RemoveContainer" containerID="e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26"
Aug 04 17:59:28.133581 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:59:28.133562    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26\": container with ID starting with e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26 not found: ID does not exist" containerID="e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26"
Aug 04 17:59:28.133636 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.133589    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26"} err="failed to get container status \"e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26\": rpc error: code = NotFound desc = could not find container \"e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26\": container with ID starting with e4aa4161346ba4de75ead164c770637162fc9a8e30832e9d3df0bfac22929c26 not found: ID does not exist"
Aug 04 17:59:28.141222 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.141197    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bcf6dcd-gx2vh"]
Aug 04 17:59:28.144839 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:28.144805    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bcf6dcd-gx2vh"]
Aug 04 17:59:30.065159 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:30.065129    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63223acb-91fa-482a-a93b-d707c8e5d910" path="/var/lib/kubelet/pods/63223acb-91fa-482a-a93b-d707c8e5d910/volumes"
Aug 04 17:59:47.656681 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:47.656641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:47.754738 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:47.754707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:49.251185 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.251153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:49.322074 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.322049    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"]
Aug 04 17:59:49.322412 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.322400    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63223acb-91fa-482a-a93b-d707c8e5d910" containerName="manager"
Aug 04 17:59:49.322460 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.322421    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63223acb-91fa-482a-a93b-d707c8e5d910" containerName="manager"
Aug 04 17:59:49.322492 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.322474    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63223acb-91fa-482a-a93b-d707c8e5d910" containerName="manager"
Aug 04 17:59:49.328849 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.328829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.330515 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.330493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rlc9\" (UniqueName: \"kubernetes.io/projected/c9412a3a-a429-4660-b29a-c12b3697dbee-kube-api-access-6rlc9\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.330613 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.330576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9412a3a-a429-4660-b29a-c12b3697dbee-openshift-service-ca\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.330679 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.330639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9412a3a-a429-4660-b29a-c12b3697dbee-maas-api-tls\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.331077 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.331061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ww786\""
Aug 04 17:59:49.331158 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.331061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 04 17:59:49.338271 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.338243    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"]
Aug 04 17:59:49.431577 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.431549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9412a3a-a429-4660-b29a-c12b3697dbee-openshift-service-ca\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.431728 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.431584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9412a3a-a429-4660-b29a-c12b3697dbee-maas-api-tls\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.431728 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.431648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rlc9\" (UniqueName: \"kubernetes.io/projected/c9412a3a-a429-4660-b29a-c12b3697dbee-kube-api-access-6rlc9\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.431859 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:59:49.431765    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Aug 04 17:59:49.431859 ip-10-0-140-41 kubenswrapper[2565]: E0804 17:59:49.431856    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9412a3a-a429-4660-b29a-c12b3697dbee-maas-api-tls podName:c9412a3a-a429-4660-b29a-c12b3697dbee nodeName:}" failed. No retries permitted until 2026-08-04 17:59:49.931836756 +0000 UTC m=+784.307782826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c9412a3a-a429-4660-b29a-c12b3697dbee-maas-api-tls") pod "maas-api-757fdc8c4c-766p5" (UID: "c9412a3a-a429-4660-b29a-c12b3697dbee") : secret "maas-api-serving-cert" not found
Aug 04 17:59:49.432250 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.432232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9412a3a-a429-4660-b29a-c12b3697dbee-openshift-service-ca\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.440273 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.440252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rlc9\" (UniqueName: \"kubernetes.io/projected/c9412a3a-a429-4660-b29a-c12b3697dbee-kube-api-access-6rlc9\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.481570 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.481551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:49.800791 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.800759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:49.902531 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.902500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 17:59:49.906041 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.906017    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"]
Aug 04 17:59:49.910294 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.910278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:49.913437 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.913417    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p9s89\""
Aug 04 17:59:49.913542 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.913470    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 04 17:59:49.925827 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.925703    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"]
Aug 04 17:59:49.933227 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.933204    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q425w"]
Aug 04 17:59:49.935898 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.935874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9412a3a-a429-4660-b29a-c12b3697dbee-maas-api-tls\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.935980 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.935935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e94ea3e8-2515-42d8-95a2-6d6960813964-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kxx8m\" (UID: \"e94ea3e8-2515-42d8-95a2-6d6960813964\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:49.935980 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.935952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42x2k\" (UniqueName: \"kubernetes.io/projected/e94ea3e8-2515-42d8-95a2-6d6960813964-kube-api-access-42x2k\") pod \"payload-pre-processing-687dbb6cf6-kxx8m\" (UID: \"e94ea3e8-2515-42d8-95a2-6d6960813964\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:49.937292 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.937272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:49.938593 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.938574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9412a3a-a429-4660-b29a-c12b3697dbee-maas-api-tls\") pod \"maas-api-757fdc8c4c-766p5\" (UID: \"c9412a3a-a429-4660-b29a-c12b3697dbee\") " pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.939072 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.939053    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:49.946087 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:49.946039    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q425w"]
Aug 04 17:59:50.036523 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.036491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q425w\" (UID: \"ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:50.036669 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.036536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spj7x\" (UniqueName: \"kubernetes.io/projected/ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46-kube-api-access-spj7x\") pod \"payload-processing-5cc6cd444b-q425w\" (UID: \"ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:50.036717 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.036664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e94ea3e8-2515-42d8-95a2-6d6960813964-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kxx8m\" (UID: \"e94ea3e8-2515-42d8-95a2-6d6960813964\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:50.036717 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.036700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42x2k\" (UniqueName: \"kubernetes.io/projected/e94ea3e8-2515-42d8-95a2-6d6960813964-kube-api-access-42x2k\") pod \"payload-pre-processing-687dbb6cf6-kxx8m\" (UID: \"e94ea3e8-2515-42d8-95a2-6d6960813964\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:50.037639 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.037613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e94ea3e8-2515-42d8-95a2-6d6960813964-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kxx8m\" (UID: \"e94ea3e8-2515-42d8-95a2-6d6960813964\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:50.047925 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.047863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42x2k\" (UniqueName: \"kubernetes.io/projected/e94ea3e8-2515-42d8-95a2-6d6960813964-kube-api-access-42x2k\") pod \"payload-pre-processing-687dbb6cf6-kxx8m\" (UID: \"e94ea3e8-2515-42d8-95a2-6d6960813964\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:50.076945 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.076920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"]
Aug 04 17:59:50.078695 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:59:50.078670    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9412a3a_a429_4660_b29a_c12b3697dbee.slice/crio-bfa258a3d8db1437e4d784eea142c55cf0f57b1c60ec736e031cd7af961232fe WatchSource:0}: Error finding container bfa258a3d8db1437e4d784eea142c55cf0f57b1c60ec736e031cd7af961232fe: Status 404 returned error can't find the container with id bfa258a3d8db1437e4d784eea142c55cf0f57b1c60ec736e031cd7af961232fe
Aug 04 17:59:50.137446 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.137422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spj7x\" (UniqueName: \"kubernetes.io/projected/ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46-kube-api-access-spj7x\") pod \"payload-processing-5cc6cd444b-q425w\" (UID: \"ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:50.137557 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.137519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q425w\" (UID: \"ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:50.138215 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.138197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q425w\" (UID: \"ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:50.144682 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.144664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spj7x\" (UniqueName: \"kubernetes.io/projected/ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46-kube-api-access-spj7x\") pod \"payload-processing-5cc6cd444b-q425w\" (UID: \"ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:50.220330 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.220305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:50.223578 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.223553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5" event={"ID":"c9412a3a-a429-4660-b29a-c12b3697dbee","Type":"ContainerStarted","Data":"bfa258a3d8db1437e4d784eea142c55cf0f57b1c60ec736e031cd7af961232fe"}
Aug 04 17:59:50.273069 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.273024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:50.355673 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.355643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"]
Aug 04 17:59:50.358039 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:59:50.358008    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94ea3e8_2515_42d8_95a2_6d6960813964.slice/crio-127aeaf1b2177fe1a9f8ffd6e8c18c6cc508f214655cd1bf4653c415f30fa821 WatchSource:0}: Error finding container 127aeaf1b2177fe1a9f8ffd6e8c18c6cc508f214655cd1bf4653c415f30fa821: Status 404 returned error can't find the container with id 127aeaf1b2177fe1a9f8ffd6e8c18c6cc508f214655cd1bf4653c415f30fa821
Aug 04 17:59:50.409584 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:50.409562    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q425w"]
Aug 04 17:59:50.412256 ip-10-0-140-41 kubenswrapper[2565]: W0804 17:59:50.412231    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae8456a8_0a6e_42be_b2d3_c1a1de6b4d46.slice/crio-0e5e65abb103ea4ae652ef644ad43e1006e138d3107f7982ade848eae8d2b77e WatchSource:0}: Error finding container 0e5e65abb103ea4ae652ef644ad43e1006e138d3107f7982ade848eae8d2b77e: Status 404 returned error can't find the container with id 0e5e65abb103ea4ae652ef644ad43e1006e138d3107f7982ade848eae8d2b77e
Aug 04 17:59:51.234278 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:51.234187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-q425w" event={"ID":"ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46","Type":"ContainerStarted","Data":"0e5e65abb103ea4ae652ef644ad43e1006e138d3107f7982ade848eae8d2b77e"}
Aug 04 17:59:51.236217 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:51.236155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m" event={"ID":"e94ea3e8-2515-42d8-95a2-6d6960813964","Type":"ContainerStarted","Data":"127aeaf1b2177fe1a9f8ffd6e8c18c6cc508f214655cd1bf4653c415f30fa821"}
Aug 04 17:59:53.248222 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.248143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5" event={"ID":"c9412a3a-a429-4660-b29a-c12b3697dbee","Type":"ContainerStarted","Data":"8ec33f8d5d131333e5f976e966d51a4c19a126239f56d48bdd183abb572c7010"}
Aug 04 17:59:53.248222 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.248207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 17:59:53.249662 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.249633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-q425w" event={"ID":"ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46","Type":"ContainerStarted","Data":"80525634c6c03821bfb0a43d2c7cdba668b968e787ad2fa043ce48d3accf05ad"}
Aug 04 17:59:53.249783 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.249727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 17:59:53.251019 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.251002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m" event={"ID":"e94ea3e8-2515-42d8-95a2-6d6960813964","Type":"ContainerStarted","Data":"61a77d954212a457c5d5c1af0460622136628f03e41bedeec08a5e7773012621"}
Aug 04 17:59:53.251116 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.251049    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 17:59:53.264359 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.264312    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5" podStartSLOduration=1.37057896 podStartE2EDuration="4.264295721s" totalImagesPullingTime="2.893716761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:59:53.263301117 +0000 UTC m=+787.639247206" watchObservedRunningTime="2026-08-04 17:59:53.264295721 +0000 UTC m=+787.640241809"
Aug 04 17:59:53.279206 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.279160    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m" podStartSLOduration=1.603276804 podStartE2EDuration="4.279144732s" totalImagesPullingTime="2.675867928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:59:53.277024968 +0000 UTC m=+787.652971061" watchObservedRunningTime="2026-08-04 17:59:53.279144732 +0000 UTC m=+787.655090825"
Aug 04 17:59:53.292422 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:53.292386    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-q425w" podStartSLOduration=1.6773820210000001 podStartE2EDuration="4.292374047s" totalImagesPullingTime="2.614992026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:59:53.291284359 +0000 UTC m=+787.667230449" watchObservedRunningTime="2026-08-04 17:59:53.292374047 +0000 UTC m=+787.668320136"
Aug 04 17:59:59.261320 ip-10-0-140-41 kubenswrapper[2565]: I0804 17:59:59.261287    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-757fdc8c4c-766p5"
Aug 04 18:00:00.413937 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:00.413895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:00:00.491630 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:00.491595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:00:04.257979 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:04.257944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-q425w"
Aug 04 18:00:04.258429 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:04.258198    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kxx8m"
Aug 04 18:00:29.871823 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.871736    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"]
Aug 04 18:00:29.877223 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.877202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:29.879358 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.879337    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 18:00:29.880325 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.880303    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 04 18:00:29.880605 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.880342    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b4f56\""
Aug 04 18:00:29.880833 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.880377    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 18:00:29.883431 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.883412    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"]
Aug 04 18:00:29.911619 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.911588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:00:29.959709 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.959679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:29.959841 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.959712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:29.959841 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.959750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:29.959841 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.959774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwrqw\" (UniqueName: \"kubernetes.io/projected/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-kube-api-access-pwrqw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:29.959841 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.959804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:29.960027 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:29.959908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060327 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060327 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060518 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060518 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060518 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwrqw\" (UniqueName: \"kubernetes.io/projected/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-kube-api-access-pwrqw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060656 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060714 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060767 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.060847 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.060774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.062485 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.062463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.062980 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.062958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.067705 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.067684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwrqw\" (UniqueName: \"kubernetes.io/projected/9a86e8f5-892b-4b12-88f7-ed8d2b5ec315-kube-api-access-pwrqw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q\" (UID: \"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.189866 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.189834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:30.329265 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.329235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"]
Aug 04 18:00:30.331617 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:00:30.331591    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a86e8f5_892b_4b12_88f7_ed8d2b5ec315.slice/crio-dd1db892848aa99aaa2cdae9e3394077bb81bd7a4d48b7ddff07b096652f80f6 WatchSource:0}: Error finding container dd1db892848aa99aaa2cdae9e3394077bb81bd7a4d48b7ddff07b096652f80f6: Status 404 returned error can't find the container with id dd1db892848aa99aaa2cdae9e3394077bb81bd7a4d48b7ddff07b096652f80f6
Aug 04 18:00:30.427708 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:30.427678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q" event={"ID":"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315","Type":"ContainerStarted","Data":"dd1db892848aa99aaa2cdae9e3394077bb81bd7a4d48b7ddff07b096652f80f6"}
Aug 04 18:00:32.439513 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:32.439482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q" event={"ID":"9a86e8f5-892b-4b12-88f7-ed8d2b5ec315","Type":"ContainerStarted","Data":"db400df22aad6326d11982324117787e856b88528ce941cc3b0c4a696228f9cd"}
Aug 04 18:00:32.457373 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:32.457323    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q" podStartSLOduration=2.3077795549999998 podStartE2EDuration="3.457308315s" totalImagesPullingTime="1.14952876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:32.457247492 +0000 UTC m=+826.833193582" watchObservedRunningTime="2026-08-04 18:00:32.457308315 +0000 UTC m=+826.833254404"
Aug 04 18:00:37.571021 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.570990    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"]
Aug 04 18:00:37.574053 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.574031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.576231 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.576201    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 04 18:00:37.585995 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.585970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"]
Aug 04 18:00:37.600698 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.600668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:00:37.729200 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.729172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.729370 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.729217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.729370 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.729261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.729370 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.729286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wllj5\" (UniqueName: \"kubernetes.io/projected/ee72a9de-48c4-4062-a013-8b2f6dc4f874-kube-api-access-wllj5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.729370 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.729318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.729370 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.729343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee72a9de-48c4-4062-a013-8b2f6dc4f874-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.830789 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.830706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.830789 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.830747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.830789 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.830780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.831058 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.830800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wllj5\" (UniqueName: \"kubernetes.io/projected/ee72a9de-48c4-4062-a013-8b2f6dc4f874-kube-api-access-wllj5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.831058 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.830854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.831058 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.830987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee72a9de-48c4-4062-a013-8b2f6dc4f874-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.831205 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.831184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.831255 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.831214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.831291 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.831275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.833111 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.833087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee72a9de-48c4-4062-a013-8b2f6dc4f874-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.833255 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.833237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee72a9de-48c4-4062-a013-8b2f6dc4f874-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.838135 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.838118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wllj5\" (UniqueName: \"kubernetes.io/projected/ee72a9de-48c4-4062-a013-8b2f6dc4f874-kube-api-access-wllj5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p2tx6\" (UID: \"ee72a9de-48c4-4062-a013-8b2f6dc4f874\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:37.886235 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:37.886211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:38.016989 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:38.016960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"]
Aug 04 18:00:38.019638 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:00:38.019612    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee72a9de_48c4_4062_a013_8b2f6dc4f874.slice/crio-4b04d20a116f62b84fa7cf11631a3e31929a35895c772881d4a246c9a91ce27b WatchSource:0}: Error finding container 4b04d20a116f62b84fa7cf11631a3e31929a35895c772881d4a246c9a91ce27b: Status 404 returned error can't find the container with id 4b04d20a116f62b84fa7cf11631a3e31929a35895c772881d4a246c9a91ce27b
Aug 04 18:00:38.021082 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:38.021061    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:00:38.475969 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:38.475936    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6" event={"ID":"ee72a9de-48c4-4062-a013-8b2f6dc4f874","Type":"ContainerStarted","Data":"632eace4463f6d51e41d6c2c55abf1acbdc0417deb1c444c7dff58640eecb2da"}
Aug 04 18:00:38.476138 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:38.475985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6" event={"ID":"ee72a9de-48c4-4062-a013-8b2f6dc4f874","Type":"ContainerStarted","Data":"4b04d20a116f62b84fa7cf11631a3e31929a35895c772881d4a246c9a91ce27b"}
Aug 04 18:00:38.492993 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:38.492886    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6" podStartSLOduration=1.272461027 podStartE2EDuration="1.492872449s" totalImagesPullingTime="220.411422ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:38.490959979 +0000 UTC m=+832.866906065" watchObservedRunningTime="2026-08-04 18:00:38.492872449 +0000 UTC m=+832.868818538"
Aug 04 18:00:40.190080 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:40.190043    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:40.190483 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:40.190225    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:40.202563 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:40.202530    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:40.495919 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:40.495848    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q"
Aug 04 18:00:47.887010 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:47.886978    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:47.887359 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:47.887074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:47.899108 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:47.899074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:48.534862 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:48.534834    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p2tx6"
Aug 04 18:00:51.308721 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:51.308691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:00:51.735104 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:51.735067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:00:51.833639 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:51.833609    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:00:57.276338 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.276306    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"]
Aug 04 18:00:57.279404 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.279382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.281915 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.281897    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 04 18:00:57.288378 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.288356    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"]
Aug 04 18:00:57.305197 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.305163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:00:57.405940 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.405903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.405940 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.405944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/699e273f-1614-4dae-867f-4e4f3592e40a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.406158 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.406086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.406158 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.406117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.406158 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.406142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.406255 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.406193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7gp\" (UniqueName: \"kubernetes.io/projected/699e273f-1614-4dae-867f-4e4f3592e40a-kube-api-access-nz7gp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507155 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7gp\" (UniqueName: \"kubernetes.io/projected/699e273f-1614-4dae-867f-4e4f3592e40a-kube-api-access-nz7gp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507312 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507312 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/699e273f-1614-4dae-867f-4e4f3592e40a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507312 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507312 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507531 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507701 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507845 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.507845 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.507717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.509380 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.509352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/699e273f-1614-4dae-867f-4e4f3592e40a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.509789 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.509767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/699e273f-1614-4dae-867f-4e4f3592e40a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.515169 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.515145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7gp\" (UniqueName: \"kubernetes.io/projected/699e273f-1614-4dae-867f-4e4f3592e40a-kube-api-access-nz7gp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6\" (UID: \"699e273f-1614-4dae-867f-4e4f3592e40a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.591506 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.591410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:00:57.735635 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:57.735609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"]
Aug 04 18:00:57.737613 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:00:57.737586    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699e273f_1614_4dae_867f_4e4f3592e40a.slice/crio-c8ee10c99184d88960744b622db570c94ed61917b08f6862d720ecb766e94efd WatchSource:0}: Error finding container c8ee10c99184d88960744b622db570c94ed61917b08f6862d720ecb766e94efd: Status 404 returned error can't find the container with id c8ee10c99184d88960744b622db570c94ed61917b08f6862d720ecb766e94efd
Aug 04 18:00:58.570063 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:58.570023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6" event={"ID":"699e273f-1614-4dae-867f-4e4f3592e40a","Type":"ContainerStarted","Data":"4f7734c5f9fe7395f2597d37ca3de8c62bd277c0f3d5c8e623f1667dbcbe6551"}
Aug 04 18:00:58.570525 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:58.570104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6" event={"ID":"699e273f-1614-4dae-867f-4e4f3592e40a","Type":"ContainerStarted","Data":"c8ee10c99184d88960744b622db570c94ed61917b08f6862d720ecb766e94efd"}
Aug 04 18:00:58.587536 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:00:58.587484    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6" podStartSLOduration=1.194525948 podStartE2EDuration="1.587467899s" totalImagesPullingTime="392.941951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:58.585437325 +0000 UTC m=+852.961383416" watchObservedRunningTime="2026-08-04 18:00:58.587467899 +0000 UTC m=+852.963413988"
Aug 04 18:01:05.310508 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:05.310474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:01:07.591690 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:07.591652    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:01:07.592127 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:07.591714    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:01:07.604000 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:07.603980    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:01:07.622784 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:07.622761    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6"
Aug 04 18:01:08.010975 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:08.010942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:01:27.178110 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:27.178071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:01:46.057653 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:46.057578    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:01:46.059243 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:46.059221    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:01:46.065285 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:46.065256    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:01:46.067033 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:01:46.067016    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:02:17.732493 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:02:17.732459    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:02:19.315984 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:02:19.315945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:02:22.668963 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:02:22.668933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:02:22.769357 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:02:22.769319    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:03:08.715645 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:08.715571    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-jh4kd"]
Aug 04 18:03:08.716153 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:08.715788    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd" podUID="310b3064-e6cd-47a0-9935-65d17a88a5e5" containerName="manager" containerID="cri-o://622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955" gracePeriod=30
Aug 04 18:03:08.954766 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:08.954743    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 18:03:08.976634 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:08.976570    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqldr\" (UniqueName: \"kubernetes.io/projected/310b3064-e6cd-47a0-9935-65d17a88a5e5-kube-api-access-fqldr\") pod \"310b3064-e6cd-47a0-9935-65d17a88a5e5\" (UID: \"310b3064-e6cd-47a0-9935-65d17a88a5e5\") "
Aug 04 18:03:08.976775 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:08.976679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/310b3064-e6cd-47a0-9935-65d17a88a5e5-webhook-cert\") pod \"310b3064-e6cd-47a0-9935-65d17a88a5e5\" (UID: \"310b3064-e6cd-47a0-9935-65d17a88a5e5\") "
Aug 04 18:03:08.979306 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:08.979282    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/310b3064-e6cd-47a0-9935-65d17a88a5e5-kube-api-access-fqldr" (OuterVolumeSpecName: "kube-api-access-fqldr") pod "310b3064-e6cd-47a0-9935-65d17a88a5e5" (UID: "310b3064-e6cd-47a0-9935-65d17a88a5e5"). InnerVolumeSpecName "kube-api-access-fqldr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:03:08.979476 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:08.979451    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/310b3064-e6cd-47a0-9935-65d17a88a5e5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "310b3064-e6cd-47a0-9935-65d17a88a5e5" (UID: "310b3064-e6cd-47a0-9935-65d17a88a5e5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:09.078369 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.078339    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/310b3064-e6cd-47a0-9935-65d17a88a5e5-webhook-cert\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:03:09.078369 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.078366    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqldr\" (UniqueName: \"kubernetes.io/projected/310b3064-e6cd-47a0-9935-65d17a88a5e5-kube-api-access-fqldr\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:03:09.185130 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.185097    2565 generic.go:356] "Generic (PLEG): container finished" podID="310b3064-e6cd-47a0-9935-65d17a88a5e5" containerID="622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955" exitCode=0
Aug 04 18:03:09.185274 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.185153    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd"
Aug 04 18:03:09.185274 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.185168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd" event={"ID":"310b3064-e6cd-47a0-9935-65d17a88a5e5","Type":"ContainerDied","Data":"622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955"}
Aug 04 18:03:09.185274 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.185227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-jh4kd" event={"ID":"310b3064-e6cd-47a0-9935-65d17a88a5e5","Type":"ContainerDied","Data":"87fa399dd06697255c9ba175984525741b229a7f07657b67a4b8aab80a3d3ec8"}
Aug 04 18:03:09.185274 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.185247    2565 scope.go:117] "RemoveContainer" containerID="622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955"
Aug 04 18:03:09.193945 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.193927    2565 scope.go:117] "RemoveContainer" containerID="622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955"
Aug 04 18:03:09.194176 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:03:09.194156    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955\": container with ID starting with 622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955 not found: ID does not exist" containerID="622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955"
Aug 04 18:03:09.194241 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.194184    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955"} err="failed to get container status \"622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955\": rpc error: code = NotFound desc = could not find container \"622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955\": container with ID starting with 622fdb13bff7a01067ee83a9c26bf90f7ba017c609aaafb2418c50a71a78e955 not found: ID does not exist"
Aug 04 18:03:09.206912 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.206890    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-jh4kd"]
Aug 04 18:03:09.210142 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:09.210122    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-jh4kd"]
Aug 04 18:03:10.065585 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:10.065553    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="310b3064-e6cd-47a0-9935-65d17a88a5e5" path="/var/lib/kubelet/pods/310b3064-e6cd-47a0-9935-65d17a88a5e5/volumes"
Aug 04 18:03:28.640542 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:28.640506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:03:28.739595 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:03:28.739568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:04:10.105129 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.105102    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-dpsp8"]
Aug 04 18:04:10.105522 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.105455    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="310b3064-e6cd-47a0-9935-65d17a88a5e5" containerName="manager"
Aug 04 18:04:10.105522 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.105466    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="310b3064-e6cd-47a0-9935-65d17a88a5e5" containerName="manager"
Aug 04 18:04:10.105598 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.105529    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="310b3064-e6cd-47a0-9935-65d17a88a5e5" containerName="manager"
Aug 04 18:04:10.107560 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.107545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:10.110562 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.110526    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 18:04:10.110703 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.110594    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ln5nk\""
Aug 04 18:04:10.110703 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.110609    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 18:04:10.116301 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.116281    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-dpsp8"]
Aug 04 18:04:10.202560 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.202530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46946429-0d5c-4cb7-acb0-5d95b1a45125-webhook-cert\") pod \"maas-controller-59ccb7c8d4-dpsp8\" (UID: \"46946429-0d5c-4cb7-acb0-5d95b1a45125\") " pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:10.202694 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.202626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk7f7\" (UniqueName: \"kubernetes.io/projected/46946429-0d5c-4cb7-acb0-5d95b1a45125-kube-api-access-hk7f7\") pod \"maas-controller-59ccb7c8d4-dpsp8\" (UID: \"46946429-0d5c-4cb7-acb0-5d95b1a45125\") " pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:10.303861 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.303826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk7f7\" (UniqueName: \"kubernetes.io/projected/46946429-0d5c-4cb7-acb0-5d95b1a45125-kube-api-access-hk7f7\") pod \"maas-controller-59ccb7c8d4-dpsp8\" (UID: \"46946429-0d5c-4cb7-acb0-5d95b1a45125\") " pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:10.303999 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.303892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46946429-0d5c-4cb7-acb0-5d95b1a45125-webhook-cert\") pod \"maas-controller-59ccb7c8d4-dpsp8\" (UID: \"46946429-0d5c-4cb7-acb0-5d95b1a45125\") " pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:10.306014 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.305989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46946429-0d5c-4cb7-acb0-5d95b1a45125-webhook-cert\") pod \"maas-controller-59ccb7c8d4-dpsp8\" (UID: \"46946429-0d5c-4cb7-acb0-5d95b1a45125\") " pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:10.311711 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.311694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk7f7\" (UniqueName: \"kubernetes.io/projected/46946429-0d5c-4cb7-acb0-5d95b1a45125-kube-api-access-hk7f7\") pod \"maas-controller-59ccb7c8d4-dpsp8\" (UID: \"46946429-0d5c-4cb7-acb0-5d95b1a45125\") " pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:10.418524 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.418496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:10.550614 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:10.550582    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-dpsp8"]
Aug 04 18:04:10.557167 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:04:10.557135    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46946429_0d5c_4cb7_acb0_5d95b1a45125.slice/crio-44bc6f2729ec83536fdf000287f70220041608b07d436e583cbf26f038f9e1cb WatchSource:0}: Error finding container 44bc6f2729ec83536fdf000287f70220041608b07d436e583cbf26f038f9e1cb: Status 404 returned error can't find the container with id 44bc6f2729ec83536fdf000287f70220041608b07d436e583cbf26f038f9e1cb
Aug 04 18:04:11.489858 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:11.489801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8" event={"ID":"46946429-0d5c-4cb7-acb0-5d95b1a45125","Type":"ContainerStarted","Data":"633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8"}
Aug 04 18:04:11.490298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:11.489879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8" event={"ID":"46946429-0d5c-4cb7-acb0-5d95b1a45125","Type":"ContainerStarted","Data":"44bc6f2729ec83536fdf000287f70220041608b07d436e583cbf26f038f9e1cb"}
Aug 04 18:04:11.490298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:11.489908    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:11.505946 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:11.505901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8" podStartSLOduration=0.961873553 podStartE2EDuration="1.505886296s" totalImagesPullingTime="544.012743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:04:11.504086517 +0000 UTC m=+1045.880032624" watchObservedRunningTime="2026-08-04 18:04:11.505886296 +0000 UTC m=+1045.881832393"
Aug 04 18:04:22.496910 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:22.496876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:27.091941 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.091901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:04:27.209513 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.209484    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-dpsp8"]
Aug 04 18:04:27.209691 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.209668    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8" podUID="46946429-0d5c-4cb7-acb0-5d95b1a45125" containerName="manager" containerID="cri-o://633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8" gracePeriod=30
Aug 04 18:04:27.451847 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.451804    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:27.568758 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.568727    2565 generic.go:356] "Generic (PLEG): container finished" podID="46946429-0d5c-4cb7-acb0-5d95b1a45125" containerID="633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8" exitCode=0
Aug 04 18:04:27.568944 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.568774    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8"
Aug 04 18:04:27.568944 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.568826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8" event={"ID":"46946429-0d5c-4cb7-acb0-5d95b1a45125","Type":"ContainerDied","Data":"633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8"}
Aug 04 18:04:27.568944 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.568878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-dpsp8" event={"ID":"46946429-0d5c-4cb7-acb0-5d95b1a45125","Type":"ContainerDied","Data":"44bc6f2729ec83536fdf000287f70220041608b07d436e583cbf26f038f9e1cb"}
Aug 04 18:04:27.568944 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.568899    2565 scope.go:117] "RemoveContainer" containerID="633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8"
Aug 04 18:04:27.574432 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.574406    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46946429-0d5c-4cb7-acb0-5d95b1a45125-webhook-cert\") pod \"46946429-0d5c-4cb7-acb0-5d95b1a45125\" (UID: \"46946429-0d5c-4cb7-acb0-5d95b1a45125\") "
Aug 04 18:04:27.574534 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.574503    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk7f7\" (UniqueName: \"kubernetes.io/projected/46946429-0d5c-4cb7-acb0-5d95b1a45125-kube-api-access-hk7f7\") pod \"46946429-0d5c-4cb7-acb0-5d95b1a45125\" (UID: \"46946429-0d5c-4cb7-acb0-5d95b1a45125\") "
Aug 04 18:04:27.576231 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.576206    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46946429-0d5c-4cb7-acb0-5d95b1a45125-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "46946429-0d5c-4cb7-acb0-5d95b1a45125" (UID: "46946429-0d5c-4cb7-acb0-5d95b1a45125"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:04:27.576435 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.576405    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46946429-0d5c-4cb7-acb0-5d95b1a45125-kube-api-access-hk7f7" (OuterVolumeSpecName: "kube-api-access-hk7f7") pod "46946429-0d5c-4cb7-acb0-5d95b1a45125" (UID: "46946429-0d5c-4cb7-acb0-5d95b1a45125"). InnerVolumeSpecName "kube-api-access-hk7f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:04:27.577525 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.577506    2565 scope.go:117] "RemoveContainer" containerID="633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8"
Aug 04 18:04:27.577795 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:04:27.577763    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8\": container with ID starting with 633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8 not found: ID does not exist" containerID="633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8"
Aug 04 18:04:27.577878 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.577802    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8"} err="failed to get container status \"633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8\": rpc error: code = NotFound desc = could not find container \"633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8\": container with ID starting with 633b8da93152cabdaa98dd69a02347802a75e743b6ef23189dcac613593d93f8 not found: ID does not exist"
Aug 04 18:04:27.675262 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.675225    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk7f7\" (UniqueName: \"kubernetes.io/projected/46946429-0d5c-4cb7-acb0-5d95b1a45125-kube-api-access-hk7f7\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:04:27.675262 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.675258    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46946429-0d5c-4cb7-acb0-5d95b1a45125-webhook-cert\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:04:27.887864 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.887832    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-dpsp8"]
Aug 04 18:04:27.890488 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:27.890466    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-dpsp8"]
Aug 04 18:04:28.068989 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.065981    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46946429-0d5c-4cb7-acb0-5d95b1a45125" path="/var/lib/kubelet/pods/46946429-0d5c-4cb7-acb0-5d95b1a45125/volumes"
Aug 04 18:04:28.646191 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.646160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:04:28.726384 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.726348    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-8lfz8"]
Aug 04 18:04:28.726768 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.726755    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46946429-0d5c-4cb7-acb0-5d95b1a45125" containerName="manager"
Aug 04 18:04:28.726844 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.726770    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46946429-0d5c-4cb7-acb0-5d95b1a45125" containerName="manager"
Aug 04 18:04:28.726886 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.726853    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="46946429-0d5c-4cb7-acb0-5d95b1a45125" containerName="manager"
Aug 04 18:04:28.729854 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.729839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:28.732699 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.732680    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 18:04:28.732699 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.732696    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 18:04:28.732875 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.732717    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ln5nk\""
Aug 04 18:04:28.737092 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.737072    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-8lfz8"]
Aug 04 18:04:28.885173 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.885140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb1970af-d707-4dd5-b81c-de172058704d-webhook-cert\") pod \"maas-controller-59ccb7c8d4-8lfz8\" (UID: \"cb1970af-d707-4dd5-b81c-de172058704d\") " pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:28.885344 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.885260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrkk9\" (UniqueName: \"kubernetes.io/projected/cb1970af-d707-4dd5-b81c-de172058704d-kube-api-access-vrkk9\") pod \"maas-controller-59ccb7c8d4-8lfz8\" (UID: \"cb1970af-d707-4dd5-b81c-de172058704d\") " pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:28.986618 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.986591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrkk9\" (UniqueName: \"kubernetes.io/projected/cb1970af-d707-4dd5-b81c-de172058704d-kube-api-access-vrkk9\") pod \"maas-controller-59ccb7c8d4-8lfz8\" (UID: \"cb1970af-d707-4dd5-b81c-de172058704d\") " pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:28.986766 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.986633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb1970af-d707-4dd5-b81c-de172058704d-webhook-cert\") pod \"maas-controller-59ccb7c8d4-8lfz8\" (UID: \"cb1970af-d707-4dd5-b81c-de172058704d\") " pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:28.988923 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.988905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb1970af-d707-4dd5-b81c-de172058704d-webhook-cert\") pod \"maas-controller-59ccb7c8d4-8lfz8\" (UID: \"cb1970af-d707-4dd5-b81c-de172058704d\") " pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:28.993934 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:28.993915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrkk9\" (UniqueName: \"kubernetes.io/projected/cb1970af-d707-4dd5-b81c-de172058704d-kube-api-access-vrkk9\") pod \"maas-controller-59ccb7c8d4-8lfz8\" (UID: \"cb1970af-d707-4dd5-b81c-de172058704d\") " pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:29.041544 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:29.041522    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:29.166309 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:29.166281    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59ccb7c8d4-8lfz8"]
Aug 04 18:04:29.169742 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:04:29.169716    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1970af_d707_4dd5_b81c_de172058704d.slice/crio-7906a15ca323350f7cb7f747c338dbd3b1e0f631f56665375802d249340d28c5 WatchSource:0}: Error finding container 7906a15ca323350f7cb7f747c338dbd3b1e0f631f56665375802d249340d28c5: Status 404 returned error can't find the container with id 7906a15ca323350f7cb7f747c338dbd3b1e0f631f56665375802d249340d28c5
Aug 04 18:04:29.580039 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:29.580006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8" event={"ID":"cb1970af-d707-4dd5-b81c-de172058704d","Type":"ContainerStarted","Data":"7906a15ca323350f7cb7f747c338dbd3b1e0f631f56665375802d249340d28c5"}
Aug 04 18:04:30.587013 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:30.586974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8" event={"ID":"cb1970af-d707-4dd5-b81c-de172058704d","Type":"ContainerStarted","Data":"c67cff95135d4bede5d58dd2ba755e1dd353f86026d6606fafc1858c3fae8bd8"}
Aug 04 18:04:30.587462 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:30.587033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:04:30.602356 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:30.602309    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8" podStartSLOduration=2.168263133 podStartE2EDuration="2.602293298s" totalImagesPullingTime="434.030165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:04:30.601787331 +0000 UTC m=+1064.977733420" watchObservedRunningTime="2026-08-04 18:04:30.602293298 +0000 UTC m=+1064.978239388"
Aug 04 18:04:34.805099 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:34.805057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:04:41.595204 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:04:41.595122    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59ccb7c8d4-8lfz8"
Aug 04 18:05:28.538460 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:28.538416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:28.643286 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:28.643248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:28.797790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:28.797693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:34.388857 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:34.388803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:34.445487 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:34.445454    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:34.522288 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:34.522256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:34.624310 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:34.624281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:34.801380 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:34.801347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:35.124060 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:35.123976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:40.527532 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:40.527493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:05:40.599688 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:05:40.599661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:06:46.087590 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:06:46.087523    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:06:46.092692 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:06:46.092669    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:06:46.094528 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:06:46.094506    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:06:46.099010 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:06:46.098993    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:06:56.758788 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:06:56.758752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:10:08.157630 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:10:08.157598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:11:46.117792 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:11:46.117760    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:11:46.124977 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:11:46.124948    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:11:46.125133 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:11:46.125110    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:11:46.131855 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:11:46.131833    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:12:01.797704 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:12:01.797672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:12:01.884630 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:12:01.884596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:14:51.538692 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:14:51.538655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:15:19.213960 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:15:19.213923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:15:33.712172 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:15:33.712133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:16:12.905985 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:16:12.905944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:16:14.010118 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:16:14.010088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:16:46.147969 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:16:46.147943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:16:46.154464 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:16:46.154446    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:16:46.156453 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:16:46.156435    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:16:46.162885 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:16:46.162867    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:17:19.050802 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:17:19.050762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:19:37.658664 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:19:37.658632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:02.364462 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:02.364427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:03.387352 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:03.387298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:06.341245 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:06.341200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:06.439141 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:06.439106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:06.768321 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:06.768285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:12.381658 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:12.381622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:12.481918 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:12.481889    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:12.608204 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:12.608173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:12.953289 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:12.953236    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:13.284875 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:13.284772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:15.673612 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:15.673574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:15.771587 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:15.771559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:16.755665 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.755626    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"]
Aug 04 18:20:16.759923 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.759899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.762117 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.762094    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a208c700-serving-cert\""
Aug 04 18:20:16.768430 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.768407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"]
Aug 04 18:20:16.785207 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.785179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:16.848394 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.848366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56p6g\" (UniqueName: \"kubernetes.io/projected/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-kube-api-access-56p6g\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.848501 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.848418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-maas-api-tls\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.848600 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.848578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-openshift-service-ca\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.949380 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.949349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-openshift-service-ca\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.949621 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.949597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56p6g\" (UniqueName: \"kubernetes.io/projected/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-kube-api-access-56p6g\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.949726 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.949643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-maas-api-tls\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.950027 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.950010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-openshift-service-ca\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.952032 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.952014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-maas-api-tls\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.959512 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.959492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56p6g\" (UniqueName: \"kubernetes.io/projected/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-kube-api-access-56p6g\") pod \"maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:16.993583 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:16.993553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:17.072324 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.072257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:17.209523 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.209490    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"]
Aug 04 18:20:17.211403 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:20:17.211374    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa47706_e5f1_4a2f_ba75_f72a2e24a7f7.slice/crio-eb4218bfbbe134e9e2b265d191f86391d0faae9b290d7dae8212fefe6fe7e149 WatchSource:0}: Error finding container eb4218bfbbe134e9e2b265d191f86391d0faae9b290d7dae8212fefe6fe7e149: Status 404 returned error can't find the container with id eb4218bfbbe134e9e2b265d191f86391d0faae9b290d7dae8212fefe6fe7e149
Aug 04 18:20:17.213730 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.213710    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:20:17.297594 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.297561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:17.392022 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.389258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:17.396251 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.396223    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"]
Aug 04 18:20:17.400790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.400774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:17.402956 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.402936    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a208c700\""
Aug 04 18:20:17.402956 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.402951    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a208c700-dockercfg-7gwn6\""
Aug 04 18:20:17.409264 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.409202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"]
Aug 04 18:20:17.430954 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.430916    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"]
Aug 04 18:20:17.442037 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.442009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"]
Aug 04 18:20:17.442185 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.442112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:17.555658 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.555622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3598db-bc61-406f-bad9-8cc20b020e57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x\" (UID: \"da3598db-bc61-406f-bad9-8cc20b020e57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:17.555867 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.555666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040c70c6-47b8-4bc5-ab7b-7b85a740290c-plugins-config-volume\") pod \"payload-processing-e2e-ait-a208c700-7d67959f46-gbs42\" (UID: \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\") " pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:17.555867 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.555689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdgcl\" (UniqueName: \"kubernetes.io/projected/040c70c6-47b8-4bc5-ab7b-7b85a740290c-kube-api-access-gdgcl\") pod \"payload-processing-e2e-ait-a208c700-7d67959f46-gbs42\" (UID: \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\") " pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:17.555992 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.555873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln5lp\" (UniqueName: \"kubernetes.io/projected/da3598db-bc61-406f-bad9-8cc20b020e57-kube-api-access-ln5lp\") pod \"payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x\" (UID: \"da3598db-bc61-406f-bad9-8cc20b020e57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:17.656531 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.656499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln5lp\" (UniqueName: \"kubernetes.io/projected/da3598db-bc61-406f-bad9-8cc20b020e57-kube-api-access-ln5lp\") pod \"payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x\" (UID: \"da3598db-bc61-406f-bad9-8cc20b020e57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:17.656705 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.656598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3598db-bc61-406f-bad9-8cc20b020e57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x\" (UID: \"da3598db-bc61-406f-bad9-8cc20b020e57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:17.656705 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.656640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040c70c6-47b8-4bc5-ab7b-7b85a740290c-plugins-config-volume\") pod \"payload-processing-e2e-ait-a208c700-7d67959f46-gbs42\" (UID: \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\") " pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:17.656705 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.656665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdgcl\" (UniqueName: \"kubernetes.io/projected/040c70c6-47b8-4bc5-ab7b-7b85a740290c-kube-api-access-gdgcl\") pod \"payload-processing-e2e-ait-a208c700-7d67959f46-gbs42\" (UID: \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\") " pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:17.657433 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.657409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040c70c6-47b8-4bc5-ab7b-7b85a740290c-plugins-config-volume\") pod \"payload-processing-e2e-ait-a208c700-7d67959f46-gbs42\" (UID: \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\") " pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:17.657433 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.657427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3598db-bc61-406f-bad9-8cc20b020e57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x\" (UID: \"da3598db-bc61-406f-bad9-8cc20b020e57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:17.663987 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.663965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdgcl\" (UniqueName: \"kubernetes.io/projected/040c70c6-47b8-4bc5-ab7b-7b85a740290c-kube-api-access-gdgcl\") pod \"payload-processing-e2e-ait-a208c700-7d67959f46-gbs42\" (UID: \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\") " pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:17.664056 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.663968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln5lp\" (UniqueName: \"kubernetes.io/projected/da3598db-bc61-406f-bad9-8cc20b020e57-kube-api-access-ln5lp\") pod \"payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x\" (UID: \"da3598db-bc61-406f-bad9-8cc20b020e57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:17.714321 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.714287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:17.752487 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.752461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:17.863753 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.863718    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"]
Aug 04 18:20:17.868072 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:20:17.868033    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3598db_bc61_406f_bad9_8cc20b020e57.slice/crio-ee7473c0d1481b698c8daf4ee6d3c2cae55d5939329e3e3ced04d54eb70a6629 WatchSource:0}: Error finding container ee7473c0d1481b698c8daf4ee6d3c2cae55d5939329e3e3ced04d54eb70a6629: Status 404 returned error can't find the container with id ee7473c0d1481b698c8daf4ee6d3c2cae55d5939329e3e3ced04d54eb70a6629
Aug 04 18:20:17.902551 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:17.902522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"]
Aug 04 18:20:17.905061 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:20:17.905025    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040c70c6_47b8_4bc5_ab7b_7b85a740290c.slice/crio-47aceaeaf32cfb8bf4434d2e3c0efa8e982e8db7e8a8d24abaff73ea9622dc31 WatchSource:0}: Error finding container 47aceaeaf32cfb8bf4434d2e3c0efa8e982e8db7e8a8d24abaff73ea9622dc31: Status 404 returned error can't find the container with id 47aceaeaf32cfb8bf4434d2e3c0efa8e982e8db7e8a8d24abaff73ea9622dc31
Aug 04 18:20:18.092213 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.092174    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng" event={"ID":"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7","Type":"ContainerStarted","Data":"7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25"}
Aug 04 18:20:18.092396 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.092235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng" event={"ID":"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7","Type":"ContainerStarted","Data":"eb4218bfbbe134e9e2b265d191f86391d0faae9b290d7dae8212fefe6fe7e149"}
Aug 04 18:20:18.092396 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.092262    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:18.093997 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.093960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42" event={"ID":"040c70c6-47b8-4bc5-ab7b-7b85a740290c","Type":"ContainerStarted","Data":"732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336"}
Aug 04 18:20:18.094140 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.094006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42" event={"ID":"040c70c6-47b8-4bc5-ab7b-7b85a740290c","Type":"ContainerStarted","Data":"47aceaeaf32cfb8bf4434d2e3c0efa8e982e8db7e8a8d24abaff73ea9622dc31"}
Aug 04 18:20:18.094140 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.094038    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:18.095554 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.095533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x" event={"ID":"da3598db-bc61-406f-bad9-8cc20b020e57","Type":"ContainerStarted","Data":"ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4"}
Aug 04 18:20:18.095670 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.095575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x" event={"ID":"da3598db-bc61-406f-bad9-8cc20b020e57","Type":"ContainerStarted","Data":"ee7473c0d1481b698c8daf4ee6d3c2cae55d5939329e3e3ced04d54eb70a6629"}
Aug 04 18:20:18.095670 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.095611    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:18.108365 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.108322    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng" podStartSLOduration=1.57809943 podStartE2EDuration="2.108308252s" totalImagesPullingTime="530.208822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:18.106194247 +0000 UTC m=+2012.482140336" watchObservedRunningTime="2026-08-04 18:20:18.108308252 +0000 UTC m=+2012.484254341"
Aug 04 18:20:18.120953 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.120916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42" podStartSLOduration=1.120902528 podStartE2EDuration="1.120902528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:18.120084918 +0000 UTC m=+2012.496031007" watchObservedRunningTime="2026-08-04 18:20:18.120902528 +0000 UTC m=+2012.496848616"
Aug 04 18:20:18.134547 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:18.134506    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x" podStartSLOduration=1.134492969 podStartE2EDuration="1.134492969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:18.132995229 +0000 UTC m=+2012.508941321" watchObservedRunningTime="2026-08-04 18:20:18.134492969 +0000 UTC m=+2012.510439096"
Aug 04 18:20:24.106090 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:24.106063    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:29.103432 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:29.103402    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:29.103898 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:29.103472    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:47.288770 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.288737    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"]
Aug 04 18:20:47.289387 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.289027    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng" podUID="0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" containerName="maas-api" containerID="cri-o://7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25" gracePeriod=30
Aug 04 18:20:47.317121 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.317076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:47.339469 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.339438    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"]
Aug 04 18:20:47.339702 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.339660    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42" podUID="040c70c6-47b8-4bc5-ab7b-7b85a740290c" containerName="payload-processing" containerID="cri-o://732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336" gracePeriod=30
Aug 04 18:20:47.345884 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.345576    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"]
Aug 04 18:20:47.345884 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.345791    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x" podUID="da3598db-bc61-406f-bad9-8cc20b020e57" containerName="payload-pre-processing" containerID="cri-o://ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4" gracePeriod=30
Aug 04 18:20:47.638242 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.638212    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:47.641315 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.641285    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:47.655303 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.655063    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:47.735592 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.735561    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56p6g\" (UniqueName: \"kubernetes.io/projected/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-kube-api-access-56p6g\") pod \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") "
Aug 04 18:20:47.735755 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.735635    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-openshift-service-ca\") pod \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") "
Aug 04 18:20:47.735755 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.735671    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-maas-api-tls\") pod \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\" (UID: \"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7\") "
Aug 04 18:20:47.735755 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.735687    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040c70c6-47b8-4bc5-ab7b-7b85a740290c-plugins-config-volume\") pod \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\" (UID: \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\") "
Aug 04 18:20:47.735952 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.735857    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln5lp\" (UniqueName: \"kubernetes.io/projected/da3598db-bc61-406f-bad9-8cc20b020e57-kube-api-access-ln5lp\") pod \"da3598db-bc61-406f-bad9-8cc20b020e57\" (UID: \"da3598db-bc61-406f-bad9-8cc20b020e57\") "
Aug 04 18:20:47.736016 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.735975    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdgcl\" (UniqueName: \"kubernetes.io/projected/040c70c6-47b8-4bc5-ab7b-7b85a740290c-kube-api-access-gdgcl\") pod \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\" (UID: \"040c70c6-47b8-4bc5-ab7b-7b85a740290c\") "
Aug 04 18:20:47.736076 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.736020    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3598db-bc61-406f-bad9-8cc20b020e57-plugins-config-volume\") pod \"da3598db-bc61-406f-bad9-8cc20b020e57\" (UID: \"da3598db-bc61-406f-bad9-8cc20b020e57\") "
Aug 04 18:20:47.736076 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.736037    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" (UID: "0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:20:47.736173 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.736070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/040c70c6-47b8-4bc5-ab7b-7b85a740290c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "040c70c6-47b8-4bc5-ab7b-7b85a740290c" (UID: "040c70c6-47b8-4bc5-ab7b-7b85a740290c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:20:47.736431 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.736367    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:20:47.736431 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.736391    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040c70c6-47b8-4bc5-ab7b-7b85a740290c-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:20:47.736431 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.736421    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3598db-bc61-406f-bad9-8cc20b020e57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da3598db-bc61-406f-bad9-8cc20b020e57" (UID: "da3598db-bc61-406f-bad9-8cc20b020e57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:20:47.738040 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.738016    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3598db-bc61-406f-bad9-8cc20b020e57-kube-api-access-ln5lp" (OuterVolumeSpecName: "kube-api-access-ln5lp") pod "da3598db-bc61-406f-bad9-8cc20b020e57" (UID: "da3598db-bc61-406f-bad9-8cc20b020e57"). InnerVolumeSpecName "kube-api-access-ln5lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:20:47.738040 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.738023    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040c70c6-47b8-4bc5-ab7b-7b85a740290c-kube-api-access-gdgcl" (OuterVolumeSpecName: "kube-api-access-gdgcl") pod "040c70c6-47b8-4bc5-ab7b-7b85a740290c" (UID: "040c70c6-47b8-4bc5-ab7b-7b85a740290c"). InnerVolumeSpecName "kube-api-access-gdgcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:20:47.738271 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.738242    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-kube-api-access-56p6g" (OuterVolumeSpecName: "kube-api-access-56p6g") pod "0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" (UID: "0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7"). InnerVolumeSpecName "kube-api-access-56p6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:20:47.738365 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.738241    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" (UID: "0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:20:47.837229 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.837176    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:20:47.837229 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.837197    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln5lp\" (UniqueName: \"kubernetes.io/projected/da3598db-bc61-406f-bad9-8cc20b020e57-kube-api-access-ln5lp\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:20:47.837229 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.837206    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdgcl\" (UniqueName: \"kubernetes.io/projected/040c70c6-47b8-4bc5-ab7b-7b85a740290c-kube-api-access-gdgcl\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:20:47.837229 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.837216    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3598db-bc61-406f-bad9-8cc20b020e57-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:20:47.837229 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:47.837225    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56p6g\" (UniqueName: \"kubernetes.io/projected/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7-kube-api-access-56p6g\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:20:48.255379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.255346    2565 generic.go:356] "Generic (PLEG): container finished" podID="040c70c6-47b8-4bc5-ab7b-7b85a740290c" containerID="732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336" exitCode=0
Aug 04 18:20:48.255537 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.255399    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"
Aug 04 18:20:48.255537 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.255432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42" event={"ID":"040c70c6-47b8-4bc5-ab7b-7b85a740290c","Type":"ContainerDied","Data":"732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336"}
Aug 04 18:20:48.255537 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.255494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42" event={"ID":"040c70c6-47b8-4bc5-ab7b-7b85a740290c","Type":"ContainerDied","Data":"47aceaeaf32cfb8bf4434d2e3c0efa8e982e8db7e8a8d24abaff73ea9622dc31"}
Aug 04 18:20:48.255537 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.255522    2565 scope.go:117] "RemoveContainer" containerID="732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336"
Aug 04 18:20:48.257306 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.257276    2565 generic.go:356] "Generic (PLEG): container finished" podID="da3598db-bc61-406f-bad9-8cc20b020e57" containerID="ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4" exitCode=0
Aug 04 18:20:48.257403 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.257332    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"
Aug 04 18:20:48.257403 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.257384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x" event={"ID":"da3598db-bc61-406f-bad9-8cc20b020e57","Type":"ContainerDied","Data":"ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4"}
Aug 04 18:20:48.257519 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.257437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x" event={"ID":"da3598db-bc61-406f-bad9-8cc20b020e57","Type":"ContainerDied","Data":"ee7473c0d1481b698c8daf4ee6d3c2cae55d5939329e3e3ced04d54eb70a6629"}
Aug 04 18:20:48.258897 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.258877    2565 generic.go:356] "Generic (PLEG): container finished" podID="0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" containerID="7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25" exitCode=0
Aug 04 18:20:48.258982 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.258918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng" event={"ID":"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7","Type":"ContainerDied","Data":"7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25"}
Aug 04 18:20:48.258982 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.258928    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"
Aug 04 18:20:48.258982 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.258951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng" event={"ID":"0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7","Type":"ContainerDied","Data":"eb4218bfbbe134e9e2b265d191f86391d0faae9b290d7dae8212fefe6fe7e149"}
Aug 04 18:20:48.265245 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.265229    2565 scope.go:117] "RemoveContainer" containerID="732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336"
Aug 04 18:20:48.265471 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:20:48.265452    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336\": container with ID starting with 732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336 not found: ID does not exist" containerID="732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336"
Aug 04 18:20:48.265577 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.265475    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336"} err="failed to get container status \"732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336\": rpc error: code = NotFound desc = could not find container \"732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336\": container with ID starting with 732096957fbb434328658be375f614b812e65494312417be4bb9dc9da5540336 not found: ID does not exist"
Aug 04 18:20:48.265577 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.265501    2565 scope.go:117] "RemoveContainer" containerID="ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4"
Aug 04 18:20:48.273496 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.273480    2565 scope.go:117] "RemoveContainer" containerID="ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4"
Aug 04 18:20:48.273760 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:20:48.273740    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4\": container with ID starting with ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4 not found: ID does not exist" containerID="ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4"
Aug 04 18:20:48.273854 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.273765    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4"} err="failed to get container status \"ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4\": rpc error: code = NotFound desc = could not find container \"ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4\": container with ID starting with ddabd1ba9b7bcd07ad103edeb2872fc6db1a64fcd1dd7b30837d5c2eb62125a4 not found: ID does not exist"
Aug 04 18:20:48.273854 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.273781    2565 scope.go:117] "RemoveContainer" containerID="7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25"
Aug 04 18:20:48.275332 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.275314    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"]
Aug 04 18:20:48.279363 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.279344    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a208c700-7d67959f46-gbs42"]
Aug 04 18:20:48.282474 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.282459    2565 scope.go:117] "RemoveContainer" containerID="7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25"
Aug 04 18:20:48.282695 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:20:48.282675    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25\": container with ID starting with 7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25 not found: ID does not exist" containerID="7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25"
Aug 04 18:20:48.282780 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.282699    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25"} err="failed to get container status \"7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25\": rpc error: code = NotFound desc = could not find container \"7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25\": container with ID starting with 7fef4478096ff342be5ab5b9851c1393bbc47edc7e694b6f04516e698c466d25 not found: ID does not exist"
Aug 04 18:20:48.291845 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.291821    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"]
Aug 04 18:20:48.295369 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.295347    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a208c700-dbf8779b9-vp7ng"]
Aug 04 18:20:48.304656 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.304508    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"]
Aug 04 18:20:48.308513 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.308487    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a208c700-97f6c8b88-g9q4x"]
Aug 04 18:20:48.776445 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:48.776407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:49.070837 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:49.070736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:50.065750 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:50.065713    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="040c70c6-47b8-4bc5-ab7b-7b85a740290c" path="/var/lib/kubelet/pods/040c70c6-47b8-4bc5-ab7b-7b85a740290c/volumes"
Aug 04 18:20:50.066140 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:50.066125    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" path="/var/lib/kubelet/pods/0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7/volumes"
Aug 04 18:20:50.066450 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:50.066439    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da3598db-bc61-406f-bad9-8cc20b020e57" path="/var/lib/kubelet/pods/da3598db-bc61-406f-bad9-8cc20b020e57/volumes"
Aug 04 18:20:51.014097 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.014058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:51.116483 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.116450    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"]
Aug 04 18:20:51.117030 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117014    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" containerName="maas-api"
Aug 04 18:20:51.117112 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117033    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" containerName="maas-api"
Aug 04 18:20:51.117112 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117068    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3598db-bc61-406f-bad9-8cc20b020e57" containerName="payload-pre-processing"
Aug 04 18:20:51.117112 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117077    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3598db-bc61-406f-bad9-8cc20b020e57" containerName="payload-pre-processing"
Aug 04 18:20:51.117112 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117109    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040c70c6-47b8-4bc5-ab7b-7b85a740290c" containerName="payload-processing"
Aug 04 18:20:51.117270 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117118    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="040c70c6-47b8-4bc5-ab7b-7b85a740290c" containerName="payload-processing"
Aug 04 18:20:51.117270 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117235    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3598db-bc61-406f-bad9-8cc20b020e57" containerName="payload-pre-processing"
Aug 04 18:20:51.117270 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117249    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="040c70c6-47b8-4bc5-ab7b-7b85a740290c" containerName="payload-processing"
Aug 04 18:20:51.117270 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.117259    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa47706-e5f1-4a2f-ba75-f72a2e24a7f7" containerName="maas-api"
Aug 04 18:20:51.121941 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.121920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.124118 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.124099    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-06d91391-serving-cert\""
Aug 04 18:20:51.132269 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.132245    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"]
Aug 04 18:20:51.148373 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.148346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:51.269279 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.269199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29257ed-3043-4770-8154-62568d5ca00c-openshift-service-ca\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.269279 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.269245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv4pq\" (UniqueName: \"kubernetes.io/projected/b29257ed-3043-4770-8154-62568d5ca00c-kube-api-access-bv4pq\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.269443 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.269365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29257ed-3043-4770-8154-62568d5ca00c-maas-api-tls\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.276906 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.276869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:51.370394 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.370365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29257ed-3043-4770-8154-62568d5ca00c-openshift-service-ca\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.370522 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.370399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv4pq\" (UniqueName: \"kubernetes.io/projected/b29257ed-3043-4770-8154-62568d5ca00c-kube-api-access-bv4pq\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.370522 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.370450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29257ed-3043-4770-8154-62568d5ca00c-maas-api-tls\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.371067 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.371047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29257ed-3043-4770-8154-62568d5ca00c-openshift-service-ca\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.372842 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.372799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29257ed-3043-4770-8154-62568d5ca00c-maas-api-tls\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.378413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.378392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv4pq\" (UniqueName: \"kubernetes.io/projected/b29257ed-3043-4770-8154-62568d5ca00c-kube-api-access-bv4pq\") pod \"maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.434865 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.434840    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:51.581333 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.581296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"]
Aug 04 18:20:51.583446 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:20:51.583419    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29257ed_3043_4770_8154_62568d5ca00c.slice/crio-08f4d1fdc3ce8619962fe44e318070a23e262d2be80c6a9afb423c7ec522c171 WatchSource:0}: Error finding container 08f4d1fdc3ce8619962fe44e318070a23e262d2be80c6a9afb423c7ec522c171: Status 404 returned error can't find the container with id 08f4d1fdc3ce8619962fe44e318070a23e262d2be80c6a9afb423c7ec522c171
Aug 04 18:20:51.664802 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.664766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:51.754146 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.754095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:20:51.758397 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.758373    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"]
Aug 04 18:20:51.762871 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.762856    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:51.765166 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.765142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-06d91391\""
Aug 04 18:20:51.765553 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.765535    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-06d91391-dockercfg-r6mqn\""
Aug 04 18:20:51.771293 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.771251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"]
Aug 04 18:20:51.794651 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.794585    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"]
Aug 04 18:20:51.798021 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.797999    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:51.808176 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.808152    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"]
Aug 04 18:20:51.875231 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.875194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b192cb3-709d-4eef-9dd4-00f110181961-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh\" (UID: \"9b192cb3-709d-4eef-9dd4-00f110181961\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:51.875379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.875318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vdj\" (UniqueName: \"kubernetes.io/projected/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-kube-api-access-d8vdj\") pod \"payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj\" (UID: \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\") " pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:51.875379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.875369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gkvx\" (UniqueName: \"kubernetes.io/projected/9b192cb3-709d-4eef-9dd4-00f110181961-kube-api-access-6gkvx\") pod \"payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh\" (UID: \"9b192cb3-709d-4eef-9dd4-00f110181961\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:51.875456 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.875416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj\" (UID: \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\") " pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:51.976119 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.976089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gkvx\" (UniqueName: \"kubernetes.io/projected/9b192cb3-709d-4eef-9dd4-00f110181961-kube-api-access-6gkvx\") pod \"payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh\" (UID: \"9b192cb3-709d-4eef-9dd4-00f110181961\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:51.976318 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.976149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj\" (UID: \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\") " pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:51.976318 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.976231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b192cb3-709d-4eef-9dd4-00f110181961-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh\" (UID: \"9b192cb3-709d-4eef-9dd4-00f110181961\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:51.976318 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.976294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vdj\" (UniqueName: \"kubernetes.io/projected/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-kube-api-access-d8vdj\") pod \"payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj\" (UID: \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\") " pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:51.976965 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.976945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj\" (UID: \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\") " pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:51.976965 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.976956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b192cb3-709d-4eef-9dd4-00f110181961-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh\" (UID: \"9b192cb3-709d-4eef-9dd4-00f110181961\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:51.983603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.983577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gkvx\" (UniqueName: \"kubernetes.io/projected/9b192cb3-709d-4eef-9dd4-00f110181961-kube-api-access-6gkvx\") pod \"payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh\" (UID: \"9b192cb3-709d-4eef-9dd4-00f110181961\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:51.983717 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:51.983621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vdj\" (UniqueName: \"kubernetes.io/projected/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-kube-api-access-d8vdj\") pod \"payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj\" (UID: \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\") " pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:52.074340 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.074266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:52.108941 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.108915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:52.236800 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.236774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"]
Aug 04 18:20:52.239146 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:20:52.239112    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b192cb3_709d_4eef_9dd4_00f110181961.slice/crio-fd5a440bc69dd7bf88f921c3c7d869ecc89d93cece7ddd076b2245751d479a57 WatchSource:0}: Error finding container fd5a440bc69dd7bf88f921c3c7d869ecc89d93cece7ddd076b2245751d479a57: Status 404 returned error can't find the container with id fd5a440bc69dd7bf88f921c3c7d869ecc89d93cece7ddd076b2245751d479a57
Aug 04 18:20:52.263235 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.263213    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"]
Aug 04 18:20:52.272018 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:20:52.271992    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6b5dae_b0fc_4e4b_ad7d_1752544522b4.slice/crio-b980697eeba3c53b7fe5b36435769eb15727f95c1e7a586cbe22becc185e9f22 WatchSource:0}: Error finding container b980697eeba3c53b7fe5b36435769eb15727f95c1e7a586cbe22becc185e9f22: Status 404 returned error can't find the container with id b980697eeba3c53b7fe5b36435769eb15727f95c1e7a586cbe22becc185e9f22
Aug 04 18:20:52.283050 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.283019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj" event={"ID":"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4","Type":"ContainerStarted","Data":"b980697eeba3c53b7fe5b36435769eb15727f95c1e7a586cbe22becc185e9f22"}
Aug 04 18:20:52.284592 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.284569    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh" event={"ID":"9b192cb3-709d-4eef-9dd4-00f110181961","Type":"ContainerStarted","Data":"fd5a440bc69dd7bf88f921c3c7d869ecc89d93cece7ddd076b2245751d479a57"}
Aug 04 18:20:52.286136 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.286108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l" event={"ID":"b29257ed-3043-4770-8154-62568d5ca00c","Type":"ContainerStarted","Data":"998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3"}
Aug 04 18:20:52.286242 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.286162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l" event={"ID":"b29257ed-3043-4770-8154-62568d5ca00c","Type":"ContainerStarted","Data":"08f4d1fdc3ce8619962fe44e318070a23e262d2be80c6a9afb423c7ec522c171"}
Aug 04 18:20:52.286310 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.286264    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:20:52.301786 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:52.301747    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l" podStartSLOduration=0.804234825 podStartE2EDuration="1.301728547s" totalImagesPullingTime="497.493722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:52.299892949 +0000 UTC m=+2046.675839041" watchObservedRunningTime="2026-08-04 18:20:52.301728547 +0000 UTC m=+2046.677674640"
Aug 04 18:20:53.293487 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:53.293450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh" event={"ID":"9b192cb3-709d-4eef-9dd4-00f110181961","Type":"ContainerStarted","Data":"b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818"}
Aug 04 18:20:53.293959 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:53.293517    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:20:53.295113 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:53.295081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj" event={"ID":"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4","Type":"ContainerStarted","Data":"036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a"}
Aug 04 18:20:53.295303 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:53.295280    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:20:53.308459 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:53.308414    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh" podStartSLOduration=2.30840222 podStartE2EDuration="2.30840222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:53.307658788 +0000 UTC m=+2047.683604893" watchObservedRunningTime="2026-08-04 18:20:53.30840222 +0000 UTC m=+2047.684348309"
Aug 04 18:20:53.323958 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:53.323915    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj" podStartSLOduration=2.323901027 podStartE2EDuration="2.323901027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:53.323517705 +0000 UTC m=+2047.699463795" watchObservedRunningTime="2026-08-04 18:20:53.323901027 +0000 UTC m=+2047.699847116"
Aug 04 18:20:58.300983 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:20:58.300948    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:21:04.303073 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:04.303045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:21:04.303473 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:04.303258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:21:21.655904 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.655795    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"]
Aug 04 18:21:21.656500 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.656077    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l" podUID="b29257ed-3043-4770-8154-62568d5ca00c" containerName="maas-api" containerID="cri-o://998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3" gracePeriod=30
Aug 04 18:21:21.680265 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.680239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:21.708629 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.708594    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"]
Aug 04 18:21:21.708893 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.708866    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj" podUID="7b6b5dae-b0fc-4e4b-ad7d-1752544522b4" containerName="payload-processing" containerID="cri-o://036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a" gracePeriod=30
Aug 04 18:21:21.716841 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.716781    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"]
Aug 04 18:21:21.717238 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.717137    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh" podUID="9b192cb3-709d-4eef-9dd4-00f110181961" containerName="payload-pre-processing" containerID="cri-o://b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818" gracePeriod=30
Aug 04 18:21:21.725005 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:21:21.724964    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29257ed_3043_4770_8154_62568d5ca00c.slice/crio-conmon-998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:21:21.751453 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.751418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:21.850790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.850735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:21.904068 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:21.903958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:22.000456 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.000419    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:22.016568 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.016541    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:21:22.027605 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.027581    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:21:22.040556 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.040530    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:21:22.060041 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.060008    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-plugins-config-volume\") pod \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\" (UID: \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\") "
Aug 04 18:21:22.060041 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.060043    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29257ed-3043-4770-8154-62568d5ca00c-openshift-service-ca\") pod \"b29257ed-3043-4770-8154-62568d5ca00c\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") "
Aug 04 18:21:22.060281 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.060091    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv4pq\" (UniqueName: \"kubernetes.io/projected/b29257ed-3043-4770-8154-62568d5ca00c-kube-api-access-bv4pq\") pod \"b29257ed-3043-4770-8154-62568d5ca00c\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") "
Aug 04 18:21:22.060281 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.060141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8vdj\" (UniqueName: \"kubernetes.io/projected/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-kube-api-access-d8vdj\") pod \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\" (UID: \"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4\") "
Aug 04 18:21:22.060394 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.060296    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29257ed-3043-4770-8154-62568d5ca00c-maas-api-tls\") pod \"b29257ed-3043-4770-8154-62568d5ca00c\" (UID: \"b29257ed-3043-4770-8154-62568d5ca00c\") "
Aug 04 18:21:22.060469 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.060435    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29257ed-3043-4770-8154-62568d5ca00c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b29257ed-3043-4770-8154-62568d5ca00c" (UID: "b29257ed-3043-4770-8154-62568d5ca00c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:22.060469 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.060453    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b6b5dae-b0fc-4e4b-ad7d-1752544522b4" (UID: "7b6b5dae-b0fc-4e4b-ad7d-1752544522b4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:22.061059 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.061036    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:22.061172 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.061070    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29257ed-3043-4770-8154-62568d5ca00c-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:22.062998 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.062789    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-kube-api-access-d8vdj" (OuterVolumeSpecName: "kube-api-access-d8vdj") pod "7b6b5dae-b0fc-4e4b-ad7d-1752544522b4" (UID: "7b6b5dae-b0fc-4e4b-ad7d-1752544522b4"). InnerVolumeSpecName "kube-api-access-d8vdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:21:22.062998 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.062949    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29257ed-3043-4770-8154-62568d5ca00c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b29257ed-3043-4770-8154-62568d5ca00c" (UID: "b29257ed-3043-4770-8154-62568d5ca00c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:21:22.063973 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.063932    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29257ed-3043-4770-8154-62568d5ca00c-kube-api-access-bv4pq" (OuterVolumeSpecName: "kube-api-access-bv4pq") pod "b29257ed-3043-4770-8154-62568d5ca00c" (UID: "b29257ed-3043-4770-8154-62568d5ca00c"). InnerVolumeSpecName "kube-api-access-bv4pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:21:22.162028 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.161991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b192cb3-709d-4eef-9dd4-00f110181961-plugins-config-volume\") pod \"9b192cb3-709d-4eef-9dd4-00f110181961\" (UID: \"9b192cb3-709d-4eef-9dd4-00f110181961\") "
Aug 04 18:21:22.162201 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.162045    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gkvx\" (UniqueName: \"kubernetes.io/projected/9b192cb3-709d-4eef-9dd4-00f110181961-kube-api-access-6gkvx\") pod \"9b192cb3-709d-4eef-9dd4-00f110181961\" (UID: \"9b192cb3-709d-4eef-9dd4-00f110181961\") "
Aug 04 18:21:22.162254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.162204    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv4pq\" (UniqueName: \"kubernetes.io/projected/b29257ed-3043-4770-8154-62568d5ca00c-kube-api-access-bv4pq\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:22.162254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.162214    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8vdj\" (UniqueName: \"kubernetes.io/projected/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4-kube-api-access-d8vdj\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:22.162254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.162227    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29257ed-3043-4770-8154-62568d5ca00c-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:22.162475 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.162446    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b192cb3-709d-4eef-9dd4-00f110181961-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b192cb3-709d-4eef-9dd4-00f110181961" (UID: "9b192cb3-709d-4eef-9dd4-00f110181961"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:22.164150 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.164128    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b192cb3-709d-4eef-9dd4-00f110181961-kube-api-access-6gkvx" (OuterVolumeSpecName: "kube-api-access-6gkvx") pod "9b192cb3-709d-4eef-9dd4-00f110181961" (UID: "9b192cb3-709d-4eef-9dd4-00f110181961"). InnerVolumeSpecName "kube-api-access-6gkvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:21:22.212000 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.211919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:22.263341 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.263296    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b192cb3-709d-4eef-9dd4-00f110181961-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:22.263341 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.263333    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gkvx\" (UniqueName: \"kubernetes.io/projected/9b192cb3-709d-4eef-9dd4-00f110181961-kube-api-access-6gkvx\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:22.427014 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.426982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:22.442304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.442273    2565 generic.go:356] "Generic (PLEG): container finished" podID="9b192cb3-709d-4eef-9dd4-00f110181961" containerID="b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818" exitCode=0
Aug 04 18:21:22.442450 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.442306    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh" event={"ID":"9b192cb3-709d-4eef-9dd4-00f110181961","Type":"ContainerDied","Data":"b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818"}
Aug 04 18:21:22.442450 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.442318    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"
Aug 04 18:21:22.442450 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.442360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh" event={"ID":"9b192cb3-709d-4eef-9dd4-00f110181961","Type":"ContainerDied","Data":"fd5a440bc69dd7bf88f921c3c7d869ecc89d93cece7ddd076b2245751d479a57"}
Aug 04 18:21:22.442450 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.442393    2565 scope.go:117] "RemoveContainer" containerID="b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818"
Aug 04 18:21:22.443732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.443707    2565 generic.go:356] "Generic (PLEG): container finished" podID="b29257ed-3043-4770-8154-62568d5ca00c" containerID="998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3" exitCode=0
Aug 04 18:21:22.443865 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.443744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l" event={"ID":"b29257ed-3043-4770-8154-62568d5ca00c","Type":"ContainerDied","Data":"998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3"}
Aug 04 18:21:22.443865 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.443754    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"
Aug 04 18:21:22.443865 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.443787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l" event={"ID":"b29257ed-3043-4770-8154-62568d5ca00c","Type":"ContainerDied","Data":"08f4d1fdc3ce8619962fe44e318070a23e262d2be80c6a9afb423c7ec522c171"}
Aug 04 18:21:22.445244 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.445222    2565 generic.go:356] "Generic (PLEG): container finished" podID="7b6b5dae-b0fc-4e4b-ad7d-1752544522b4" containerID="036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a" exitCode=0
Aug 04 18:21:22.445347 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.445277    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"
Aug 04 18:21:22.445347 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.445287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj" event={"ID":"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4","Type":"ContainerDied","Data":"036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a"}
Aug 04 18:21:22.445347 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.445321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj" event={"ID":"7b6b5dae-b0fc-4e4b-ad7d-1752544522b4","Type":"ContainerDied","Data":"b980697eeba3c53b7fe5b36435769eb15727f95c1e7a586cbe22becc185e9f22"}
Aug 04 18:21:22.452839 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.452804    2565 scope.go:117] "RemoveContainer" containerID="b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818"
Aug 04 18:21:22.453104 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:21:22.453084    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818\": container with ID starting with b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818 not found: ID does not exist" containerID="b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818"
Aug 04 18:21:22.453178 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.453116    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818"} err="failed to get container status \"b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818\": rpc error: code = NotFound desc = could not find container \"b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818\": container with ID starting with b5ee9f700bcd4c80984ffdad32e6e24af891910eb23240f06edc267a44e31818 not found: ID does not exist"
Aug 04 18:21:22.453178 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.453141    2565 scope.go:117] "RemoveContainer" containerID="998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3"
Aug 04 18:21:22.461347 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.461330    2565 scope.go:117] "RemoveContainer" containerID="998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3"
Aug 04 18:21:22.461589 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:21:22.461571    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3\": container with ID starting with 998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3 not found: ID does not exist" containerID="998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3"
Aug 04 18:21:22.461657 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.461600    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3"} err="failed to get container status \"998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3\": rpc error: code = NotFound desc = could not find container \"998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3\": container with ID starting with 998b985f4e837ce0d29bd3b90c4a4cfe4d9fd5c36b1a86e58d4fad4bb277bad3 not found: ID does not exist"
Aug 04 18:21:22.461657 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.461624    2565 scope.go:117] "RemoveContainer" containerID="036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a"
Aug 04 18:21:22.464929 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.464900    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"]
Aug 04 18:21:22.468419 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.468399    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-06d91391-79fd946ffc-sv5gj"]
Aug 04 18:21:22.470600 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.470572    2565 scope.go:117] "RemoveContainer" containerID="036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a"
Aug 04 18:21:22.470889 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:21:22.470871    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a\": container with ID starting with 036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a not found: ID does not exist" containerID="036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a"
Aug 04 18:21:22.470950 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.470899    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a"} err="failed to get container status \"036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a\": rpc error: code = NotFound desc = could not find container \"036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a\": container with ID starting with 036a377f0638d47c478deb19af9b5385ec1765070e188b25561dd2ff84e61b6a not found: ID does not exist"
Aug 04 18:21:22.480932 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.480893    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"]
Aug 04 18:21:22.483763 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.483733    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-06d91391-7d5db8bffb-vct6l"]
Aug 04 18:21:22.490145 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.490121    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"]
Aug 04 18:21:22.492977 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.492958    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-06d91391-66dcc6f56-xz8mh"]
Aug 04 18:21:22.729226 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.729145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:22.865798 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:22.865765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:24.065886 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:24.065852    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b6b5dae-b0fc-4e4b-ad7d-1752544522b4" path="/var/lib/kubelet/pods/7b6b5dae-b0fc-4e4b-ad7d-1752544522b4/volumes"
Aug 04 18:21:24.066261 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:24.066223    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b192cb3-709d-4eef-9dd4-00f110181961" path="/var/lib/kubelet/pods/9b192cb3-709d-4eef-9dd4-00f110181961/volumes"
Aug 04 18:21:24.066559 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:24.066546    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b29257ed-3043-4770-8154-62568d5ca00c" path="/var/lib/kubelet/pods/b29257ed-3043-4770-8154-62568d5ca00c/volumes"
Aug 04 18:21:24.968445 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:24.968411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:25.070856 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:25.070797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:26.159879 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.159804    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"]
Aug 04 18:21:26.160489 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160466    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29257ed-3043-4770-8154-62568d5ca00c" containerName="maas-api"
Aug 04 18:21:26.160489 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160489    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29257ed-3043-4770-8154-62568d5ca00c" containerName="maas-api"
Aug 04 18:21:26.160613 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160508    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b192cb3-709d-4eef-9dd4-00f110181961" containerName="payload-pre-processing"
Aug 04 18:21:26.160613 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160517    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b192cb3-709d-4eef-9dd4-00f110181961" containerName="payload-pre-processing"
Aug 04 18:21:26.160613 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160538    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b6b5dae-b0fc-4e4b-ad7d-1752544522b4" containerName="payload-processing"
Aug 04 18:21:26.160613 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160547    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b6b5dae-b0fc-4e4b-ad7d-1752544522b4" containerName="payload-processing"
Aug 04 18:21:26.160798 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160642    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b192cb3-709d-4eef-9dd4-00f110181961" containerName="payload-pre-processing"
Aug 04 18:21:26.160798 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160662    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b6b5dae-b0fc-4e4b-ad7d-1752544522b4" containerName="payload-processing"
Aug 04 18:21:26.160798 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.160672    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29257ed-3043-4770-8154-62568d5ca00c" containerName="maas-api"
Aug 04 18:21:26.165840 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.165802    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.168129 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.168107    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a081e149-serving-cert\""
Aug 04 18:21:26.178435 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.178412    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"]
Aug 04 18:21:26.195952 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.195918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:26.297004 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.296969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:26.303586 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.303565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-openshift-service-ca\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.303685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.303595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-maas-api-tls\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.303685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.303671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk7dj\" (UniqueName: \"kubernetes.io/projected/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-kube-api-access-xk7dj\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.404888 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.404852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk7dj\" (UniqueName: \"kubernetes.io/projected/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-kube-api-access-xk7dj\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.405062 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.404929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-openshift-service-ca\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.405062 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.404946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-maas-api-tls\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.405641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.405618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-openshift-service-ca\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.407376 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.407358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-maas-api-tls\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.412477 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.412410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk7dj\" (UniqueName: \"kubernetes.io/projected/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-kube-api-access-xk7dj\") pod \"maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.479961 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.479924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:26.630079 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.630052    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"]
Aug 04 18:21:26.632577 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:21:26.632551    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e8ad4f_d8cc_41c0_a281_4aee0dd0aa6f.slice/crio-fc7592db5010fbfde6cf5277fdfe615051494d6668bee05ce8c664be368de215 WatchSource:0}: Error finding container fc7592db5010fbfde6cf5277fdfe615051494d6668bee05ce8c664be368de215: Status 404 returned error can't find the container with id fc7592db5010fbfde6cf5277fdfe615051494d6668bee05ce8c664be368de215
Aug 04 18:21:26.633140 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.633115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:26.694514 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.694429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:26.780561 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.780529    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"]
Aug 04 18:21:26.785217 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.785197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:26.787686 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.787658    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a081e149\""
Aug 04 18:21:26.787786 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.787695    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a081e149-dockercfg-cmksr\""
Aug 04 18:21:26.794221 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.794201    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"]
Aug 04 18:21:26.820521 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.820497    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"]
Aug 04 18:21:26.824080 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.824061    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:26.835666 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.835637    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"]
Aug 04 18:21:26.910436 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.910403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9n6\" (UniqueName: \"kubernetes.io/projected/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-kube-api-access-jb9n6\") pod \"payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg\" (UID: \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:26.910605 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.910450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8qjp\" (UniqueName: \"kubernetes.io/projected/175f508b-70bd-4683-a40d-b25e0ca66114-kube-api-access-r8qjp\") pod \"payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk\" (UID: \"175f508b-70bd-4683-a40d-b25e0ca66114\") " pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:26.910605 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.910475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/175f508b-70bd-4683-a40d-b25e0ca66114-plugins-config-volume\") pod \"payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk\" (UID: \"175f508b-70bd-4683-a40d-b25e0ca66114\") " pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:26.910685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:26.910605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg\" (UID: \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:27.012141 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.012070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9n6\" (UniqueName: \"kubernetes.io/projected/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-kube-api-access-jb9n6\") pod \"payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg\" (UID: \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:27.012141 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.012114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8qjp\" (UniqueName: \"kubernetes.io/projected/175f508b-70bd-4683-a40d-b25e0ca66114-kube-api-access-r8qjp\") pod \"payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk\" (UID: \"175f508b-70bd-4683-a40d-b25e0ca66114\") " pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:27.012141 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.012142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/175f508b-70bd-4683-a40d-b25e0ca66114-plugins-config-volume\") pod \"payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk\" (UID: \"175f508b-70bd-4683-a40d-b25e0ca66114\") " pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:27.012421 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.012177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg\" (UID: \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:27.012868 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.012847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg\" (UID: \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:27.012980 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.012905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/175f508b-70bd-4683-a40d-b25e0ca66114-plugins-config-volume\") pod \"payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk\" (UID: \"175f508b-70bd-4683-a40d-b25e0ca66114\") " pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:27.019994 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.019970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9n6\" (UniqueName: \"kubernetes.io/projected/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-kube-api-access-jb9n6\") pod \"payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg\" (UID: \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:27.020092 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.020023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8qjp\" (UniqueName: \"kubernetes.io/projected/175f508b-70bd-4683-a40d-b25e0ca66114-kube-api-access-r8qjp\") pod \"payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk\" (UID: \"175f508b-70bd-4683-a40d-b25e0ca66114\") " pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:27.097470 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.097439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:27.135272 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.135241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:27.241915 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.241881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"]
Aug 04 18:21:27.244291 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:21:27.244245    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175f508b_70bd_4683_a40d_b25e0ca66114.slice/crio-de007201d02c2a6518d0a56c62f59ca6131f368c1463d808e0ffc58c3a548e91 WatchSource:0}: Error finding container de007201d02c2a6518d0a56c62f59ca6131f368c1463d808e0ffc58c3a548e91: Status 404 returned error can't find the container with id de007201d02c2a6518d0a56c62f59ca6131f368c1463d808e0ffc58c3a548e91
Aug 04 18:21:27.298445 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.298089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"]
Aug 04 18:21:27.299934 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:21:27.299906    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2e04a9_c36a_46e4_bc9c_7c2c7c34b28d.slice/crio-ef3ac00cadb53f79269c047832303d90be5a2e9f7f43f5ec6bcb504735b37d32 WatchSource:0}: Error finding container ef3ac00cadb53f79269c047832303d90be5a2e9f7f43f5ec6bcb504735b37d32: Status 404 returned error can't find the container with id ef3ac00cadb53f79269c047832303d90be5a2e9f7f43f5ec6bcb504735b37d32
Aug 04 18:21:27.477654 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.477611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg" event={"ID":"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d","Type":"ContainerStarted","Data":"f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f"}
Aug 04 18:21:27.477869 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.477718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg" event={"ID":"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d","Type":"ContainerStarted","Data":"ef3ac00cadb53f79269c047832303d90be5a2e9f7f43f5ec6bcb504735b37d32"}
Aug 04 18:21:27.478434 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.478411    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:27.483250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.483215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh" event={"ID":"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f","Type":"ContainerStarted","Data":"5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c"}
Aug 04 18:21:27.483386 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.483275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh" event={"ID":"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f","Type":"ContainerStarted","Data":"fc7592db5010fbfde6cf5277fdfe615051494d6668bee05ce8c664be368de215"}
Aug 04 18:21:27.483386 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.483328    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:27.485625 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.485599    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk" event={"ID":"175f508b-70bd-4683-a40d-b25e0ca66114","Type":"ContainerStarted","Data":"2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0"}
Aug 04 18:21:27.485706 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.485644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk" event={"ID":"175f508b-70bd-4683-a40d-b25e0ca66114","Type":"ContainerStarted","Data":"de007201d02c2a6518d0a56c62f59ca6131f368c1463d808e0ffc58c3a548e91"}
Aug 04 18:21:27.485747 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.485701    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:27.493486 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.493449    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg" podStartSLOduration=1.4934356 podStartE2EDuration="1.4934356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:21:27.492070773 +0000 UTC m=+2081.868016908" watchObservedRunningTime="2026-08-04 18:21:27.4934356 +0000 UTC m=+2081.869381689"
Aug 04 18:21:27.508068 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.508009    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk" podStartSLOduration=1.507996455 podStartE2EDuration="1.507996455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:21:27.507136286 +0000 UTC m=+2081.883082400" watchObservedRunningTime="2026-08-04 18:21:27.507996455 +0000 UTC m=+2081.883942546"
Aug 04 18:21:27.523905 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:27.523800    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh" podStartSLOduration=1.132176855 podStartE2EDuration="1.523788394s" totalImagesPullingTime="391.611539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:21:27.522439061 +0000 UTC m=+2081.898385187" watchObservedRunningTime="2026-08-04 18:21:27.523788394 +0000 UTC m=+2081.899734483"
Aug 04 18:21:33.497361 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:33.497332    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:38.493556 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:38.493529    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:39.498652 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:39.498622    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:46.177715 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:46.177684    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:21:46.184347 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:46.184322    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:21:46.187378 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:46.187360    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:21:46.193291 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:46.193272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:21:56.587693 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.587656    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"]
Aug 04 18:21:56.588320 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.587948    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh" podUID="12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" containerName="maas-api" containerID="cri-o://5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c" gracePeriod=30
Aug 04 18:21:56.612651 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.612619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:56.640348 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.640318    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"]
Aug 04 18:21:56.640565 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.640540    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk" podUID="175f508b-70bd-4683-a40d-b25e0ca66114" containerName="payload-processing" containerID="cri-o://2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0" gracePeriod=30
Aug 04 18:21:56.646194 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.646163    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"]
Aug 04 18:21:56.646610 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.646579    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg" podUID="ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d" containerName="payload-pre-processing" containerID="cri-o://f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f" gracePeriod=30
Aug 04 18:21:56.678148 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.678071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:56.768321 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.768283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:56.826452 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.826374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:56.927136 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.927107    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:56.930543 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.930517    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:56.944651 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.944626    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:56.982682 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.982642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-plugins-config-volume\") pod \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\" (UID: \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\") "
Aug 04 18:21:56.982895 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.982721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk7dj\" (UniqueName: \"kubernetes.io/projected/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-kube-api-access-xk7dj\") pod \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") "
Aug 04 18:21:56.982895 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.982756    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-maas-api-tls\") pod \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") "
Aug 04 18:21:56.982895 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.982843    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-openshift-service-ca\") pod \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\" (UID: \"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f\") "
Aug 04 18:21:56.982895 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.982882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/175f508b-70bd-4683-a40d-b25e0ca66114-plugins-config-volume\") pod \"175f508b-70bd-4683-a40d-b25e0ca66114\" (UID: \"175f508b-70bd-4683-a40d-b25e0ca66114\") "
Aug 04 18:21:56.983131 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.982918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8qjp\" (UniqueName: \"kubernetes.io/projected/175f508b-70bd-4683-a40d-b25e0ca66114-kube-api-access-r8qjp\") pod \"175f508b-70bd-4683-a40d-b25e0ca66114\" (UID: \"175f508b-70bd-4683-a40d-b25e0ca66114\") "
Aug 04 18:21:56.983131 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.982945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb9n6\" (UniqueName: \"kubernetes.io/projected/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-kube-api-access-jb9n6\") pod \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\" (UID: \"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d\") "
Aug 04 18:21:56.983131 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.983101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d" (UID: "ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:56.983283 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.983203    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" (UID: "12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:56.983446 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.983424    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:56.983518 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.983452    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:56.983589 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.983552    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/175f508b-70bd-4683-a40d-b25e0ca66114-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "175f508b-70bd-4683-a40d-b25e0ca66114" (UID: "175f508b-70bd-4683-a40d-b25e0ca66114"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:21:56.985194 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.985166    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-kube-api-access-xk7dj" (OuterVolumeSpecName: "kube-api-access-xk7dj") pod "12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" (UID: "12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f"). InnerVolumeSpecName "kube-api-access-xk7dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:21:56.985301 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.985219    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" (UID: "12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:21:56.985454 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.985431    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-kube-api-access-jb9n6" (OuterVolumeSpecName: "kube-api-access-jb9n6") pod "ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d" (UID: "ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d"). InnerVolumeSpecName "kube-api-access-jb9n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:21:56.985570 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:56.985555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/175f508b-70bd-4683-a40d-b25e0ca66114-kube-api-access-r8qjp" (OuterVolumeSpecName: "kube-api-access-r8qjp") pod "175f508b-70bd-4683-a40d-b25e0ca66114" (UID: "175f508b-70bd-4683-a40d-b25e0ca66114"). InnerVolumeSpecName "kube-api-access-r8qjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:21:57.084028 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.083986    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk7dj\" (UniqueName: \"kubernetes.io/projected/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-kube-api-access-xk7dj\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:57.084028 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.084021    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:57.084028 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.084037    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/175f508b-70bd-4683-a40d-b25e0ca66114-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:57.084273 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.084048    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8qjp\" (UniqueName: \"kubernetes.io/projected/175f508b-70bd-4683-a40d-b25e0ca66114-kube-api-access-r8qjp\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:57.084273 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.084060    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb9n6\" (UniqueName: \"kubernetes.io/projected/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d-kube-api-access-jb9n6\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:21:57.647056 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.647007    2565 generic.go:356] "Generic (PLEG): container finished" podID="175f508b-70bd-4683-a40d-b25e0ca66114" containerID="2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0" exitCode=0
Aug 04 18:21:57.647588 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.647170    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"
Aug 04 18:21:57.647588 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.647205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk" event={"ID":"175f508b-70bd-4683-a40d-b25e0ca66114","Type":"ContainerDied","Data":"2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0"}
Aug 04 18:21:57.647588 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.647260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk" event={"ID":"175f508b-70bd-4683-a40d-b25e0ca66114","Type":"ContainerDied","Data":"de007201d02c2a6518d0a56c62f59ca6131f368c1463d808e0ffc58c3a548e91"}
Aug 04 18:21:57.647588 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.647310    2565 scope.go:117] "RemoveContainer" containerID="2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0"
Aug 04 18:21:57.649163 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.649137    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d" containerID="f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f" exitCode=0
Aug 04 18:21:57.649301 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.649198    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"
Aug 04 18:21:57.649301 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.649244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg" event={"ID":"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d","Type":"ContainerDied","Data":"f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f"}
Aug 04 18:21:57.649301 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.649296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg" event={"ID":"ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d","Type":"ContainerDied","Data":"ef3ac00cadb53f79269c047832303d90be5a2e9f7f43f5ec6bcb504735b37d32"}
Aug 04 18:21:57.650681 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.650653    2565 generic.go:356] "Generic (PLEG): container finished" podID="12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" containerID="5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c" exitCode=0
Aug 04 18:21:57.650785 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.650723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh" event={"ID":"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f","Type":"ContainerDied","Data":"5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c"}
Aug 04 18:21:57.650785 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.650758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh" event={"ID":"12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f","Type":"ContainerDied","Data":"fc7592db5010fbfde6cf5277fdfe615051494d6668bee05ce8c664be368de215"}
Aug 04 18:21:57.650919 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.650883    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"
Aug 04 18:21:57.657140 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.657098    2565 scope.go:117] "RemoveContainer" containerID="2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0"
Aug 04 18:21:57.657456 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:21:57.657433    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0\": container with ID starting with 2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0 not found: ID does not exist" containerID="2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0"
Aug 04 18:21:57.657535 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.657464    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0"} err="failed to get container status \"2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0\": rpc error: code = NotFound desc = could not find container \"2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0\": container with ID starting with 2f50434d882f1c6cb7b4198079b3bdb61818e53815609efa3b6b738b70e2f3c0 not found: ID does not exist"
Aug 04 18:21:57.657535 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.657483    2565 scope.go:117] "RemoveContainer" containerID="f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f"
Aug 04 18:21:57.666282 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.666255    2565 scope.go:117] "RemoveContainer" containerID="f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f"
Aug 04 18:21:57.666634 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:21:57.666611    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f\": container with ID starting with f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f not found: ID does not exist" containerID="f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f"
Aug 04 18:21:57.666727 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.666642    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f"} err="failed to get container status \"f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f\": rpc error: code = NotFound desc = could not find container \"f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f\": container with ID starting with f6f6488f506bdecf78c682ebfc62625c5a23a6981b2e05765cd64036a3865e9f not found: ID does not exist"
Aug 04 18:21:57.666727 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.666666    2565 scope.go:117] "RemoveContainer" containerID="5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c"
Aug 04 18:21:57.675750 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.675726    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"]
Aug 04 18:21:57.675919 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.675772    2565 scope.go:117] "RemoveContainer" containerID="5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c"
Aug 04 18:21:57.676641 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:21:57.676447    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c\": container with ID starting with 5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c not found: ID does not exist" containerID="5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c"
Aug 04 18:21:57.676641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.676486    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c"} err="failed to get container status \"5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c\": rpc error: code = NotFound desc = could not find container \"5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c\": container with ID starting with 5e29b9df5d23b8ef814bfedf8263b9a1f985e92594e09e83978eeb219e890c6c not found: ID does not exist"
Aug 04 18:21:57.678447 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.678425    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a081e149-7876ff86f4-lq2zk"]
Aug 04 18:21:57.688478 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.688441    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"]
Aug 04 18:21:57.692183 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.692153    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a081e149-59576b6fc5-fl6zh"]
Aug 04 18:21:57.704611 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.704573    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"]
Aug 04 18:21:57.708141 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.708114    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a081e149-7b89ccc788-flwbg"]
Aug 04 18:21:57.900997 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:57.900916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:58.000562 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:58.000532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:58.066005 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:58.065971    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" path="/var/lib/kubelet/pods/12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f/volumes"
Aug 04 18:21:58.066349 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:58.066337    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="175f508b-70bd-4683-a40d-b25e0ca66114" path="/var/lib/kubelet/pods/175f508b-70bd-4683-a40d-b25e0ca66114/volumes"
Aug 04 18:21:58.066659 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:58.066648    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d" path="/var/lib/kubelet/pods/ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d/volumes"
Aug 04 18:21:58.112556 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:58.112529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:58.326321 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:58.326281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:58.644255 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:58.644180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:21:59.132554 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:21:59.132521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:01.125694 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:01.125657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:01.220678 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:01.220641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:02.225959 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.225925    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"]
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226296    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d" containerName="payload-pre-processing"
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226307    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d" containerName="payload-pre-processing"
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226315    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175f508b-70bd-4683-a40d-b25e0ca66114" containerName="payload-processing"
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226320    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="175f508b-70bd-4683-a40d-b25e0ca66114" containerName="payload-processing"
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226343    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" containerName="maas-api"
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226349    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" containerName="maas-api"
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226405    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba2e04a9-c36a-46e4-bc9c-7c2c7c34b28d" containerName="payload-pre-processing"
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226412    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e8ad4f-d8cc-41c0-a281-4aee0dd0aa6f" containerName="maas-api"
Aug 04 18:22:02.226497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.226420    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="175f508b-70bd-4683-a40d-b25e0ca66114" containerName="payload-processing"
Aug 04 18:22:02.230850 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.230803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.233146 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.233129    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-024faf48-serving-cert\""
Aug 04 18:22:02.240464 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.240440    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"]
Aug 04 18:22:02.320574 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.320545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:02.328657 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.328623    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk4n5\" (UniqueName: \"kubernetes.io/projected/de11a17c-7c33-401e-a279-efdffc5d67cd-kube-api-access-zk4n5\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.328820 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.328732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de11a17c-7c33-401e-a279-efdffc5d67cd-maas-api-tls\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.328820 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.328761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de11a17c-7c33-401e-a279-efdffc5d67cd-openshift-service-ca\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.421048 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.421018    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:02.430239 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.430211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de11a17c-7c33-401e-a279-efdffc5d67cd-maas-api-tls\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.430381 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.430252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de11a17c-7c33-401e-a279-efdffc5d67cd-openshift-service-ca\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.430381 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.430286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk4n5\" (UniqueName: \"kubernetes.io/projected/de11a17c-7c33-401e-a279-efdffc5d67cd-kube-api-access-zk4n5\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.430922 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.430902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de11a17c-7c33-401e-a279-efdffc5d67cd-openshift-service-ca\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.432610 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.432590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de11a17c-7c33-401e-a279-efdffc5d67cd-maas-api-tls\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.438403 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.438380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk4n5\" (UniqueName: \"kubernetes.io/projected/de11a17c-7c33-401e-a279-efdffc5d67cd-kube-api-access-zk4n5\") pod \"maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.541595 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.541507    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:02.677953 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.677927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"]
Aug 04 18:22:02.679922 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:22:02.679898    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde11a17c_7c33_401e_a279_efdffc5d67cd.slice/crio-2a37322fc765a9517bbc60d1a6dc52ae9d955e0db6bffa8cbeacf31d3a162ba2 WatchSource:0}: Error finding container 2a37322fc765a9517bbc60d1a6dc52ae9d955e0db6bffa8cbeacf31d3a162ba2: Status 404 returned error can't find the container with id 2a37322fc765a9517bbc60d1a6dc52ae9d955e0db6bffa8cbeacf31d3a162ba2
Aug 04 18:22:02.766285 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.766255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:02.869040 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.868956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:02.875576 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.875551    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"]
Aug 04 18:22:02.880130 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.880113    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:02.882386 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.882367    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-024faf48\""
Aug 04 18:22:02.882869 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.882854    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-024faf48-dockercfg-95mk8\""
Aug 04 18:22:02.888171 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.888149    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"]
Aug 04 18:22:02.892234 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.892212    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"]
Aug 04 18:22:02.892340 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.892305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:02.903797 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.903778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"]
Aug 04 18:22:02.935057 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.935029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj6ps\" (UniqueName: \"kubernetes.io/projected/3e699d6b-0001-4cab-97f6-29423fdf672a-kube-api-access-qj6ps\") pod \"payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br\" (UID: \"3e699d6b-0001-4cab-97f6-29423fdf672a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:02.935191 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.935151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-plugins-config-volume\") pod \"payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd\" (UID: \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\") " pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:02.935191 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.935177    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5v2\" (UniqueName: \"kubernetes.io/projected/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-kube-api-access-6r5v2\") pod \"payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd\" (UID: \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\") " pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:02.935278 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:02.935204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e699d6b-0001-4cab-97f6-29423fdf672a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br\" (UID: \"3e699d6b-0001-4cab-97f6-29423fdf672a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:03.036202 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.036173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj6ps\" (UniqueName: \"kubernetes.io/projected/3e699d6b-0001-4cab-97f6-29423fdf672a-kube-api-access-qj6ps\") pod \"payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br\" (UID: \"3e699d6b-0001-4cab-97f6-29423fdf672a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:03.036306 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.036272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-plugins-config-volume\") pod \"payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd\" (UID: \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\") " pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:03.036306 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.036292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5v2\" (UniqueName: \"kubernetes.io/projected/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-kube-api-access-6r5v2\") pod \"payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd\" (UID: \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\") " pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:03.036413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.036316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e699d6b-0001-4cab-97f6-29423fdf672a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br\" (UID: \"3e699d6b-0001-4cab-97f6-29423fdf672a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:03.037059 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.037038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e699d6b-0001-4cab-97f6-29423fdf672a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br\" (UID: \"3e699d6b-0001-4cab-97f6-29423fdf672a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:03.037177 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.037158    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-plugins-config-volume\") pod \"payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd\" (UID: \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\") " pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:03.043173 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.043155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj6ps\" (UniqueName: \"kubernetes.io/projected/3e699d6b-0001-4cab-97f6-29423fdf672a-kube-api-access-qj6ps\") pod \"payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br\" (UID: \"3e699d6b-0001-4cab-97f6-29423fdf672a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:03.043254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.043176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5v2\" (UniqueName: \"kubernetes.io/projected/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-kube-api-access-6r5v2\") pod \"payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd\" (UID: \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\") " pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:03.192612 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.192571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:03.206677 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.206647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:03.339755 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.339683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"]
Aug 04 18:22:03.343116 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:22:03.343061    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e699d6b_0001_4cab_97f6_29423fdf672a.slice/crio-15dffb181659a3fecd6ed68c5cffd6fa5a7f9e0560de0e831110c127d90303b1 WatchSource:0}: Error finding container 15dffb181659a3fecd6ed68c5cffd6fa5a7f9e0560de0e831110c127d90303b1: Status 404 returned error can't find the container with id 15dffb181659a3fecd6ed68c5cffd6fa5a7f9e0560de0e831110c127d90303b1
Aug 04 18:22:03.369357 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.369334    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"]
Aug 04 18:22:03.689236 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.689202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6" event={"ID":"de11a17c-7c33-401e-a279-efdffc5d67cd","Type":"ContainerStarted","Data":"0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793"}
Aug 04 18:22:03.689420 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.689292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6" event={"ID":"de11a17c-7c33-401e-a279-efdffc5d67cd","Type":"ContainerStarted","Data":"2a37322fc765a9517bbc60d1a6dc52ae9d955e0db6bffa8cbeacf31d3a162ba2"}
Aug 04 18:22:03.689420 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.689326    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:03.690793 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.690760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br" event={"ID":"3e699d6b-0001-4cab-97f6-29423fdf672a","Type":"ContainerStarted","Data":"f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07"}
Aug 04 18:22:03.690954 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.690845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br" event={"ID":"3e699d6b-0001-4cab-97f6-29423fdf672a","Type":"ContainerStarted","Data":"15dffb181659a3fecd6ed68c5cffd6fa5a7f9e0560de0e831110c127d90303b1"}
Aug 04 18:22:03.690954 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.690878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:03.692269 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.692243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd" event={"ID":"5a5b5543-9c84-461c-8c2f-ba00701ddfaf","Type":"ContainerStarted","Data":"54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572"}
Aug 04 18:22:03.692381 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.692290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd" event={"ID":"5a5b5543-9c84-461c-8c2f-ba00701ddfaf","Type":"ContainerStarted","Data":"6c23172a83827c9f70f7411d88d10248389d710a418ec88ba28a69a177cea170"}
Aug 04 18:22:03.692381 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.692329    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:03.705053 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.705011    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6" podStartSLOduration=1.415532227 podStartE2EDuration="1.704997079s" totalImagesPullingTime="289.464852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:22:03.704306499 +0000 UTC m=+2118.080252588" watchObservedRunningTime="2026-08-04 18:22:03.704997079 +0000 UTC m=+2118.080943166"
Aug 04 18:22:03.718260 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.718208    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br" podStartSLOduration=1.718191349 podStartE2EDuration="1.718191349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:22:03.717896663 +0000 UTC m=+2118.093842765" watchObservedRunningTime="2026-08-04 18:22:03.718191349 +0000 UTC m=+2118.094137440"
Aug 04 18:22:03.735091 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:03.735043    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd" podStartSLOduration=1.735029426 podStartE2EDuration="1.735029426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:22:03.732878724 +0000 UTC m=+2118.108824813" watchObservedRunningTime="2026-08-04 18:22:03.735029426 +0000 UTC m=+2118.110975514"
Aug 04 18:22:09.703538 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:09.703509    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:14.699214 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:14.699185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:14.699671 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:14.699266    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:32.759884 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.759847    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"]
Aug 04 18:22:32.760462 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.760065    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6" podUID="de11a17c-7c33-401e-a279-efdffc5d67cd" containerName="maas-api" containerID="cri-o://0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793" gracePeriod=30
Aug 04 18:22:32.784755 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.784670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:32.811455 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.811429    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"]
Aug 04 18:22:32.811691 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.811663    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd" podUID="5a5b5543-9c84-461c-8c2f-ba00701ddfaf" containerName="payload-processing" containerID="cri-o://54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572" gracePeriod=30
Aug 04 18:22:32.834434 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.832655    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"]
Aug 04 18:22:32.834434 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.832894    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br" podUID="3e699d6b-0001-4cab-97f6-29423fdf672a" containerName="payload-pre-processing" containerID="cri-o://f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07" gracePeriod=30
Aug 04 18:22:32.868469 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.868434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:32.933602 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.933570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:32.989831 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:32.989331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:33.100403 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.100365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:33.138827 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.138789    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:33.141799 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.141779    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:33.156036 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.156015    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:33.235618 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.235591    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r5v2\" (UniqueName: \"kubernetes.io/projected/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-kube-api-access-6r5v2\") pod \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\" (UID: \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\") "
Aug 04 18:22:33.235618 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.235622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de11a17c-7c33-401e-a279-efdffc5d67cd-openshift-service-ca\") pod \"de11a17c-7c33-401e-a279-efdffc5d67cd\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") "
Aug 04 18:22:33.235878 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.235643    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk4n5\" (UniqueName: \"kubernetes.io/projected/de11a17c-7c33-401e-a279-efdffc5d67cd-kube-api-access-zk4n5\") pod \"de11a17c-7c33-401e-a279-efdffc5d67cd\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") "
Aug 04 18:22:33.235878 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.235713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-plugins-config-volume\") pod \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\" (UID: \"5a5b5543-9c84-461c-8c2f-ba00701ddfaf\") "
Aug 04 18:22:33.235878 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.235734    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de11a17c-7c33-401e-a279-efdffc5d67cd-maas-api-tls\") pod \"de11a17c-7c33-401e-a279-efdffc5d67cd\" (UID: \"de11a17c-7c33-401e-a279-efdffc5d67cd\") "
Aug 04 18:22:33.236058 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.235985    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de11a17c-7c33-401e-a279-efdffc5d67cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "de11a17c-7c33-401e-a279-efdffc5d67cd" (UID: "de11a17c-7c33-401e-a279-efdffc5d67cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:22:33.236128 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.236104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a5b5543-9c84-461c-8c2f-ba00701ddfaf" (UID: "5a5b5543-9c84-461c-8c2f-ba00701ddfaf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:22:33.236191 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.236154    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de11a17c-7c33-401e-a279-efdffc5d67cd-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:22:33.237711 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.237689    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de11a17c-7c33-401e-a279-efdffc5d67cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "de11a17c-7c33-401e-a279-efdffc5d67cd" (UID: "de11a17c-7c33-401e-a279-efdffc5d67cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:22:33.237711 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.237704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de11a17c-7c33-401e-a279-efdffc5d67cd-kube-api-access-zk4n5" (OuterVolumeSpecName: "kube-api-access-zk4n5") pod "de11a17c-7c33-401e-a279-efdffc5d67cd" (UID: "de11a17c-7c33-401e-a279-efdffc5d67cd"). InnerVolumeSpecName "kube-api-access-zk4n5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:22:33.237849 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.237691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-kube-api-access-6r5v2" (OuterVolumeSpecName: "kube-api-access-6r5v2") pod "5a5b5543-9c84-461c-8c2f-ba00701ddfaf" (UID: "5a5b5543-9c84-461c-8c2f-ba00701ddfaf"). InnerVolumeSpecName "kube-api-access-6r5v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:22:33.327483 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.327420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:33.336460 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.336440    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj6ps\" (UniqueName: \"kubernetes.io/projected/3e699d6b-0001-4cab-97f6-29423fdf672a-kube-api-access-qj6ps\") pod \"3e699d6b-0001-4cab-97f6-29423fdf672a\" (UID: \"3e699d6b-0001-4cab-97f6-29423fdf672a\") "
Aug 04 18:22:33.336547 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.336488    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e699d6b-0001-4cab-97f6-29423fdf672a-plugins-config-volume\") pod \"3e699d6b-0001-4cab-97f6-29423fdf672a\" (UID: \"3e699d6b-0001-4cab-97f6-29423fdf672a\") "
Aug 04 18:22:33.336724 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.336708    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r5v2\" (UniqueName: \"kubernetes.io/projected/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-kube-api-access-6r5v2\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:22:33.336800 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.336726    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk4n5\" (UniqueName: \"kubernetes.io/projected/de11a17c-7c33-401e-a279-efdffc5d67cd-kube-api-access-zk4n5\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:22:33.336800 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.336738    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a5b5543-9c84-461c-8c2f-ba00701ddfaf-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:22:33.336800 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.336746    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de11a17c-7c33-401e-a279-efdffc5d67cd-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:22:33.336963 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.336892    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e699d6b-0001-4cab-97f6-29423fdf672a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e699d6b-0001-4cab-97f6-29423fdf672a" (UID: "3e699d6b-0001-4cab-97f6-29423fdf672a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:22:33.338213 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.338189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e699d6b-0001-4cab-97f6-29423fdf672a-kube-api-access-qj6ps" (OuterVolumeSpecName: "kube-api-access-qj6ps") pod "3e699d6b-0001-4cab-97f6-29423fdf672a" (UID: "3e699d6b-0001-4cab-97f6-29423fdf672a"). InnerVolumeSpecName "kube-api-access-qj6ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:22:33.437476 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.437450    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj6ps\" (UniqueName: \"kubernetes.io/projected/3e699d6b-0001-4cab-97f6-29423fdf672a-kube-api-access-qj6ps\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:22:33.437476 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.437472    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e699d6b-0001-4cab-97f6-29423fdf672a-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:22:33.773521 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.773485    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:33.860706 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.860674    2565 generic.go:356] "Generic (PLEG): container finished" podID="de11a17c-7c33-401e-a279-efdffc5d67cd" containerID="0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793" exitCode=0
Aug 04 18:22:33.860868 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.860718    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"
Aug 04 18:22:33.860868 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.860758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6" event={"ID":"de11a17c-7c33-401e-a279-efdffc5d67cd","Type":"ContainerDied","Data":"0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793"}
Aug 04 18:22:33.860868 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.860832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6" event={"ID":"de11a17c-7c33-401e-a279-efdffc5d67cd","Type":"ContainerDied","Data":"2a37322fc765a9517bbc60d1a6dc52ae9d955e0db6bffa8cbeacf31d3a162ba2"}
Aug 04 18:22:33.860868 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.860868    2565 scope.go:117] "RemoveContainer" containerID="0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793"
Aug 04 18:22:33.862164 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.862144    2565 generic.go:356] "Generic (PLEG): container finished" podID="3e699d6b-0001-4cab-97f6-29423fdf672a" containerID="f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07" exitCode=0
Aug 04 18:22:33.862231 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.862174    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br" event={"ID":"3e699d6b-0001-4cab-97f6-29423fdf672a","Type":"ContainerDied","Data":"f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07"}
Aug 04 18:22:33.862231 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.862202    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"
Aug 04 18:22:33.862231 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.862219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br" event={"ID":"3e699d6b-0001-4cab-97f6-29423fdf672a","Type":"ContainerDied","Data":"15dffb181659a3fecd6ed68c5cffd6fa5a7f9e0560de0e831110c127d90303b1"}
Aug 04 18:22:33.863571 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.863550    2565 generic.go:356] "Generic (PLEG): container finished" podID="5a5b5543-9c84-461c-8c2f-ba00701ddfaf" containerID="54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572" exitCode=0
Aug 04 18:22:33.863713 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.863580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd" event={"ID":"5a5b5543-9c84-461c-8c2f-ba00701ddfaf","Type":"ContainerDied","Data":"54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572"}
Aug 04 18:22:33.863713 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.863594    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"
Aug 04 18:22:33.863713 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.863619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd" event={"ID":"5a5b5543-9c84-461c-8c2f-ba00701ddfaf","Type":"ContainerDied","Data":"6c23172a83827c9f70f7411d88d10248389d710a418ec88ba28a69a177cea170"}
Aug 04 18:22:33.869239 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.869213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:33.870166 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.870145    2565 scope.go:117] "RemoveContainer" containerID="0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793"
Aug 04 18:22:33.870447 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:22:33.870418    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793\": container with ID starting with 0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793 not found: ID does not exist" containerID="0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793"
Aug 04 18:22:33.870546 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.870456    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793"} err="failed to get container status \"0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793\": rpc error: code = NotFound desc = could not find container \"0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793\": container with ID starting with 0158693412c733f984ef0be14a5643629d28593fe96ad6fff41941c875b4d793 not found: ID does not exist"
Aug 04 18:22:33.870546 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.870478    2565 scope.go:117] "RemoveContainer" containerID="f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07"
Aug 04 18:22:33.878960 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.878944    2565 scope.go:117] "RemoveContainer" containerID="f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07"
Aug 04 18:22:33.879243 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:22:33.879224    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07\": container with ID starting with f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07 not found: ID does not exist" containerID="f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07"
Aug 04 18:22:33.879323 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.879245    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07"} err="failed to get container status \"f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07\": rpc error: code = NotFound desc = could not find container \"f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07\": container with ID starting with f6b881793df7c257265e2ba7a723652e535c1a5b7c9d7b3cc2b679992e751f07 not found: ID does not exist"
Aug 04 18:22:33.879323 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.879260    2565 scope.go:117] "RemoveContainer" containerID="54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572"
Aug 04 18:22:33.888358 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.888276    2565 scope.go:117] "RemoveContainer" containerID="54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572"
Aug 04 18:22:33.888561 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:22:33.888542    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572\": container with ID starting with 54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572 not found: ID does not exist" containerID="54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572"
Aug 04 18:22:33.888610 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.888567    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572"} err="failed to get container status \"54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572\": rpc error: code = NotFound desc = could not find container \"54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572\": container with ID starting with 54fa0d00f80bd2ae89749ea9725a2da3e5beedce24b2be11a5a43a8490f4d572 not found: ID does not exist"
Aug 04 18:22:33.890290 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.890271    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"]
Aug 04 18:22:33.895739 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.895719    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-024faf48-5cd8756f9d-nl5cd"]
Aug 04 18:22:33.908024 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.908001    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"]
Aug 04 18:22:33.912179 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.912161    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-024faf48-5f64c46bbb-4tdg6"]
Aug 04 18:22:33.922089 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.922068    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"]
Aug 04 18:22:33.924253 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.924236    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-024faf48-5956c67948-8w5br"]
Aug 04 18:22:33.969113 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:33.969081    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:34.065902 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:34.065840    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e699d6b-0001-4cab-97f6-29423fdf672a" path="/var/lib/kubelet/pods/3e699d6b-0001-4cab-97f6-29423fdf672a/volumes"
Aug 04 18:22:34.066388 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:34.066372    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a5b5543-9c84-461c-8c2f-ba00701ddfaf" path="/var/lib/kubelet/pods/5a5b5543-9c84-461c-8c2f-ba00701ddfaf/volumes"
Aug 04 18:22:34.066734 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:34.066722    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de11a17c-7c33-401e-a279-efdffc5d67cd" path="/var/lib/kubelet/pods/de11a17c-7c33-401e-a279-efdffc5d67cd/volumes"
Aug 04 18:22:45.591752 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:45.591672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:51.636438 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:51.636402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:51.738287 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:51.738253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:51.842685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:51.842647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:51.937554 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:51.937519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:22:52.350368 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:22:52.350281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:18.293959 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:18.293925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:24.201725 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:24.201676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:24.303968 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:24.303924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:24.402336 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:24.402305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:40.242563 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:40.242522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:46.001536 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:46.001488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:46.106591 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:46.106554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:46.200665 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:46.200617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:23:56.690023 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:23:56.689976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:05.592483 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:05.592444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:07.696576 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:07.696541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:13.501009 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:13.500971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:13.611279 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:13.611245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:13.704128 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:13.704083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:13.801957 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:13.801877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:14.427577 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:14.427535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:14.520601 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:14.520547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:14.628301 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:14.628226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:16.086503 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:16.086448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:22.298625 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:22.298579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:22.401984 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:22.401926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:22.950306 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:22.950265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:29.471078 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:29.471044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:29.571664 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:29.571631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:29.706951 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:29.706919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:30.022242 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:30.022188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:30.400874 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:30.400761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:31.109378 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:31.109337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:33.303262 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:33.303230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:33.405137 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:33.405103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.408949    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"]
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409600    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e699d6b-0001-4cab-97f6-29423fdf672a" containerName="payload-pre-processing"
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409621    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e699d6b-0001-4cab-97f6-29423fdf672a" containerName="payload-pre-processing"
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409643    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de11a17c-7c33-401e-a279-efdffc5d67cd" containerName="maas-api"
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409652    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de11a17c-7c33-401e-a279-efdffc5d67cd" containerName="maas-api"
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409660    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a5b5543-9c84-461c-8c2f-ba00701ddfaf" containerName="payload-processing"
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409671    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a5b5543-9c84-461c-8c2f-ba00701ddfaf" containerName="payload-processing"
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409767    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e699d6b-0001-4cab-97f6-29423fdf672a" containerName="payload-pre-processing"
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409785    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de11a17c-7c33-401e-a279-efdffc5d67cd" containerName="maas-api"
Aug 04 18:24:34.409832 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.409796    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a5b5543-9c84-461c-8c2f-ba00701ddfaf" containerName="payload-processing"
Aug 04 18:24:34.413359 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.413331    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.415684 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.415653    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-10e78006-serving-cert\""
Aug 04 18:24:34.427790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.427658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"]
Aug 04 18:24:34.442050 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.442014    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:34.538564 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.538528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:34.594856 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.594783    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/540002e9-fc9c-406b-b122-add7091c8042-maas-api-tls\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.595060 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.594884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwgwv\" (UniqueName: \"kubernetes.io/projected/540002e9-fc9c-406b-b122-add7091c8042-kube-api-access-zwgwv\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.595060 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.594916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/540002e9-fc9c-406b-b122-add7091c8042-openshift-service-ca\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.696061 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.695958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/540002e9-fc9c-406b-b122-add7091c8042-maas-api-tls\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.696061 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.696007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwgwv\" (UniqueName: \"kubernetes.io/projected/540002e9-fc9c-406b-b122-add7091c8042-kube-api-access-zwgwv\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.696262 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.696127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/540002e9-fc9c-406b-b122-add7091c8042-openshift-service-ca\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.696761 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.696736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/540002e9-fc9c-406b-b122-add7091c8042-openshift-service-ca\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.698470 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.698444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/540002e9-fc9c-406b-b122-add7091c8042-maas-api-tls\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.704011 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.703978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwgwv\" (UniqueName: \"kubernetes.io/projected/540002e9-fc9c-406b-b122-add7091c8042-kube-api-access-zwgwv\") pod \"maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.733201 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.733167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:34.892168 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.892076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"]
Aug 04 18:24:34.894006 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:24:34.893962    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540002e9_fc9c_406b_b122_add7091c8042.slice/crio-b8f1aef80874699ae40cb27d1b0351e61e1d51e425a3636f015dd9d721f984cb WatchSource:0}: Error finding container b8f1aef80874699ae40cb27d1b0351e61e1d51e425a3636f015dd9d721f984cb: Status 404 returned error can't find the container with id b8f1aef80874699ae40cb27d1b0351e61e1d51e425a3636f015dd9d721f984cb
Aug 04 18:24:34.915759 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:34.915716    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:35.059768 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.059683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:35.063648 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.063616    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"]
Aug 04 18:24:35.068189 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.068170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:35.070587 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.070566    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-10e78006\""
Aug 04 18:24:35.070717 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.070662    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-10e78006-dockercfg-8cj7w\""
Aug 04 18:24:35.078186 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.078156    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"]
Aug 04 18:24:35.092733 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.092698    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"]
Aug 04 18:24:35.096679 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.096655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:35.107554 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.107527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"]
Aug 04 18:24:35.200547 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.200511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jbbd\" (UniqueName: \"kubernetes.io/projected/aee266a1-c8df-4fba-9104-a89588ad3e2c-kube-api-access-4jbbd\") pod \"payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm\" (UID: \"aee266a1-c8df-4fba-9104-a89588ad3e2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:35.200749 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.200708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8649b68-236f-4d38-8c87-e086533216d4-plugins-config-volume\") pod \"payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4\" (UID: \"a8649b68-236f-4d38-8c87-e086533216d4\") " pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:35.200906 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.200872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h767\" (UniqueName: \"kubernetes.io/projected/a8649b68-236f-4d38-8c87-e086533216d4-kube-api-access-4h767\") pod \"payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4\" (UID: \"a8649b68-236f-4d38-8c87-e086533216d4\") " pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:35.201052 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.200955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee266a1-c8df-4fba-9104-a89588ad3e2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm\" (UID: \"aee266a1-c8df-4fba-9104-a89588ad3e2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:35.302465 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.302428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h767\" (UniqueName: \"kubernetes.io/projected/a8649b68-236f-4d38-8c87-e086533216d4-kube-api-access-4h767\") pod \"payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4\" (UID: \"a8649b68-236f-4d38-8c87-e086533216d4\") " pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:35.302669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.302476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee266a1-c8df-4fba-9104-a89588ad3e2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm\" (UID: \"aee266a1-c8df-4fba-9104-a89588ad3e2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:35.302669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.302538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jbbd\" (UniqueName: \"kubernetes.io/projected/aee266a1-c8df-4fba-9104-a89588ad3e2c-kube-api-access-4jbbd\") pod \"payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm\" (UID: \"aee266a1-c8df-4fba-9104-a89588ad3e2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:35.302669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.302624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8649b68-236f-4d38-8c87-e086533216d4-plugins-config-volume\") pod \"payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4\" (UID: \"a8649b68-236f-4d38-8c87-e086533216d4\") " pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:35.303324 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.303299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee266a1-c8df-4fba-9104-a89588ad3e2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm\" (UID: \"aee266a1-c8df-4fba-9104-a89588ad3e2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:35.303419 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.303304    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8649b68-236f-4d38-8c87-e086533216d4-plugins-config-volume\") pod \"payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4\" (UID: \"a8649b68-236f-4d38-8c87-e086533216d4\") " pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:35.311158 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.311096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h767\" (UniqueName: \"kubernetes.io/projected/a8649b68-236f-4d38-8c87-e086533216d4-kube-api-access-4h767\") pod \"payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4\" (UID: \"a8649b68-236f-4d38-8c87-e086533216d4\") " pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:35.311261 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.311165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jbbd\" (UniqueName: \"kubernetes.io/projected/aee266a1-c8df-4fba-9104-a89588ad3e2c-kube-api-access-4jbbd\") pod \"payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm\" (UID: \"aee266a1-c8df-4fba-9104-a89588ad3e2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:35.382235 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.382195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:35.409669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.409628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:35.477791 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.477705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt" event={"ID":"540002e9-fc9c-406b-b122-add7091c8042","Type":"ContainerStarted","Data":"b8f1aef80874699ae40cb27d1b0351e61e1d51e425a3636f015dd9d721f984cb"}
Aug 04 18:24:35.547096 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.547057    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"]
Aug 04 18:24:35.549176 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:24:35.549131    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8649b68_236f_4d38_8c87_e086533216d4.slice/crio-2a348de37bff03b973bc75e76c07450ef33dca2c56a0cf1f1d54d4f4af04ffec WatchSource:0}: Error finding container 2a348de37bff03b973bc75e76c07450ef33dca2c56a0cf1f1d54d4f4af04ffec: Status 404 returned error can't find the container with id 2a348de37bff03b973bc75e76c07450ef33dca2c56a0cf1f1d54d4f4af04ffec
Aug 04 18:24:35.581586 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:35.581560    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"]
Aug 04 18:24:35.583014 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:24:35.582987    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee266a1_c8df_4fba_9104_a89588ad3e2c.slice/crio-6176a3055b7f3f36880c6a18726b79b0d8e7aca96d9dd3c4bbe15ae7e8ebd6b6 WatchSource:0}: Error finding container 6176a3055b7f3f36880c6a18726b79b0d8e7aca96d9dd3c4bbe15ae7e8ebd6b6: Status 404 returned error can't find the container with id 6176a3055b7f3f36880c6a18726b79b0d8e7aca96d9dd3c4bbe15ae7e8ebd6b6
Aug 04 18:24:36.485067 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.485014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt" event={"ID":"540002e9-fc9c-406b-b122-add7091c8042","Type":"ContainerStarted","Data":"f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98"}
Aug 04 18:24:36.485551 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.485158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:36.490681 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.490644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm" event={"ID":"aee266a1-c8df-4fba-9104-a89588ad3e2c","Type":"ContainerStarted","Data":"d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3"}
Aug 04 18:24:36.490857 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.490789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm" event={"ID":"aee266a1-c8df-4fba-9104-a89588ad3e2c","Type":"ContainerStarted","Data":"6176a3055b7f3f36880c6a18726b79b0d8e7aca96d9dd3c4bbe15ae7e8ebd6b6"}
Aug 04 18:24:36.490857 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.490843    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:36.492566 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.492530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4" event={"ID":"a8649b68-236f-4d38-8c87-e086533216d4","Type":"ContainerStarted","Data":"da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42"}
Aug 04 18:24:36.492713 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.492574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4" event={"ID":"a8649b68-236f-4d38-8c87-e086533216d4","Type":"ContainerStarted","Data":"2a348de37bff03b973bc75e76c07450ef33dca2c56a0cf1f1d54d4f4af04ffec"}
Aug 04 18:24:36.492713 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.492684    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:36.506456 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.506406    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt" podStartSLOduration=1.87970461 podStartE2EDuration="2.5063916s" totalImagesPullingTime="626.68699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:24:36.505525261 +0000 UTC m=+2270.881471351" watchObservedRunningTime="2026-08-04 18:24:36.5063916 +0000 UTC m=+2270.882337690"
Aug 04 18:24:36.520661 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.520615    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm" podStartSLOduration=1.5206009919999999 podStartE2EDuration="1.520600992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:24:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:24:36.519306271 +0000 UTC m=+2270.895252367" watchObservedRunningTime="2026-08-04 18:24:36.520600992 +0000 UTC m=+2270.896547073"
Aug 04 18:24:36.535801 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:36.535747    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4" podStartSLOduration=1.5357301840000002 podStartE2EDuration="1.535730184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:24:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:24:36.534425743 +0000 UTC m=+2270.910371834" watchObservedRunningTime="2026-08-04 18:24:36.535730184 +0000 UTC m=+2270.911676274"
Aug 04 18:24:42.503428 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:42.503396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:24:47.500398 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:47.500356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:24:47.500927 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:47.500432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:24:58.284096 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:58.284057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:58.915439 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:58.915402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:59.014769 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:59.014737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:24:59.336776 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:24:59.336692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:05.051862 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:05.051830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:05.152627 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:05.152600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:15.905783 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:15.905743    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"]
Aug 04 18:25:15.906404 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:15.906035    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt" podUID="540002e9-fc9c-406b-b122-add7091c8042" containerName="maas-api" containerID="cri-o://f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98" gracePeriod=30
Aug 04 18:25:15.929332 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:15.929305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:15.956476 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:15.956391    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"]
Aug 04 18:25:15.957027 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:15.956624    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4" podUID="a8649b68-236f-4d38-8c87-e086533216d4" containerName="payload-processing" containerID="cri-o://da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42" gracePeriod=30
Aug 04 18:25:15.962916 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:15.962874    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"]
Aug 04 18:25:15.963329 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:15.963281    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm" podUID="aee266a1-c8df-4fba-9104-a89588ad3e2c" containerName="payload-pre-processing" containerID="cri-o://d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3" gracePeriod=30
Aug 04 18:25:15.993372 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:15.993292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:16.078628 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.078600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:16.138599 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.137409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:16.243148 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.243122    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:25:16.246315 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.246295    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:25:16.260141 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.260099    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:25:16.388734 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.388705    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8649b68-236f-4d38-8c87-e086533216d4-plugins-config-volume\") pod \"a8649b68-236f-4d38-8c87-e086533216d4\" (UID: \"a8649b68-236f-4d38-8c87-e086533216d4\") "
Aug 04 18:25:16.388734 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.388736    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee266a1-c8df-4fba-9104-a89588ad3e2c-plugins-config-volume\") pod \"aee266a1-c8df-4fba-9104-a89588ad3e2c\" (UID: \"aee266a1-c8df-4fba-9104-a89588ad3e2c\") "
Aug 04 18:25:16.388998 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.388781    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwgwv\" (UniqueName: \"kubernetes.io/projected/540002e9-fc9c-406b-b122-add7091c8042-kube-api-access-zwgwv\") pod \"540002e9-fc9c-406b-b122-add7091c8042\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") "
Aug 04 18:25:16.388998 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.388799    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h767\" (UniqueName: \"kubernetes.io/projected/a8649b68-236f-4d38-8c87-e086533216d4-kube-api-access-4h767\") pod \"a8649b68-236f-4d38-8c87-e086533216d4\" (UID: \"a8649b68-236f-4d38-8c87-e086533216d4\") "
Aug 04 18:25:16.388998 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.388845    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/540002e9-fc9c-406b-b122-add7091c8042-maas-api-tls\") pod \"540002e9-fc9c-406b-b122-add7091c8042\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") "
Aug 04 18:25:16.388998 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.388861    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jbbd\" (UniqueName: \"kubernetes.io/projected/aee266a1-c8df-4fba-9104-a89588ad3e2c-kube-api-access-4jbbd\") pod \"aee266a1-c8df-4fba-9104-a89588ad3e2c\" (UID: \"aee266a1-c8df-4fba-9104-a89588ad3e2c\") "
Aug 04 18:25:16.388998 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.388918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/540002e9-fc9c-406b-b122-add7091c8042-openshift-service-ca\") pod \"540002e9-fc9c-406b-b122-add7091c8042\" (UID: \"540002e9-fc9c-406b-b122-add7091c8042\") "
Aug 04 18:25:16.389275 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.389199    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8649b68-236f-4d38-8c87-e086533216d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8649b68-236f-4d38-8c87-e086533216d4" (UID: "a8649b68-236f-4d38-8c87-e086533216d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:25:16.389354 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.389237    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aee266a1-c8df-4fba-9104-a89588ad3e2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aee266a1-c8df-4fba-9104-a89588ad3e2c" (UID: "aee266a1-c8df-4fba-9104-a89588ad3e2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:25:16.389447 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.389374    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8649b68-236f-4d38-8c87-e086533216d4-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:25:16.389534 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.389436    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/540002e9-fc9c-406b-b122-add7091c8042-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "540002e9-fc9c-406b-b122-add7091c8042" (UID: "540002e9-fc9c-406b-b122-add7091c8042"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:25:16.391012 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.390987    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540002e9-fc9c-406b-b122-add7091c8042-kube-api-access-zwgwv" (OuterVolumeSpecName: "kube-api-access-zwgwv") pod "540002e9-fc9c-406b-b122-add7091c8042" (UID: "540002e9-fc9c-406b-b122-add7091c8042"). InnerVolumeSpecName "kube-api-access-zwgwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:25:16.391134 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.391014    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee266a1-c8df-4fba-9104-a89588ad3e2c-kube-api-access-4jbbd" (OuterVolumeSpecName: "kube-api-access-4jbbd") pod "aee266a1-c8df-4fba-9104-a89588ad3e2c" (UID: "aee266a1-c8df-4fba-9104-a89588ad3e2c"). InnerVolumeSpecName "kube-api-access-4jbbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:25:16.391134 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.391019    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/540002e9-fc9c-406b-b122-add7091c8042-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "540002e9-fc9c-406b-b122-add7091c8042" (UID: "540002e9-fc9c-406b-b122-add7091c8042"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:25:16.391215 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.391152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8649b68-236f-4d38-8c87-e086533216d4-kube-api-access-4h767" (OuterVolumeSpecName: "kube-api-access-4h767") pod "a8649b68-236f-4d38-8c87-e086533216d4" (UID: "a8649b68-236f-4d38-8c87-e086533216d4"). InnerVolumeSpecName "kube-api-access-4h767". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:25:16.490461 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.490402    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwgwv\" (UniqueName: \"kubernetes.io/projected/540002e9-fc9c-406b-b122-add7091c8042-kube-api-access-zwgwv\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:25:16.490461 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.490423    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h767\" (UniqueName: \"kubernetes.io/projected/a8649b68-236f-4d38-8c87-e086533216d4-kube-api-access-4h767\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:25:16.490461 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.490445    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/540002e9-fc9c-406b-b122-add7091c8042-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:25:16.490461 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.490456    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jbbd\" (UniqueName: \"kubernetes.io/projected/aee266a1-c8df-4fba-9104-a89588ad3e2c-kube-api-access-4jbbd\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:25:16.490461 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.490464    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/540002e9-fc9c-406b-b122-add7091c8042-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:25:16.490685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.490473    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee266a1-c8df-4fba-9104-a89588ad3e2c-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:25:16.503444 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.503411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:16.702026 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.701992    2565 generic.go:356] "Generic (PLEG): container finished" podID="a8649b68-236f-4d38-8c87-e086533216d4" containerID="da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42" exitCode=0
Aug 04 18:25:16.702162 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.702033    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"
Aug 04 18:25:16.702162 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.702040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4" event={"ID":"a8649b68-236f-4d38-8c87-e086533216d4","Type":"ContainerDied","Data":"da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42"}
Aug 04 18:25:16.702162 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.702088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4" event={"ID":"a8649b68-236f-4d38-8c87-e086533216d4","Type":"ContainerDied","Data":"2a348de37bff03b973bc75e76c07450ef33dca2c56a0cf1f1d54d4f4af04ffec"}
Aug 04 18:25:16.702162 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.702121    2565 scope.go:117] "RemoveContainer" containerID="da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42"
Aug 04 18:25:16.703312 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.703293    2565 generic.go:356] "Generic (PLEG): container finished" podID="540002e9-fc9c-406b-b122-add7091c8042" containerID="f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98" exitCode=0
Aug 04 18:25:16.703409 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.703333    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"
Aug 04 18:25:16.703409 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.703372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt" event={"ID":"540002e9-fc9c-406b-b122-add7091c8042","Type":"ContainerDied","Data":"f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98"}
Aug 04 18:25:16.703523 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.703423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt" event={"ID":"540002e9-fc9c-406b-b122-add7091c8042","Type":"ContainerDied","Data":"b8f1aef80874699ae40cb27d1b0351e61e1d51e425a3636f015dd9d721f984cb"}
Aug 04 18:25:16.704865 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.704841    2565 generic.go:356] "Generic (PLEG): container finished" podID="aee266a1-c8df-4fba-9104-a89588ad3e2c" containerID="d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3" exitCode=0
Aug 04 18:25:16.704978 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.704927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm" event={"ID":"aee266a1-c8df-4fba-9104-a89588ad3e2c","Type":"ContainerDied","Data":"d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3"}
Aug 04 18:25:16.704978 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.704932    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"
Aug 04 18:25:16.704978 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.704968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm" event={"ID":"aee266a1-c8df-4fba-9104-a89588ad3e2c","Type":"ContainerDied","Data":"6176a3055b7f3f36880c6a18726b79b0d8e7aca96d9dd3c4bbe15ae7e8ebd6b6"}
Aug 04 18:25:16.713289 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.713267    2565 scope.go:117] "RemoveContainer" containerID="da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42"
Aug 04 18:25:16.713578 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:25:16.713554    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42\": container with ID starting with da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42 not found: ID does not exist" containerID="da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42"
Aug 04 18:25:16.713641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.713592    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42"} err="failed to get container status \"da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42\": rpc error: code = NotFound desc = could not find container \"da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42\": container with ID starting with da60818cc35228fa2dc595e0cb26ae59af8e3ff93a906ec00f4460a368220c42 not found: ID does not exist"
Aug 04 18:25:16.713641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.713618    2565 scope.go:117] "RemoveContainer" containerID="f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98"
Aug 04 18:25:16.721442 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.721427    2565 scope.go:117] "RemoveContainer" containerID="f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98"
Aug 04 18:25:16.721684 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:25:16.721666    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98\": container with ID starting with f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98 not found: ID does not exist" containerID="f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98"
Aug 04 18:25:16.721722 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.721692    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98"} err="failed to get container status \"f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98\": rpc error: code = NotFound desc = could not find container \"f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98\": container with ID starting with f98dd92f4037bb16ddb77ebc7cd2930f2b6de7cdaeda99a0286da77413f26f98 not found: ID does not exist"
Aug 04 18:25:16.721722 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.721709    2565 scope.go:117] "RemoveContainer" containerID="d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3"
Aug 04 18:25:16.727129 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.727104    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"]
Aug 04 18:25:16.729619 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.729601    2565 scope.go:117] "RemoveContainer" containerID="d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3"
Aug 04 18:25:16.730088 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:25:16.730061    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3\": container with ID starting with d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3 not found: ID does not exist" containerID="d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3"
Aug 04 18:25:16.730212 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.730095    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3"} err="failed to get container status \"d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3\": rpc error: code = NotFound desc = could not find container \"d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3\": container with ID starting with d74ababe47c7b24c49952437685483916ebb56e4cfc5228aa4d4afb2bc38cdc3 not found: ID does not exist"
Aug 04 18:25:16.732653 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.732632    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-10e78006-86f486bff4-mnqd4"]
Aug 04 18:25:16.742640 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.742585    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"]
Aug 04 18:25:16.746116 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.746097    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10e78006-57cd6c9496-pmnwt"]
Aug 04 18:25:16.754922 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.754903    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"]
Aug 04 18:25:16.758710 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:16.758693    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-10e78006-ffb9d45d4-zs6dm"]
Aug 04 18:25:18.066579 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:18.066546    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="540002e9-fc9c-406b-b122-add7091c8042" path="/var/lib/kubelet/pods/540002e9-fc9c-406b-b122-add7091c8042/volumes"
Aug 04 18:25:18.066963 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:18.066915    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8649b68-236f-4d38-8c87-e086533216d4" path="/var/lib/kubelet/pods/a8649b68-236f-4d38-8c87-e086533216d4/volumes"
Aug 04 18:25:18.067229 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:18.067215    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aee266a1-c8df-4fba-9104-a89588ad3e2c" path="/var/lib/kubelet/pods/aee266a1-c8df-4fba-9104-a89588ad3e2c/volumes"
Aug 04 18:25:22.137454 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:22.137417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:22.202309 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:22.202273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:22.490572 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:22.490537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:22.631343 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:22.631287    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:22.744107 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:22.744018    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:22.843166 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:22.843135    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:22.956260 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:22.956227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:28.499223 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:28.499189    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:28.575945 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:28.575911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:28.659542 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:28.659506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:28.851046 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:28.850948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:34.492484 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:34.492445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:34.593339 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:34.593301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:25:53.070765 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:25:53.070736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:26:46.208993 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:26:46.208964    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:26:46.215775 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:26:46.215749    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:26:46.218308 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:26:46.218292    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:26:46.224735 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:26:46.224719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:27:13.836925 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:13.836803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:37.012997 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:37.012961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:37.314097 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:37.314015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:37.933229 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:37.933192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:40.093091 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:40.093049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:40.190451 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:40.190410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:41.232840 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.232794    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"]
Aug 04 18:27:41.233245 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233231    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540002e9-fc9c-406b-b122-add7091c8042" containerName="maas-api"
Aug 04 18:27:41.233290 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233248    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="540002e9-fc9c-406b-b122-add7091c8042" containerName="maas-api"
Aug 04 18:27:41.233290 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233256    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aee266a1-c8df-4fba-9104-a89588ad3e2c" containerName="payload-pre-processing"
Aug 04 18:27:41.233290 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233261    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aee266a1-c8df-4fba-9104-a89588ad3e2c" containerName="payload-pre-processing"
Aug 04 18:27:41.233290 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233271    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8649b68-236f-4d38-8c87-e086533216d4" containerName="payload-processing"
Aug 04 18:27:41.233290 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233278    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8649b68-236f-4d38-8c87-e086533216d4" containerName="payload-processing"
Aug 04 18:27:41.233443 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233339    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aee266a1-c8df-4fba-9104-a89588ad3e2c" containerName="payload-pre-processing"
Aug 04 18:27:41.233443 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233349    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8649b68-236f-4d38-8c87-e086533216d4" containerName="payload-processing"
Aug 04 18:27:41.233443 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.233357    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="540002e9-fc9c-406b-b122-add7091c8042" containerName="maas-api"
Aug 04 18:27:41.236260 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.236236    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.239025 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.239002    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6f0f8ee0-serving-cert\""
Aug 04 18:27:41.261337 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.261299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"]
Aug 04 18:27:41.264557 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.264515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5d56da-ad29-47ca-9b44-c1c3541d9066-openshift-service-ca\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.264710 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.264562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft42z\" (UniqueName: \"kubernetes.io/projected/cc5d56da-ad29-47ca-9b44-c1c3541d9066-kube-api-access-ft42z\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.264771 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.264726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc5d56da-ad29-47ca-9b44-c1c3541d9066-maas-api-tls\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.287358 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.287322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:41.365408 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.365374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc5d56da-ad29-47ca-9b44-c1c3541d9066-maas-api-tls\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.365603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.365546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5d56da-ad29-47ca-9b44-c1c3541d9066-openshift-service-ca\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.365603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.365586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft42z\" (UniqueName: \"kubernetes.io/projected/cc5d56da-ad29-47ca-9b44-c1c3541d9066-kube-api-access-ft42z\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.366225 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.366201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5d56da-ad29-47ca-9b44-c1c3541d9066-openshift-service-ca\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.368081 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.368060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc5d56da-ad29-47ca-9b44-c1c3541d9066-maas-api-tls\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.373824 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.373791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft42z\" (UniqueName: \"kubernetes.io/projected/cc5d56da-ad29-47ca-9b44-c1c3541d9066-kube-api-access-ft42z\") pod \"maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.387939 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.387909    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:41.553716 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.553615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:41.696759 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.696730    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"]
Aug 04 18:27:41.699295 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:27:41.699266    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5d56da_ad29_47ca_9b44_c1c3541d9066.slice/crio-0fcf3c2a97b2003ff8250c4e07af3428c3dda7e02c860e865753730b5025522f WatchSource:0}: Error finding container 0fcf3c2a97b2003ff8250c4e07af3428c3dda7e02c860e865753730b5025522f: Status 404 returned error can't find the container with id 0fcf3c2a97b2003ff8250c4e07af3428c3dda7e02c860e865753730b5025522f
Aug 04 18:27:41.700685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.700664    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:27:41.804981 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.804893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:41.902382 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.902345    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"]
Aug 04 18:27:41.904134 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.904098    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:27:41.907295 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.907272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:41.909708 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.909692    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6f0f8ee0-dockercfg-b5xg6\""
Aug 04 18:27:41.909825 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.909692    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6f0f8ee0\""
Aug 04 18:27:41.915057 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.915031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"]
Aug 04 18:27:41.936262 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.936225    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"]
Aug 04 18:27:41.940236 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.940216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:41.951714 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.951688    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"]
Aug 04 18:27:41.972149 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.972106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1280989c-391e-441b-9b24-18eb69d35f67-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv\" (UID: \"1280989c-391e-441b-9b24-18eb69d35f67\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:41.972149 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.972149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d7edee-472c-4938-be20-fc63ddd37c1b-plugins-config-volume\") pod \"payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f\" (UID: \"e3d7edee-472c-4938-be20-fc63ddd37c1b\") " pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:41.972371 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.972256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lr8q\" (UniqueName: \"kubernetes.io/projected/e3d7edee-472c-4938-be20-fc63ddd37c1b-kube-api-access-8lr8q\") pod \"payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f\" (UID: \"e3d7edee-472c-4938-be20-fc63ddd37c1b\") " pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:41.972371 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:41.972294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qk4f\" (UniqueName: \"kubernetes.io/projected/1280989c-391e-441b-9b24-18eb69d35f67-kube-api-access-5qk4f\") pod \"payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv\" (UID: \"1280989c-391e-441b-9b24-18eb69d35f67\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:42.073925 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.073826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1280989c-391e-441b-9b24-18eb69d35f67-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv\" (UID: \"1280989c-391e-441b-9b24-18eb69d35f67\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:42.073925 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.073872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d7edee-472c-4938-be20-fc63ddd37c1b-plugins-config-volume\") pod \"payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f\" (UID: \"e3d7edee-472c-4938-be20-fc63ddd37c1b\") " pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:42.074155 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.073941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lr8q\" (UniqueName: \"kubernetes.io/projected/e3d7edee-472c-4938-be20-fc63ddd37c1b-kube-api-access-8lr8q\") pod \"payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f\" (UID: \"e3d7edee-472c-4938-be20-fc63ddd37c1b\") " pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:42.074155 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.073969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qk4f\" (UniqueName: \"kubernetes.io/projected/1280989c-391e-441b-9b24-18eb69d35f67-kube-api-access-5qk4f\") pod \"payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv\" (UID: \"1280989c-391e-441b-9b24-18eb69d35f67\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:42.074616 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.074594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1280989c-391e-441b-9b24-18eb69d35f67-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv\" (UID: \"1280989c-391e-441b-9b24-18eb69d35f67\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:42.074685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.074644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d7edee-472c-4938-be20-fc63ddd37c1b-plugins-config-volume\") pod \"payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f\" (UID: \"e3d7edee-472c-4938-be20-fc63ddd37c1b\") " pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:42.081515 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.081489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qk4f\" (UniqueName: \"kubernetes.io/projected/1280989c-391e-441b-9b24-18eb69d35f67-kube-api-access-5qk4f\") pod \"payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv\" (UID: \"1280989c-391e-441b-9b24-18eb69d35f67\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:42.081630 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.081534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lr8q\" (UniqueName: \"kubernetes.io/projected/e3d7edee-472c-4938-be20-fc63ddd37c1b-kube-api-access-8lr8q\") pod \"payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f\" (UID: \"e3d7edee-472c-4938-be20-fc63ddd37c1b\") " pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:42.221044 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.220987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:42.253120 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.253085    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:42.381201 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.381128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"]
Aug 04 18:27:42.386647 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:27:42.386573    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1280989c_391e_441b_9b24_18eb69d35f67.slice/crio-c6ee7e85df436e11a0bc3f5592648a70c69f59af8a0eed81a9b322cb078284e7 WatchSource:0}: Error finding container c6ee7e85df436e11a0bc3f5592648a70c69f59af8a0eed81a9b322cb078284e7: Status 404 returned error can't find the container with id c6ee7e85df436e11a0bc3f5592648a70c69f59af8a0eed81a9b322cb078284e7
Aug 04 18:27:42.418894 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.418867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"]
Aug 04 18:27:42.422056 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:27:42.422010    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d7edee_472c_4938_be20_fc63ddd37c1b.slice/crio-b4dbaab7e8d11bdeed9b0eda23f24e57ff32e09df42c12f4b133f7c022d4229a WatchSource:0}: Error finding container b4dbaab7e8d11bdeed9b0eda23f24e57ff32e09df42c12f4b133f7c022d4229a: Status 404 returned error can't find the container with id b4dbaab7e8d11bdeed9b0eda23f24e57ff32e09df42c12f4b133f7c022d4229a
Aug 04 18:27:42.427528 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.427500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv" event={"ID":"1280989c-391e-441b-9b24-18eb69d35f67","Type":"ContainerStarted","Data":"c6ee7e85df436e11a0bc3f5592648a70c69f59af8a0eed81a9b322cb078284e7"}
Aug 04 18:27:42.428916 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.428890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd" event={"ID":"cc5d56da-ad29-47ca-9b44-c1c3541d9066","Type":"ContainerStarted","Data":"9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050"}
Aug 04 18:27:42.429023 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.428935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd" event={"ID":"cc5d56da-ad29-47ca-9b44-c1c3541d9066","Type":"ContainerStarted","Data":"0fcf3c2a97b2003ff8250c4e07af3428c3dda7e02c860e865753730b5025522f"}
Aug 04 18:27:42.429957 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.429938    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:42.445539 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:42.445489    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd" podStartSLOduration=1.042637537 podStartE2EDuration="1.445472133s" totalImagesPullingTime="402.834596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:27:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:27:42.443830333 +0000 UTC m=+2456.819776416" watchObservedRunningTime="2026-08-04 18:27:42.445472133 +0000 UTC m=+2456.821418251"
Aug 04 18:27:43.436379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:43.436340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv" event={"ID":"1280989c-391e-441b-9b24-18eb69d35f67","Type":"ContainerStarted","Data":"65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507"}
Aug 04 18:27:43.436846 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:43.436462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:43.438031 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:43.438007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f" event={"ID":"e3d7edee-472c-4938-be20-fc63ddd37c1b","Type":"ContainerStarted","Data":"217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a"}
Aug 04 18:27:43.438151 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:43.438042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f" event={"ID":"e3d7edee-472c-4938-be20-fc63ddd37c1b","Type":"ContainerStarted","Data":"b4dbaab7e8d11bdeed9b0eda23f24e57ff32e09df42c12f4b133f7c022d4229a"}
Aug 04 18:27:43.438151 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:43.438091    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:27:43.451689 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:43.451639    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv" podStartSLOduration=2.451622511 podStartE2EDuration="2.451622511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:27:43.45011398 +0000 UTC m=+2457.826060081" watchObservedRunningTime="2026-08-04 18:27:43.451622511 +0000 UTC m=+2457.827568600"
Aug 04 18:27:43.464368 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:43.464229    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f" podStartSLOduration=2.464211282 podStartE2EDuration="2.464211282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:27:43.463568728 +0000 UTC m=+2457.839514818" watchObservedRunningTime="2026-08-04 18:27:43.464211282 +0000 UTC m=+2457.840157373"
Aug 04 18:27:48.443569 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:48.443532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:27:54.452312 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:54.452279    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:27:54.452786 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:27:54.452370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:28:03.103151 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:28:03.103094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:28:05.051258 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:28:05.051214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:28:11.415567 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:28:11.415522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:28:18.465538 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:28:18.465492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:04.848733 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:04.848701    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"]
Aug 04 18:29:04.849279 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:04.848917    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd" podUID="cc5d56da-ad29-47ca-9b44-c1c3541d9066" containerName="maas-api" containerID="cri-o://9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050" gracePeriod=30
Aug 04 18:29:04.871999 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:04.871950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:04.896589 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:04.896557    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"]
Aug 04 18:29:04.896868 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:04.896842    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f" podUID="e3d7edee-472c-4938-be20-fc63ddd37c1b" containerName="payload-processing" containerID="cri-o://217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a" gracePeriod=30
Aug 04 18:29:04.903116 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:04.902724    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"]
Aug 04 18:29:04.903116 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:04.902948    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv" podUID="1280989c-391e-441b-9b24-18eb69d35f67" containerName="payload-pre-processing" containerID="cri-o://65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507" gracePeriod=30
Aug 04 18:29:04.932548 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:04.932519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:05.034712 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.034621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:05.091343 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.091263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:05.195109 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.195079    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:29:05.198576 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.198554    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:29:05.225553 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.225522    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:29:05.299342 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299316    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5d56da-ad29-47ca-9b44-c1c3541d9066-openshift-service-ca\") pod \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") "
Aug 04 18:29:05.299505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qk4f\" (UniqueName: \"kubernetes.io/projected/1280989c-391e-441b-9b24-18eb69d35f67-kube-api-access-5qk4f\") pod \"1280989c-391e-441b-9b24-18eb69d35f67\" (UID: \"1280989c-391e-441b-9b24-18eb69d35f67\") "
Aug 04 18:29:05.299505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299404    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft42z\" (UniqueName: \"kubernetes.io/projected/cc5d56da-ad29-47ca-9b44-c1c3541d9066-kube-api-access-ft42z\") pod \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") "
Aug 04 18:29:05.299505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299431    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc5d56da-ad29-47ca-9b44-c1c3541d9066-maas-api-tls\") pod \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\" (UID: \"cc5d56da-ad29-47ca-9b44-c1c3541d9066\") "
Aug 04 18:29:05.299505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299475    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1280989c-391e-441b-9b24-18eb69d35f67-plugins-config-volume\") pod \"1280989c-391e-441b-9b24-18eb69d35f67\" (UID: \"1280989c-391e-441b-9b24-18eb69d35f67\") "
Aug 04 18:29:05.299738 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d7edee-472c-4938-be20-fc63ddd37c1b-plugins-config-volume\") pod \"e3d7edee-472c-4938-be20-fc63ddd37c1b\" (UID: \"e3d7edee-472c-4938-be20-fc63ddd37c1b\") "
Aug 04 18:29:05.299738 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299540    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lr8q\" (UniqueName: \"kubernetes.io/projected/e3d7edee-472c-4938-be20-fc63ddd37c1b-kube-api-access-8lr8q\") pod \"e3d7edee-472c-4938-be20-fc63ddd37c1b\" (UID: \"e3d7edee-472c-4938-be20-fc63ddd37c1b\") "
Aug 04 18:29:05.299738 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299663    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5d56da-ad29-47ca-9b44-c1c3541d9066-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc5d56da-ad29-47ca-9b44-c1c3541d9066" (UID: "cc5d56da-ad29-47ca-9b44-c1c3541d9066"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:29:05.299959 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299930    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1280989c-391e-441b-9b24-18eb69d35f67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1280989c-391e-441b-9b24-18eb69d35f67" (UID: "1280989c-391e-441b-9b24-18eb69d35f67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:29:05.299959 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.299942    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d7edee-472c-4938-be20-fc63ddd37c1b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3d7edee-472c-4938-be20-fc63ddd37c1b" (UID: "e3d7edee-472c-4938-be20-fc63ddd37c1b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:29:05.300125 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.300103    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5d56da-ad29-47ca-9b44-c1c3541d9066-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:29:05.300189 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.300128    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1280989c-391e-441b-9b24-18eb69d35f67-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:29:05.300189 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.300137    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d7edee-472c-4938-be20-fc63ddd37c1b-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:29:05.301528 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.301498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc5d56da-ad29-47ca-9b44-c1c3541d9066-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc5d56da-ad29-47ca-9b44-c1c3541d9066" (UID: "cc5d56da-ad29-47ca-9b44-c1c3541d9066"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:29:05.301642 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.301562    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5d56da-ad29-47ca-9b44-c1c3541d9066-kube-api-access-ft42z" (OuterVolumeSpecName: "kube-api-access-ft42z") pod "cc5d56da-ad29-47ca-9b44-c1c3541d9066" (UID: "cc5d56da-ad29-47ca-9b44-c1c3541d9066"). InnerVolumeSpecName "kube-api-access-ft42z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:29:05.301874 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.301855    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d7edee-472c-4938-be20-fc63ddd37c1b-kube-api-access-8lr8q" (OuterVolumeSpecName: "kube-api-access-8lr8q") pod "e3d7edee-472c-4938-be20-fc63ddd37c1b" (UID: "e3d7edee-472c-4938-be20-fc63ddd37c1b"). InnerVolumeSpecName "kube-api-access-8lr8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:29:05.301874 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.301861    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1280989c-391e-441b-9b24-18eb69d35f67-kube-api-access-5qk4f" (OuterVolumeSpecName: "kube-api-access-5qk4f") pod "1280989c-391e-441b-9b24-18eb69d35f67" (UID: "1280989c-391e-441b-9b24-18eb69d35f67"). InnerVolumeSpecName "kube-api-access-5qk4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:29:05.401067 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.400974    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft42z\" (UniqueName: \"kubernetes.io/projected/cc5d56da-ad29-47ca-9b44-c1c3541d9066-kube-api-access-ft42z\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:29:05.401067 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.401010    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc5d56da-ad29-47ca-9b44-c1c3541d9066-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:29:05.401067 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.401020    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lr8q\" (UniqueName: \"kubernetes.io/projected/e3d7edee-472c-4938-be20-fc63ddd37c1b-kube-api-access-8lr8q\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:29:05.401067 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.401030    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qk4f\" (UniqueName: \"kubernetes.io/projected/1280989c-391e-441b-9b24-18eb69d35f67-kube-api-access-5qk4f\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:29:05.867685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.867650    2565 generic.go:356] "Generic (PLEG): container finished" podID="1280989c-391e-441b-9b24-18eb69d35f67" containerID="65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507" exitCode=0
Aug 04 18:29:05.868110 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.867696    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"
Aug 04 18:29:05.868110 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.867735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv" event={"ID":"1280989c-391e-441b-9b24-18eb69d35f67","Type":"ContainerDied","Data":"65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507"}
Aug 04 18:29:05.868110 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.867839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv" event={"ID":"1280989c-391e-441b-9b24-18eb69d35f67","Type":"ContainerDied","Data":"c6ee7e85df436e11a0bc3f5592648a70c69f59af8a0eed81a9b322cb078284e7"}
Aug 04 18:29:05.868110 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.867874    2565 scope.go:117] "RemoveContainer" containerID="65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507"
Aug 04 18:29:05.869212 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.869099    2565 generic.go:356] "Generic (PLEG): container finished" podID="cc5d56da-ad29-47ca-9b44-c1c3541d9066" containerID="9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050" exitCode=0
Aug 04 18:29:05.869212 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.869136    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"
Aug 04 18:29:05.869212 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.869179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd" event={"ID":"cc5d56da-ad29-47ca-9b44-c1c3541d9066","Type":"ContainerDied","Data":"9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050"}
Aug 04 18:29:05.869393 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.869221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd" event={"ID":"cc5d56da-ad29-47ca-9b44-c1c3541d9066","Type":"ContainerDied","Data":"0fcf3c2a97b2003ff8250c4e07af3428c3dda7e02c860e865753730b5025522f"}
Aug 04 18:29:05.870576 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.870553    2565 generic.go:356] "Generic (PLEG): container finished" podID="e3d7edee-472c-4938-be20-fc63ddd37c1b" containerID="217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a" exitCode=0
Aug 04 18:29:05.870694 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.870599    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"
Aug 04 18:29:05.870694 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.870599    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f" event={"ID":"e3d7edee-472c-4938-be20-fc63ddd37c1b","Type":"ContainerDied","Data":"217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a"}
Aug 04 18:29:05.870824 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.870728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f" event={"ID":"e3d7edee-472c-4938-be20-fc63ddd37c1b","Type":"ContainerDied","Data":"b4dbaab7e8d11bdeed9b0eda23f24e57ff32e09df42c12f4b133f7c022d4229a"}
Aug 04 18:29:05.878253 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.878235    2565 scope.go:117] "RemoveContainer" containerID="65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507"
Aug 04 18:29:05.878601 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:29:05.878578    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507\": container with ID starting with 65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507 not found: ID does not exist" containerID="65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507"
Aug 04 18:29:05.878696 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.878606    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507"} err="failed to get container status \"65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507\": rpc error: code = NotFound desc = could not find container \"65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507\": container with ID starting with 65624414a052c2f690674fa08536f73a513cd75ebd4a2d53ef6382bb9c413507 not found: ID does not exist"
Aug 04 18:29:05.878696 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.878624    2565 scope.go:117] "RemoveContainer" containerID="9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050"
Aug 04 18:29:05.887128 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.887112    2565 scope.go:117] "RemoveContainer" containerID="9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050"
Aug 04 18:29:05.887382 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:29:05.887365    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050\": container with ID starting with 9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050 not found: ID does not exist" containerID="9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050"
Aug 04 18:29:05.887421 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.887389    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050"} err="failed to get container status \"9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050\": rpc error: code = NotFound desc = could not find container \"9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050\": container with ID starting with 9288ecb0a4876a5b88a1e01e9d67b8c5983f65a2fece7f646981b277893ee050 not found: ID does not exist"
Aug 04 18:29:05.887421 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.887407    2565 scope.go:117] "RemoveContainer" containerID="217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a"
Aug 04 18:29:05.891843 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.891822    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"]
Aug 04 18:29:05.895432 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.895412    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f0f8ee0-f88787c9b-dzkzv"]
Aug 04 18:29:05.895697 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.895685    2565 scope.go:117] "RemoveContainer" containerID="217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a"
Aug 04 18:29:05.895963 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:29:05.895942    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a\": container with ID starting with 217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a not found: ID does not exist" containerID="217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a"
Aug 04 18:29:05.896016 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.895970    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a"} err="failed to get container status \"217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a\": rpc error: code = NotFound desc = could not find container \"217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a\": container with ID starting with 217d253fd124a282290725b49e17a2de0616c929d30508502179988b2d26c45a not found: ID does not exist"
Aug 04 18:29:05.904536 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.904514    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"]
Aug 04 18:29:05.908041 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.908020    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f0f8ee0-869cc8fcf9-vd5fd"]
Aug 04 18:29:05.917506 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.917479    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"]
Aug 04 18:29:05.919291 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:05.919267    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f0f8ee0-84b7fd7df4-6pk5f"]
Aug 04 18:29:06.065571 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:06.065538    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1280989c-391e-441b-9b24-18eb69d35f67" path="/var/lib/kubelet/pods/1280989c-391e-441b-9b24-18eb69d35f67/volumes"
Aug 04 18:29:06.065972 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:06.065959    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5d56da-ad29-47ca-9b44-c1c3541d9066" path="/var/lib/kubelet/pods/cc5d56da-ad29-47ca-9b44-c1c3541d9066/volumes"
Aug 04 18:29:06.066280 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:06.066268    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d7edee-472c-4938-be20-fc63ddd37c1b" path="/var/lib/kubelet/pods/e3d7edee-472c-4938-be20-fc63ddd37c1b/volumes"
Aug 04 18:29:08.140657 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:08.140625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:13.186031 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:13.185992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:49.632432 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:49.632390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:50.064258 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:50.064228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:55.661718 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:55.661681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:55.759742 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:55.759708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:55.929949 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:55.929861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:29:56.179227 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:29:56.179196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:07.462901 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:07.462862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:07.639851 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:07.639821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:07.732914 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:07.732822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:08.247818 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:08.247776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:08.794435 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:08.794402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:08.894461 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:08.894424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:09.644717 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:09.644677    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:15.605435 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:15.605398    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:15.668700 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:15.668664    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:16.246856 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:16.246803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:21.902565 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:21.902531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:21.960461 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:21.960428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:22.038706 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:22.038660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:22.139243 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:22.139205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:32.573080 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:32.573038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:32.787122 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:32.787085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:53.873577 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:53.873543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:30:59.886048 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:30:59.886011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:01.441633 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:01.441593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:02.898191 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:02.898154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:02.998079 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:02.998045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:04.013486 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.013451    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"]
Aug 04 18:31:04.014153 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014133    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc5d56da-ad29-47ca-9b44-c1c3541d9066" containerName="maas-api"
Aug 04 18:31:04.014289 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014155    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5d56da-ad29-47ca-9b44-c1c3541d9066" containerName="maas-api"
Aug 04 18:31:04.014289 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014170    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1280989c-391e-441b-9b24-18eb69d35f67" containerName="payload-pre-processing"
Aug 04 18:31:04.014289 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014181    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1280989c-391e-441b-9b24-18eb69d35f67" containerName="payload-pre-processing"
Aug 04 18:31:04.014289 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014199    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d7edee-472c-4938-be20-fc63ddd37c1b" containerName="payload-processing"
Aug 04 18:31:04.014289 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014207    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d7edee-472c-4938-be20-fc63ddd37c1b" containerName="payload-processing"
Aug 04 18:31:04.014447 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014309    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc5d56da-ad29-47ca-9b44-c1c3541d9066" containerName="maas-api"
Aug 04 18:31:04.014447 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014323    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d7edee-472c-4938-be20-fc63ddd37c1b" containerName="payload-processing"
Aug 04 18:31:04.014447 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.014333    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1280989c-391e-441b-9b24-18eb69d35f67" containerName="payload-pre-processing"
Aug 04 18:31:04.017618 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.017593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.019755 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.019732    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7e1998-serving-cert\""
Aug 04 18:31:04.025248 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.025221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"]
Aug 04 18:31:04.040694 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.040661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:04.158369 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.158327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b42dj\" (UniqueName: \"kubernetes.io/projected/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-kube-api-access-b42dj\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.158369 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.158375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.158646 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.158496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.259708 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.259672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.259936 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.259863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.260015 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:31:04.259983    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-serving-cert: secret "maas-api-e2e-inf-a-7e1998-serving-cert" not found
Aug 04 18:31:04.260015 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.259984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b42dj\" (UniqueName: \"kubernetes.io/projected/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-kube-api-access-b42dj\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.260114 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:31:04.260052    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls podName:ebaa7a8c-b4f0-4816-9991-4766e09cdf2c nodeName:}" failed. No retries permitted until 2026-08-04 18:31:04.76002753 +0000 UTC m=+2659.135973598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls") pod "maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5" (UID: "ebaa7a8c-b4f0-4816-9991-4766e09cdf2c") : secret "maas-api-e2e-inf-a-7e1998-serving-cert" not found
Aug 04 18:31:04.260442 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.260415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.267689 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.267626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b42dj\" (UniqueName: \"kubernetes.io/projected/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-kube-api-access-b42dj\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.487403 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.487323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:04.649413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.649321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:04.744389 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.744351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:04.745519 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.745495    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"]
Aug 04 18:31:04.749260 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.749242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:04.751793 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.751771    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-7e1998\""
Aug 04 18:31:04.752177 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.752159    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-7e1998-dockercfg-r4777\""
Aug 04 18:31:04.761753 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.761728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"]
Aug 04 18:31:04.764739 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.764710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.767695 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.767669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.783474 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.783438    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"]
Aug 04 18:31:04.787040 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.787019    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:04.796779 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.796749    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"]
Aug 04 18:31:04.865575 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.865539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e3cd2b-f400-4cf3-a115-97abb2d12333-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp\" (UID: \"37e3cd2b-f400-4cf3-a115-97abb2d12333\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:04.865746 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.865607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djjph\" (UniqueName: \"kubernetes.io/projected/37e3cd2b-f400-4cf3-a115-97abb2d12333-kube-api-access-djjph\") pod \"payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp\" (UID: \"37e3cd2b-f400-4cf3-a115-97abb2d12333\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:04.930930 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.930887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:04.967214 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.967173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e3cd2b-f400-4cf3-a115-97abb2d12333-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp\" (UID: \"37e3cd2b-f400-4cf3-a115-97abb2d12333\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:04.967409 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.967269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7vq8\" (UniqueName: \"kubernetes.io/projected/e4381555-8906-405e-b940-38b6f13b4618-kube-api-access-n7vq8\") pod \"payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm\" (UID: \"e4381555-8906-405e-b940-38b6f13b4618\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:04.967409 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.967299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djjph\" (UniqueName: \"kubernetes.io/projected/37e3cd2b-f400-4cf3-a115-97abb2d12333-kube-api-access-djjph\") pod \"payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp\" (UID: \"37e3cd2b-f400-4cf3-a115-97abb2d12333\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:04.967554 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.967420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4381555-8906-405e-b940-38b6f13b4618-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm\" (UID: \"e4381555-8906-405e-b940-38b6f13b4618\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:04.967926 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.967906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e3cd2b-f400-4cf3-a115-97abb2d12333-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp\" (UID: \"37e3cd2b-f400-4cf3-a115-97abb2d12333\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:04.976270 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:04.976222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djjph\" (UniqueName: \"kubernetes.io/projected/37e3cd2b-f400-4cf3-a115-97abb2d12333-kube-api-access-djjph\") pod \"payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp\" (UID: \"37e3cd2b-f400-4cf3-a115-97abb2d12333\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:05.060631 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.060590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:05.068010 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.067984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vq8\" (UniqueName: \"kubernetes.io/projected/e4381555-8906-405e-b940-38b6f13b4618-kube-api-access-n7vq8\") pod \"payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm\" (UID: \"e4381555-8906-405e-b940-38b6f13b4618\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:05.068168 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.068045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4381555-8906-405e-b940-38b6f13b4618-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm\" (UID: \"e4381555-8906-405e-b940-38b6f13b4618\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:05.068674 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.068652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4381555-8906-405e-b940-38b6f13b4618-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm\" (UID: \"e4381555-8906-405e-b940-38b6f13b4618\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:05.082230 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.078324    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"]
Aug 04 18:31:05.082230 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.081687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vq8\" (UniqueName: \"kubernetes.io/projected/e4381555-8906-405e-b940-38b6f13b4618-kube-api-access-n7vq8\") pod \"payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm\" (UID: \"e4381555-8906-405e-b940-38b6f13b4618\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:05.099389 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.099345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:05.257962 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.257929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"]
Aug 04 18:31:05.261006 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:31:05.260966    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4381555_8906_405e_b940_38b6f13b4618.slice/crio-986f622d2853972b5411f326ab833d143b794030a003ecd3c40f14ca72f6291b WatchSource:0}: Error finding container 986f622d2853972b5411f326ab833d143b794030a003ecd3c40f14ca72f6291b: Status 404 returned error can't find the container with id 986f622d2853972b5411f326ab833d143b794030a003ecd3c40f14ca72f6291b
Aug 04 18:31:05.426790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.426764    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"]
Aug 04 18:31:05.428859 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:31:05.428826    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e3cd2b_f400_4cf3_a115_97abb2d12333.slice/crio-595287c718743bf970446a458e3cb241461290960108eb6ef72b7aa121f7c9c0 WatchSource:0}: Error finding container 595287c718743bf970446a458e3cb241461290960108eb6ef72b7aa121f7c9c0: Status 404 returned error can't find the container with id 595287c718743bf970446a458e3cb241461290960108eb6ef72b7aa121f7c9c0
Aug 04 18:31:05.468071 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.468006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm" event={"ID":"e4381555-8906-405e-b940-38b6f13b4618","Type":"ContainerStarted","Data":"9c8ba79fecad1246d6d42d4516af1e8c7d4dc80252688d79f7a0d1e44f7b8345"}
Aug 04 18:31:05.468345 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.468319    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:05.468474 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.468363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm" event={"ID":"e4381555-8906-405e-b940-38b6f13b4618","Type":"ContainerStarted","Data":"986f622d2853972b5411f326ab833d143b794030a003ecd3c40f14ca72f6291b"}
Aug 04 18:31:05.469700 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.469673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5" event={"ID":"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c","Type":"ContainerStarted","Data":"5b745c3121297d558461fca4e37b8fc2fd4b17d8fd8b6001d91d02366aa33bbf"}
Aug 04 18:31:05.471079 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.471042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp" event={"ID":"37e3cd2b-f400-4cf3-a115-97abb2d12333","Type":"ContainerStarted","Data":"595287c718743bf970446a458e3cb241461290960108eb6ef72b7aa121f7c9c0"}
Aug 04 18:31:05.485542 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:05.485480    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm" podStartSLOduration=1.4854619470000001 podStartE2EDuration="1.485461947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:05.483279315 +0000 UTC m=+2659.859225406" watchObservedRunningTime="2026-08-04 18:31:05.485461947 +0000 UTC m=+2659.861408036"
Aug 04 18:31:06.478409 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:06.478354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5" event={"ID":"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c","Type":"ContainerStarted","Data":"4b57256c793d45099507476252439832b6e7c972c54530039ad170bfebbd8b7f"}
Aug 04 18:31:06.478914 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:06.478438    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:06.479959 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:06.479933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp" event={"ID":"37e3cd2b-f400-4cf3-a115-97abb2d12333","Type":"ContainerStarted","Data":"cc7bf9dbfd6a474685ec264b10c583ef9d78cdde293f5f66e8bd8fd0af4ab3a6"}
Aug 04 18:31:06.494273 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:06.494217    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5" podStartSLOduration=3.06224549 podStartE2EDuration="3.494202412s" totalImagesPullingTime="431.956922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:06.49266088 +0000 UTC m=+2660.868607013" watchObservedRunningTime="2026-08-04 18:31:06.494202412 +0000 UTC m=+2660.870148502"
Aug 04 18:31:06.506340 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:06.506271    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp" podStartSLOduration=2.50625234 podStartE2EDuration="2.50625234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:06.505918895 +0000 UTC m=+2660.881865008" watchObservedRunningTime="2026-08-04 18:31:06.50625234 +0000 UTC m=+2660.882198431"
Aug 04 18:31:07.486657 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:07.486625    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:12.492108 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:12.492078    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:31:16.482632 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:16.482596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:31:18.493662 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:18.493626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:31:32.573576 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:32.573542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:33.009296 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:33.009264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:33.465641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:33.465606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:33.643155 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:33.643122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:34.031101 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:34.031071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:36.082179 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:36.082143    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:36.141116 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:36.141086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:37.169157 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.169115    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"]
Aug 04 18:31:37.172927 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.172901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.175431 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.175411    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8ca2e8-serving-cert\""
Aug 04 18:31:37.184887 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.184861    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"]
Aug 04 18:31:37.205530 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.205497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:37.273493 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.273461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgmkk\" (UniqueName: \"kubernetes.io/projected/e7afdb20-b4d4-4f41-974a-6e96d106fdea-kube-api-access-sgmkk\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.273689 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.273650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7afdb20-b4d4-4f41-974a-6e96d106fdea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.273774 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.273753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.374826 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.374775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7afdb20-b4d4-4f41-974a-6e96d106fdea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.375030 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.374862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.375030 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.374905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgmkk\" (UniqueName: \"kubernetes.io/projected/e7afdb20-b4d4-4f41-974a-6e96d106fdea-kube-api-access-sgmkk\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.375030 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:31:37.375003    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-serving-cert: secret "maas-api-e2e-inf-b-8ca2e8-serving-cert" not found
Aug 04 18:31:37.375196 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:31:37.375079    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls podName:e7afdb20-b4d4-4f41-974a-6e96d106fdea nodeName:}" failed. No retries permitted until 2026-08-04 18:31:37.875062746 +0000 UTC m=+2692.251008813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls") pod "maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5" (UID: "e7afdb20-b4d4-4f41-974a-6e96d106fdea") : secret "maas-api-e2e-inf-b-8ca2e8-serving-cert" not found
Aug 04 18:31:37.375494 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.375474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7afdb20-b4d4-4f41-974a-6e96d106fdea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.383620 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.383600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgmkk\" (UniqueName: \"kubernetes.io/projected/e7afdb20-b4d4-4f41-974a-6e96d106fdea-kube-api-access-sgmkk\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.776408 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.776372    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"]
Aug 04 18:31:37.780117 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.780100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:37.782249 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.782231    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-8ca2e8\""
Aug 04 18:31:37.782458 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.782443    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-8ca2e8-dockercfg-q5gx8\""
Aug 04 18:31:37.790615 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.790592    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"]
Aug 04 18:31:37.820054 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.820029    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"]
Aug 04 18:31:37.823990 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.823968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:37.835151 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.835130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"]
Aug 04 18:31:37.880139 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.880108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.880306 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.880157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec392e7-b173-4742-b278-0e25aa4fdda7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz\" (UID: \"2ec392e7-b173-4742-b278-0e25aa4fdda7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:37.880306 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.880225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d84lq\" (UniqueName: \"kubernetes.io/projected/2ec392e7-b173-4742-b278-0e25aa4fdda7-kube-api-access-d84lq\") pod \"payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz\" (UID: \"2ec392e7-b173-4742-b278-0e25aa4fdda7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:37.880435 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.880344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq95w\" (UniqueName: \"kubernetes.io/projected/cf1712dd-e015-4321-9544-2297978fb2bf-kube-api-access-tq95w\") pod \"payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn\" (UID: \"cf1712dd-e015-4321-9544-2297978fb2bf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:37.880435 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.880367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1712dd-e015-4321-9544-2297978fb2bf-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn\" (UID: \"cf1712dd-e015-4321-9544-2297978fb2bf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:37.882711 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.882687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls\") pod \"maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:37.981330 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.981275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq95w\" (UniqueName: \"kubernetes.io/projected/cf1712dd-e015-4321-9544-2297978fb2bf-kube-api-access-tq95w\") pod \"payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn\" (UID: \"cf1712dd-e015-4321-9544-2297978fb2bf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:37.981330 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.981329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1712dd-e015-4321-9544-2297978fb2bf-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn\" (UID: \"cf1712dd-e015-4321-9544-2297978fb2bf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:37.981612 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.981367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec392e7-b173-4742-b278-0e25aa4fdda7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz\" (UID: \"2ec392e7-b173-4742-b278-0e25aa4fdda7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:37.981612 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.981415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d84lq\" (UniqueName: \"kubernetes.io/projected/2ec392e7-b173-4742-b278-0e25aa4fdda7-kube-api-access-d84lq\") pod \"payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz\" (UID: \"2ec392e7-b173-4742-b278-0e25aa4fdda7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:37.982197 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.982174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec392e7-b173-4742-b278-0e25aa4fdda7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz\" (UID: \"2ec392e7-b173-4742-b278-0e25aa4fdda7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:37.982314 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.982288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1712dd-e015-4321-9544-2297978fb2bf-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn\" (UID: \"cf1712dd-e015-4321-9544-2297978fb2bf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:37.988801 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.988772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d84lq\" (UniqueName: \"kubernetes.io/projected/2ec392e7-b173-4742-b278-0e25aa4fdda7-kube-api-access-d84lq\") pod \"payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz\" (UID: \"2ec392e7-b173-4742-b278-0e25aa4fdda7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:37.989057 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:37.989034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq95w\" (UniqueName: \"kubernetes.io/projected/cf1712dd-e015-4321-9544-2297978fb2bf-kube-api-access-tq95w\") pod \"payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn\" (UID: \"cf1712dd-e015-4321-9544-2297978fb2bf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:38.077820 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.077701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:38.085682 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.085658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:38.091771 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.091738    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:38.135551 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.135521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:38.178230 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.178197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:31:38.252508 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.252141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"]
Aug 04 18:31:38.254979 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:31:38.254790    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec392e7_b173_4742_b278_0e25aa4fdda7.slice/crio-a3b20a3273cf82710109656a9ef79457902f987664a2d445e0a92b503ba35d01 WatchSource:0}: Error finding container a3b20a3273cf82710109656a9ef79457902f987664a2d445e0a92b503ba35d01: Status 404 returned error can't find the container with id a3b20a3273cf82710109656a9ef79457902f987664a2d445e0a92b503ba35d01
Aug 04 18:31:38.273969 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.273939    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"]
Aug 04 18:31:38.275279 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:31:38.275121    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7afdb20_b4d4_4f41_974a_6e96d106fdea.slice/crio-d45dfd4556a24a41982d661ebf1226ec7299c58380c3726a92012325a363241d WatchSource:0}: Error finding container d45dfd4556a24a41982d661ebf1226ec7299c58380c3726a92012325a363241d: Status 404 returned error can't find the container with id d45dfd4556a24a41982d661ebf1226ec7299c58380c3726a92012325a363241d
Aug 04 18:31:38.314642 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.314618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"]
Aug 04 18:31:38.317143 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:31:38.317123    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1712dd_e015_4321_9544_2297978fb2bf.slice/crio-a45e476f141371a997771650ae6366c7c21355059d8d53f4e1ed062ebac880a3 WatchSource:0}: Error finding container a45e476f141371a997771650ae6366c7c21355059d8d53f4e1ed062ebac880a3: Status 404 returned error can't find the container with id a45e476f141371a997771650ae6366c7c21355059d8d53f4e1ed062ebac880a3
Aug 04 18:31:38.641393 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.641295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn" event={"ID":"cf1712dd-e015-4321-9544-2297978fb2bf","Type":"ContainerStarted","Data":"16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c"}
Aug 04 18:31:38.641564 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.641468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:38.641564 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.641513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn" event={"ID":"cf1712dd-e015-4321-9544-2297978fb2bf","Type":"ContainerStarted","Data":"a45e476f141371a997771650ae6366c7c21355059d8d53f4e1ed062ebac880a3"}
Aug 04 18:31:38.643072 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.643048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz" event={"ID":"2ec392e7-b173-4742-b278-0e25aa4fdda7","Type":"ContainerStarted","Data":"e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e"}
Aug 04 18:31:38.643218 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.643091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz" event={"ID":"2ec392e7-b173-4742-b278-0e25aa4fdda7","Type":"ContainerStarted","Data":"a3b20a3273cf82710109656a9ef79457902f987664a2d445e0a92b503ba35d01"}
Aug 04 18:31:38.643218 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.643156    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:31:38.644347 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.644318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5" event={"ID":"e7afdb20-b4d4-4f41-974a-6e96d106fdea","Type":"ContainerStarted","Data":"d45dfd4556a24a41982d661ebf1226ec7299c58380c3726a92012325a363241d"}
Aug 04 18:31:38.657258 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.657214    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn" podStartSLOduration=1.657202137 podStartE2EDuration="1.657202137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:38.655195321 +0000 UTC m=+2693.031141414" watchObservedRunningTime="2026-08-04 18:31:38.657202137 +0000 UTC m=+2693.033148227"
Aug 04 18:31:38.672313 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:38.672262    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz" podStartSLOduration=1.672245414 podStartE2EDuration="1.672245414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:38.668926349 +0000 UTC m=+2693.044872443" watchObservedRunningTime="2026-08-04 18:31:38.672245414 +0000 UTC m=+2693.048191507"
Aug 04 18:31:39.651133 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:39.651097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5" event={"ID":"e7afdb20-b4d4-4f41-974a-6e96d106fdea","Type":"ContainerStarted","Data":"47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df"}
Aug 04 18:31:39.651602 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:39.651205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:39.666150 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:39.666100    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5" podStartSLOduration=2.17037848 podStartE2EDuration="2.666080311s" totalImagesPullingTime="495.701831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:31:39.665357874 +0000 UTC m=+2694.041303988" watchObservedRunningTime="2026-08-04 18:31:39.666080311 +0000 UTC m=+2694.042026396"
Aug 04 18:31:45.662213 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:45.662177    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:31:46.243964 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:46.243930    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:31:46.250826 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:46.250789    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:31:46.254014 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:46.253994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:31:46.260033 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:46.260018    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:31:49.653580 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:49.653549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:31:49.654078 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:31:49.653739    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:32:01.076219 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:32:01.076170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:32:17.109427 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:32:17.109380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:32:37.297780 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:32:37.297743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:25.585337 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:25.585225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:26.586525 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:26.586490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:37.067853 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.067798    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"]
Aug 04 18:33:37.068253 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.068042    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5" podUID="ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" containerName="maas-api" containerID="cri-o://4b57256c793d45099507476252439832b6e7c972c54530039ad170bfebbd8b7f" gracePeriod=30
Aug 04 18:33:37.092587 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.092563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:37.114296 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.113410    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"]
Aug 04 18:33:37.114737 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.114682    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm" podUID="e4381555-8906-405e-b940-38b6f13b4618" containerName="payload-processing" containerID="cri-o://9c8ba79fecad1246d6d42d4516af1e8c7d4dc80252688d79f7a0d1e44f7b8345" gracePeriod=30
Aug 04 18:33:37.119054 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.119020    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"]
Aug 04 18:33:37.119307 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.119230    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp" podUID="37e3cd2b-f400-4cf3-a115-97abb2d12333" containerName="payload-pre-processing" containerID="cri-o://cc7bf9dbfd6a474685ec264b10c583ef9d78cdde293f5f66e8bd8fd0af4ab3a6" gracePeriod=30
Aug 04 18:33:37.190607 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.190582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:37.243352 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.243231    2565 generic.go:356] "Generic (PLEG): container finished" podID="ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" containerID="4b57256c793d45099507476252439832b6e7c972c54530039ad170bfebbd8b7f" exitCode=0
Aug 04 18:33:37.243352 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.243263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5" event={"ID":"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c","Type":"ContainerDied","Data":"4b57256c793d45099507476252439832b6e7c972c54530039ad170bfebbd8b7f"}
Aug 04 18:33:37.245203 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.245136    2565 generic.go:356] "Generic (PLEG): container finished" podID="37e3cd2b-f400-4cf3-a115-97abb2d12333" containerID="cc7bf9dbfd6a474685ec264b10c583ef9d78cdde293f5f66e8bd8fd0af4ab3a6" exitCode=0
Aug 04 18:33:37.245326 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.245205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp" event={"ID":"37e3cd2b-f400-4cf3-a115-97abb2d12333","Type":"ContainerDied","Data":"cc7bf9dbfd6a474685ec264b10c583ef9d78cdde293f5f66e8bd8fd0af4ab3a6"}
Aug 04 18:33:37.246988 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.246930    2565 generic.go:356] "Generic (PLEG): container finished" podID="e4381555-8906-405e-b940-38b6f13b4618" containerID="9c8ba79fecad1246d6d42d4516af1e8c7d4dc80252688d79f7a0d1e44f7b8345" exitCode=0
Aug 04 18:33:37.246988 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.246971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm" event={"ID":"e4381555-8906-405e-b940-38b6f13b4618","Type":"ContainerDied","Data":"9c8ba79fecad1246d6d42d4516af1e8c7d4dc80252688d79f7a0d1e44f7b8345"}
Aug 04 18:33:37.277676 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.277382    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:37.427953 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.427929    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:33:37.431256 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.431236    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:33:37.441395 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.441377    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:33:37.505426 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505396    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b42dj\" (UniqueName: \"kubernetes.io/projected/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-kube-api-access-b42dj\") pod \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") "
Aug 04 18:33:37.505603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls\") pod \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") "
Aug 04 18:33:37.505603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e3cd2b-f400-4cf3-a115-97abb2d12333-plugins-config-volume\") pod \"37e3cd2b-f400-4cf3-a115-97abb2d12333\" (UID: \"37e3cd2b-f400-4cf3-a115-97abb2d12333\") "
Aug 04 18:33:37.505603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-openshift-service-ca\") pod \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\" (UID: \"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c\") "
Aug 04 18:33:37.505603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djjph\" (UniqueName: \"kubernetes.io/projected/37e3cd2b-f400-4cf3-a115-97abb2d12333-kube-api-access-djjph\") pod \"37e3cd2b-f400-4cf3-a115-97abb2d12333\" (UID: \"37e3cd2b-f400-4cf3-a115-97abb2d12333\") "
Aug 04 18:33:37.505603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505579    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4381555-8906-405e-b940-38b6f13b4618-plugins-config-volume\") pod \"e4381555-8906-405e-b940-38b6f13b4618\" (UID: \"e4381555-8906-405e-b940-38b6f13b4618\") "
Aug 04 18:33:37.505931 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7vq8\" (UniqueName: \"kubernetes.io/projected/e4381555-8906-405e-b940-38b6f13b4618-kube-api-access-n7vq8\") pod \"e4381555-8906-405e-b940-38b6f13b4618\" (UID: \"e4381555-8906-405e-b940-38b6f13b4618\") "
Aug 04 18:33:37.505931 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505859    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" (UID: "ebaa7a8c-b4f0-4816-9991-4766e09cdf2c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:37.505931 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e3cd2b-f400-4cf3-a115-97abb2d12333-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37e3cd2b-f400-4cf3-a115-97abb2d12333" (UID: "37e3cd2b-f400-4cf3-a115-97abb2d12333"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:37.506087 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.505980    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4381555-8906-405e-b940-38b6f13b4618-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e4381555-8906-405e-b940-38b6f13b4618" (UID: "e4381555-8906-405e-b940-38b6f13b4618"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:37.506087 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.506050    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e3cd2b-f400-4cf3-a115-97abb2d12333-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.506087 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.506069    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.507647 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.507621    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e3cd2b-f400-4cf3-a115-97abb2d12333-kube-api-access-djjph" (OuterVolumeSpecName: "kube-api-access-djjph") pod "37e3cd2b-f400-4cf3-a115-97abb2d12333" (UID: "37e3cd2b-f400-4cf3-a115-97abb2d12333"). InnerVolumeSpecName "kube-api-access-djjph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:37.507734 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.507649    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-kube-api-access-b42dj" (OuterVolumeSpecName: "kube-api-access-b42dj") pod "ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" (UID: "ebaa7a8c-b4f0-4816-9991-4766e09cdf2c"). InnerVolumeSpecName "kube-api-access-b42dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:37.507734 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.507661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" (UID: "ebaa7a8c-b4f0-4816-9991-4766e09cdf2c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:33:37.507734 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.507713    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4381555-8906-405e-b940-38b6f13b4618-kube-api-access-n7vq8" (OuterVolumeSpecName: "kube-api-access-n7vq8") pod "e4381555-8906-405e-b940-38b6f13b4618" (UID: "e4381555-8906-405e-b940-38b6f13b4618"). InnerVolumeSpecName "kube-api-access-n7vq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:37.607254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.607185    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b42dj\" (UniqueName: \"kubernetes.io/projected/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-kube-api-access-b42dj\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.607254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.607211    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.607254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.607221    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djjph\" (UniqueName: \"kubernetes.io/projected/37e3cd2b-f400-4cf3-a115-97abb2d12333-kube-api-access-djjph\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.607254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.607231    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4381555-8906-405e-b940-38b6f13b4618-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.607254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.607240    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7vq8\" (UniqueName: \"kubernetes.io/projected/e4381555-8906-405e-b940-38b6f13b4618-kube-api-access-n7vq8\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:37.649078 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:37.649045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:38.253175 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.253145    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"
Aug 04 18:33:38.253175 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.253170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm" event={"ID":"e4381555-8906-405e-b940-38b6f13b4618","Type":"ContainerDied","Data":"986f622d2853972b5411f326ab833d143b794030a003ecd3c40f14ca72f6291b"}
Aug 04 18:33:38.253683 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.253237    2565 scope.go:117] "RemoveContainer" containerID="9c8ba79fecad1246d6d42d4516af1e8c7d4dc80252688d79f7a0d1e44f7b8345"
Aug 04 18:33:38.254675 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.254648    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"
Aug 04 18:33:38.254760 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.254694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5" event={"ID":"ebaa7a8c-b4f0-4816-9991-4766e09cdf2c","Type":"ContainerDied","Data":"5b745c3121297d558461fca4e37b8fc2fd4b17d8fd8b6001d91d02366aa33bbf"}
Aug 04 18:33:38.256367 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.256345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp" event={"ID":"37e3cd2b-f400-4cf3-a115-97abb2d12333","Type":"ContainerDied","Data":"595287c718743bf970446a458e3cb241461290960108eb6ef72b7aa121f7c9c0"}
Aug 04 18:33:38.256504 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.256363    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"
Aug 04 18:33:38.263311 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.263295    2565 scope.go:117] "RemoveContainer" containerID="4b57256c793d45099507476252439832b6e7c972c54530039ad170bfebbd8b7f"
Aug 04 18:33:38.270930 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.270913    2565 scope.go:117] "RemoveContainer" containerID="cc7bf9dbfd6a474685ec264b10c583ef9d78cdde293f5f66e8bd8fd0af4ab3a6"
Aug 04 18:33:38.282442 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.282421    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"]
Aug 04 18:33:38.284641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.284622    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7e1998-7b9dc888c6-bxrfp"]
Aug 04 18:33:38.291434 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.291413    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"]
Aug 04 18:33:38.296877 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.296849    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7e1998-b7d7c49b6-w5cs5"]
Aug 04 18:33:38.309453 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.309432    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"]
Aug 04 18:33:38.311754 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:38.311735    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7e1998-76b47886d8-j4lnm"]
Aug 04 18:33:40.066497 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:40.066465    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e3cd2b-f400-4cf3-a115-97abb2d12333" path="/var/lib/kubelet/pods/37e3cd2b-f400-4cf3-a115-97abb2d12333/volumes"
Aug 04 18:33:40.066908 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:40.066840    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4381555-8906-405e-b940-38b6f13b4618" path="/var/lib/kubelet/pods/e4381555-8906-405e-b940-38b6f13b4618/volumes"
Aug 04 18:33:40.067190 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:40.067177    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" path="/var/lib/kubelet/pods/ebaa7a8c-b4f0-4816-9991-4766e09cdf2c/volumes"
Aug 04 18:33:43.435991 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:43.435955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:43.538267 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:43.538234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:43.688104 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:43.688024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:43.931848 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:43.931784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:54.399338 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.398465    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"]
Aug 04 18:33:54.399338 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.399129    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5" podUID="e7afdb20-b4d4-4f41-974a-6e96d106fdea" containerName="maas-api" containerID="cri-o://47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df" gracePeriod=30
Aug 04 18:33:54.429073 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.429045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:54.455270 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.455241    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"]
Aug 04 18:33:54.455521 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.455480    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn" podUID="cf1712dd-e015-4321-9544-2297978fb2bf" containerName="payload-processing" containerID="cri-o://16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c" gracePeriod=30
Aug 04 18:33:54.463132 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.462603    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"]
Aug 04 18:33:54.463132 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.462836    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz" podUID="2ec392e7-b173-4742-b278-0e25aa4fdda7" containerName="payload-pre-processing" containerID="cri-o://e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e" gracePeriod=30
Aug 04 18:33:54.528097 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.528072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:54.594277 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.594247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:54.731127 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.731100    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:33:54.750653 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.750628    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:33:54.766061 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.766025    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1712dd-e015-4321-9544-2297978fb2bf-plugins-config-volume\") pod \"cf1712dd-e015-4321-9544-2297978fb2bf\" (UID: \"cf1712dd-e015-4321-9544-2297978fb2bf\") "
Aug 04 18:33:54.766192 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.766088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls\") pod \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") "
Aug 04 18:33:54.766192 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.766161    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7afdb20-b4d4-4f41-974a-6e96d106fdea-openshift-service-ca\") pod \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") "
Aug 04 18:33:54.766302 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.766215    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgmkk\" (UniqueName: \"kubernetes.io/projected/e7afdb20-b4d4-4f41-974a-6e96d106fdea-kube-api-access-sgmkk\") pod \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\" (UID: \"e7afdb20-b4d4-4f41-974a-6e96d106fdea\") "
Aug 04 18:33:54.766302 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.766244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq95w\" (UniqueName: \"kubernetes.io/projected/cf1712dd-e015-4321-9544-2297978fb2bf-kube-api-access-tq95w\") pod \"cf1712dd-e015-4321-9544-2297978fb2bf\" (UID: \"cf1712dd-e015-4321-9544-2297978fb2bf\") "
Aug 04 18:33:54.766610 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.766516    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1712dd-e015-4321-9544-2297978fb2bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf1712dd-e015-4321-9544-2297978fb2bf" (UID: "cf1712dd-e015-4321-9544-2297978fb2bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:54.766959 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.766934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7afdb20-b4d4-4f41-974a-6e96d106fdea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7afdb20-b4d4-4f41-974a-6e96d106fdea" (UID: "e7afdb20-b4d4-4f41-974a-6e96d106fdea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:54.767641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.767606    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1712dd-e015-4321-9544-2297978fb2bf-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:54.767641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.767631    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7afdb20-b4d4-4f41-974a-6e96d106fdea-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:54.770831 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.770774    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7afdb20-b4d4-4f41-974a-6e96d106fdea-kube-api-access-sgmkk" (OuterVolumeSpecName: "kube-api-access-sgmkk") pod "e7afdb20-b4d4-4f41-974a-6e96d106fdea" (UID: "e7afdb20-b4d4-4f41-974a-6e96d106fdea"). InnerVolumeSpecName "kube-api-access-sgmkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:54.771433 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.771397    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1712dd-e015-4321-9544-2297978fb2bf-kube-api-access-tq95w" (OuterVolumeSpecName: "kube-api-access-tq95w") pod "cf1712dd-e015-4321-9544-2297978fb2bf" (UID: "cf1712dd-e015-4321-9544-2297978fb2bf"). InnerVolumeSpecName "kube-api-access-tq95w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:54.773058 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.773032    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7afdb20-b4d4-4f41-974a-6e96d106fdea" (UID: "e7afdb20-b4d4-4f41-974a-6e96d106fdea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:33:54.776298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.776275    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:33:54.868298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.868270    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec392e7-b173-4742-b278-0e25aa4fdda7-plugins-config-volume\") pod \"2ec392e7-b173-4742-b278-0e25aa4fdda7\" (UID: \"2ec392e7-b173-4742-b278-0e25aa4fdda7\") "
Aug 04 18:33:54.868435 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.868324    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d84lq\" (UniqueName: \"kubernetes.io/projected/2ec392e7-b173-4742-b278-0e25aa4fdda7-kube-api-access-d84lq\") pod \"2ec392e7-b173-4742-b278-0e25aa4fdda7\" (UID: \"2ec392e7-b173-4742-b278-0e25aa4fdda7\") "
Aug 04 18:33:54.868610 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.868588    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec392e7-b173-4742-b278-0e25aa4fdda7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ec392e7-b173-4742-b278-0e25aa4fdda7" (UID: "2ec392e7-b173-4742-b278-0e25aa4fdda7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:54.868662 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.868599    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7afdb20-b4d4-4f41-974a-6e96d106fdea-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:54.868662 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.868633    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgmkk\" (UniqueName: \"kubernetes.io/projected/e7afdb20-b4d4-4f41-974a-6e96d106fdea-kube-api-access-sgmkk\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:54.868662 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.868645    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq95w\" (UniqueName: \"kubernetes.io/projected/cf1712dd-e015-4321-9544-2297978fb2bf-kube-api-access-tq95w\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:54.870284 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.870265    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec392e7-b173-4742-b278-0e25aa4fdda7-kube-api-access-d84lq" (OuterVolumeSpecName: "kube-api-access-d84lq") pod "2ec392e7-b173-4742-b278-0e25aa4fdda7" (UID: "2ec392e7-b173-4742-b278-0e25aa4fdda7"). InnerVolumeSpecName "kube-api-access-d84lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:33:54.954613 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.954520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:33:54.969877 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.969854    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec392e7-b173-4742-b278-0e25aa4fdda7-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:54.969877 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:54.969877    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d84lq\" (UniqueName: \"kubernetes.io/projected/2ec392e7-b173-4742-b278-0e25aa4fdda7-kube-api-access-d84lq\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:33:55.343931 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.343842    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf1712dd-e015-4321-9544-2297978fb2bf" containerID="16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c" exitCode=0
Aug 04 18:33:55.344072 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.343928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn" event={"ID":"cf1712dd-e015-4321-9544-2297978fb2bf","Type":"ContainerDied","Data":"16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c"}
Aug 04 18:33:55.344072 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.344002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn" event={"ID":"cf1712dd-e015-4321-9544-2297978fb2bf","Type":"ContainerDied","Data":"a45e476f141371a997771650ae6366c7c21355059d8d53f4e1ed062ebac880a3"}
Aug 04 18:33:55.344072 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.343949    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"
Aug 04 18:33:55.344072 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.344037    2565 scope.go:117] "RemoveContainer" containerID="16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c"
Aug 04 18:33:55.345317 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.345297    2565 generic.go:356] "Generic (PLEG): container finished" podID="2ec392e7-b173-4742-b278-0e25aa4fdda7" containerID="e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e" exitCode=0
Aug 04 18:33:55.345405 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.345338    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"
Aug 04 18:33:55.345405 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.345359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz" event={"ID":"2ec392e7-b173-4742-b278-0e25aa4fdda7","Type":"ContainerDied","Data":"e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e"}
Aug 04 18:33:55.345523 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.345405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz" event={"ID":"2ec392e7-b173-4742-b278-0e25aa4fdda7","Type":"ContainerDied","Data":"a3b20a3273cf82710109656a9ef79457902f987664a2d445e0a92b503ba35d01"}
Aug 04 18:33:55.346880 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.346853    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7afdb20-b4d4-4f41-974a-6e96d106fdea" containerID="47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df" exitCode=0
Aug 04 18:33:55.347007 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.346901    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"
Aug 04 18:33:55.347007 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.346934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5" event={"ID":"e7afdb20-b4d4-4f41-974a-6e96d106fdea","Type":"ContainerDied","Data":"47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df"}
Aug 04 18:33:55.347007 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.346979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5" event={"ID":"e7afdb20-b4d4-4f41-974a-6e96d106fdea","Type":"ContainerDied","Data":"d45dfd4556a24a41982d661ebf1226ec7299c58380c3726a92012325a363241d"}
Aug 04 18:33:55.354354 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.354323    2565 scope.go:117] "RemoveContainer" containerID="16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c"
Aug 04 18:33:55.354668 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:33:55.354645    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c\": container with ID starting with 16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c not found: ID does not exist" containerID="16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c"
Aug 04 18:33:55.354761 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.354674    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c"} err="failed to get container status \"16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c\": rpc error: code = NotFound desc = could not find container \"16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c\": container with ID starting with 16dafe592721f0609fe55986bd695c04f1b67bca9bc5dddcb705693f20eb641c not found: ID does not exist"
Aug 04 18:33:55.354761 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.354691    2565 scope.go:117] "RemoveContainer" containerID="e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e"
Aug 04 18:33:55.363654 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.363638    2565 scope.go:117] "RemoveContainer" containerID="e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e"
Aug 04 18:33:55.364016 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:33:55.363988    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e\": container with ID starting with e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e not found: ID does not exist" containerID="e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e"
Aug 04 18:33:55.364111 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.364014    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e"} err="failed to get container status \"e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e\": rpc error: code = NotFound desc = could not find container \"e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e\": container with ID starting with e409aceb098740ca7162fa3c109977a659acd6813dc644240bc6337248a0780e not found: ID does not exist"
Aug 04 18:33:55.364111 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.364038    2565 scope.go:117] "RemoveContainer" containerID="47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df"
Aug 04 18:33:55.367591 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.367567    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"]
Aug 04 18:33:55.369479 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.369461    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ca2e8-75966f6d8b-997xn"]
Aug 04 18:33:55.372573 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.372553    2565 scope.go:117] "RemoveContainer" containerID="47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df"
Aug 04 18:33:55.372851 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:33:55.372830    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df\": container with ID starting with 47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df not found: ID does not exist" containerID="47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df"
Aug 04 18:33:55.372945 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.372856    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df"} err="failed to get container status \"47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df\": rpc error: code = NotFound desc = could not find container \"47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df\": container with ID starting with 47dbe6d9a925f16dad4032b5031bf0ea04d0bf8787e9802be81d3ccc2f2c39df not found: ID does not exist"
Aug 04 18:33:55.379567 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.379544    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"]
Aug 04 18:33:55.383136 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.383118    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ca2e8-69b8b44f4f-whkc5"]
Aug 04 18:33:55.392409 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.392390    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"]
Aug 04 18:33:55.398029 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:55.398010    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ca2e8-5c6d484c8d-tcjsz"]
Aug 04 18:33:56.071660 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:56.071628    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec392e7-b173-4742-b278-0e25aa4fdda7" path="/var/lib/kubelet/pods/2ec392e7-b173-4742-b278-0e25aa4fdda7/volumes"
Aug 04 18:33:56.072161 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:56.072145    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1712dd-e015-4321-9544-2297978fb2bf" path="/var/lib/kubelet/pods/cf1712dd-e015-4321-9544-2297978fb2bf/volumes"
Aug 04 18:33:56.072506 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:33:56.072494    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7afdb20-b4d4-4f41-974a-6e96d106fdea" path="/var/lib/kubelet/pods/e7afdb20-b4d4-4f41-974a-6e96d106fdea/volumes"
Aug 04 18:34:00.868735 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:00.868702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:00.932801 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:00.932751    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:01.179612 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:01.179579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:01.383441 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:01.383407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:01.693234 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:01.693207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:01.980261 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:01.980174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:02.170957 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:02.170930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:04.750781 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:04.750707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:04.851060 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:04.851027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:05.850634 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.850600    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"]
Aug 04 18:34:05.851203 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851188    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e3cd2b-f400-4cf3-a115-97abb2d12333" containerName="payload-pre-processing"
Aug 04 18:34:05.851250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851207    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e3cd2b-f400-4cf3-a115-97abb2d12333" containerName="payload-pre-processing"
Aug 04 18:34:05.851250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851224    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" containerName="maas-api"
Aug 04 18:34:05.851250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851232    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" containerName="maas-api"
Aug 04 18:34:05.851250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851245    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1712dd-e015-4321-9544-2297978fb2bf" containerName="payload-processing"
Aug 04 18:34:05.851379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851254    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1712dd-e015-4321-9544-2297978fb2bf" containerName="payload-processing"
Aug 04 18:34:05.851379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851290    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec392e7-b173-4742-b278-0e25aa4fdda7" containerName="payload-pre-processing"
Aug 04 18:34:05.851379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851298    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec392e7-b173-4742-b278-0e25aa4fdda7" containerName="payload-pre-processing"
Aug 04 18:34:05.851379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851309    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7afdb20-b4d4-4f41-974a-6e96d106fdea" containerName="maas-api"
Aug 04 18:34:05.851379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851317    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7afdb20-b4d4-4f41-974a-6e96d106fdea" containerName="maas-api"
Aug 04 18:34:05.851379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851329    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4381555-8906-405e-b940-38b6f13b4618" containerName="payload-processing"
Aug 04 18:34:05.851379 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851337    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4381555-8906-405e-b940-38b6f13b4618" containerName="payload-processing"
Aug 04 18:34:05.851593 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851417    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec392e7-b173-4742-b278-0e25aa4fdda7" containerName="payload-pre-processing"
Aug 04 18:34:05.851593 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851430    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebaa7a8c-b4f0-4816-9991-4766e09cdf2c" containerName="maas-api"
Aug 04 18:34:05.851593 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851439    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1712dd-e015-4321-9544-2297978fb2bf" containerName="payload-processing"
Aug 04 18:34:05.851593 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851452    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e3cd2b-f400-4cf3-a115-97abb2d12333" containerName="payload-pre-processing"
Aug 04 18:34:05.851593 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851461    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4381555-8906-405e-b940-38b6f13b4618" containerName="payload-processing"
Aug 04 18:34:05.851593 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.851470    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7afdb20-b4d4-4f41-974a-6e96d106fdea" containerName="maas-api"
Aug 04 18:34:05.854541 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.854523    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:05.856717 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.856697    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-16b81f-serving-cert\""
Aug 04 18:34:05.864320 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.864291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"]
Aug 04 18:34:05.881526 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.881492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:05.973060 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.973007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5vpp\" (UniqueName: \"kubernetes.io/projected/d511e9b2-338f-4088-97d1-f45161246ec5-kube-api-access-s5vpp\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:05.973226 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.973079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d511e9b2-338f-4088-97d1-f45161246ec5-maas-api-tls\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:05.973226 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:05.973131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d511e9b2-338f-4088-97d1-f45161246ec5-openshift-service-ca\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:06.074425 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.074381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d511e9b2-338f-4088-97d1-f45161246ec5-openshift-service-ca\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:06.074585 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.074484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vpp\" (UniqueName: \"kubernetes.io/projected/d511e9b2-338f-4088-97d1-f45161246ec5-kube-api-access-s5vpp\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:06.074585 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.074520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d511e9b2-338f-4088-97d1-f45161246ec5-maas-api-tls\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:06.075204 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.075177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d511e9b2-338f-4088-97d1-f45161246ec5-openshift-service-ca\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:06.077129 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.077108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d511e9b2-338f-4088-97d1-f45161246ec5-maas-api-tls\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:06.082304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.082280    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5vpp\" (UniqueName: \"kubernetes.io/projected/d511e9b2-338f-4088-97d1-f45161246ec5-kube-api-access-s5vpp\") pod \"maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:06.114245 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.114159    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:06.168696 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.168667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:06.299721 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.299695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"]
Aug 04 18:34:06.304596 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:34:06.304552    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd511e9b2_338f_4088_97d1_f45161246ec5.slice/crio-75584c8f46453cb372312642aaa4399218ec86d1de91c91ec07a5b71d669b947 WatchSource:0}: Error finding container 75584c8f46453cb372312642aaa4399218ec86d1de91c91ec07a5b71d669b947: Status 404 returned error can't find the container with id 75584c8f46453cb372312642aaa4399218ec86d1de91c91ec07a5b71d669b947
Aug 04 18:34:06.305644 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.305624    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:34:06.407324 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.407291    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7" event={"ID":"d511e9b2-338f-4088-97d1-f45161246ec5","Type":"ContainerStarted","Data":"75584c8f46453cb372312642aaa4399218ec86d1de91c91ec07a5b71d669b947"}
Aug 04 18:34:06.465754 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.465722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:06.564984 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.564946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:06.571933 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.571908    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"]
Aug 04 18:34:06.576629 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.576607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:06.579160 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.579139    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-16b81f-dockercfg-w9r94\""
Aug 04 18:34:06.579426 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.579407    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-16b81f\""
Aug 04 18:34:06.590524 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.590504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"]
Aug 04 18:34:06.611549 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.611524    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"]
Aug 04 18:34:06.616199 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.616178    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:06.622878 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.622857    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"]
Aug 04 18:34:06.680980 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.680896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr\" (UID: \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:06.681126 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.680982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbg9p\" (UniqueName: \"kubernetes.io/projected/0ccd45df-bf29-4b53-b0d8-586d734ff605-kube-api-access-xbg9p\") pod \"payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw\" (UID: \"0ccd45df-bf29-4b53-b0d8-586d734ff605\") " pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:06.681126 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.681014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4mw5\" (UniqueName: \"kubernetes.io/projected/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-kube-api-access-h4mw5\") pod \"payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr\" (UID: \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:06.681126 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.681053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ccd45df-bf29-4b53-b0d8-586d734ff605-plugins-config-volume\") pod \"payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw\" (UID: \"0ccd45df-bf29-4b53-b0d8-586d734ff605\") " pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:06.781517 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.781492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbg9p\" (UniqueName: \"kubernetes.io/projected/0ccd45df-bf29-4b53-b0d8-586d734ff605-kube-api-access-xbg9p\") pod \"payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw\" (UID: \"0ccd45df-bf29-4b53-b0d8-586d734ff605\") " pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:06.781820 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.781544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4mw5\" (UniqueName: \"kubernetes.io/projected/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-kube-api-access-h4mw5\") pod \"payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr\" (UID: \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:06.781820 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.781592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ccd45df-bf29-4b53-b0d8-586d734ff605-plugins-config-volume\") pod \"payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw\" (UID: \"0ccd45df-bf29-4b53-b0d8-586d734ff605\") " pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:06.781820 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.781640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr\" (UID: \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:06.782554 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.782473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ccd45df-bf29-4b53-b0d8-586d734ff605-plugins-config-volume\") pod \"payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw\" (UID: \"0ccd45df-bf29-4b53-b0d8-586d734ff605\") " pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:06.782554 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.782496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr\" (UID: \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:06.793946 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.793920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbg9p\" (UniqueName: \"kubernetes.io/projected/0ccd45df-bf29-4b53-b0d8-586d734ff605-kube-api-access-xbg9p\") pod \"payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw\" (UID: \"0ccd45df-bf29-4b53-b0d8-586d734ff605\") " pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:06.795022 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.795000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4mw5\" (UniqueName: \"kubernetes.io/projected/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-kube-api-access-h4mw5\") pod \"payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr\" (UID: \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:06.890409 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.890376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:06.929545 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:06.929282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:07.038979 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.038949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"]
Aug 04 18:34:07.040876 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:34:07.040847    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30176cdd_c704_4d5c_b613_bc0bd9a3aab8.slice/crio-9baf48009855f3fc2312e03b455707dc284b7a724ad777f9a9ceb52330261773 WatchSource:0}: Error finding container 9baf48009855f3fc2312e03b455707dc284b7a724ad777f9a9ceb52330261773: Status 404 returned error can't find the container with id 9baf48009855f3fc2312e03b455707dc284b7a724ad777f9a9ceb52330261773
Aug 04 18:34:07.083396 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.083360    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"]
Aug 04 18:34:07.086923 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:34:07.086880    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ccd45df_bf29_4b53_b0d8_586d734ff605.slice/crio-3d9e53d5dc914796d80ab3bf34849be53f43103311e4f33442f165a4665d4ac9 WatchSource:0}: Error finding container 3d9e53d5dc914796d80ab3bf34849be53f43103311e4f33442f165a4665d4ac9: Status 404 returned error can't find the container with id 3d9e53d5dc914796d80ab3bf34849be53f43103311e4f33442f165a4665d4ac9
Aug 04 18:34:07.414226 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.414187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw" event={"ID":"0ccd45df-bf29-4b53-b0d8-586d734ff605","Type":"ContainerStarted","Data":"0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6"}
Aug 04 18:34:07.414424 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.414276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw" event={"ID":"0ccd45df-bf29-4b53-b0d8-586d734ff605","Type":"ContainerStarted","Data":"3d9e53d5dc914796d80ab3bf34849be53f43103311e4f33442f165a4665d4ac9"}
Aug 04 18:34:07.414424 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.414308    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:07.415721 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.415699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7" event={"ID":"d511e9b2-338f-4088-97d1-f45161246ec5","Type":"ContainerStarted","Data":"1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229"}
Aug 04 18:34:07.415856 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.415751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:07.417282 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.417247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr" event={"ID":"30176cdd-c704-4d5c-b613-bc0bd9a3aab8","Type":"ContainerStarted","Data":"8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf"}
Aug 04 18:34:07.417398 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.417288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr" event={"ID":"30176cdd-c704-4d5c-b613-bc0bd9a3aab8","Type":"ContainerStarted","Data":"9baf48009855f3fc2312e03b455707dc284b7a724ad777f9a9ceb52330261773"}
Aug 04 18:34:07.417398 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.417383    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:07.430963 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.430925    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw" podStartSLOduration=1.430911988 podStartE2EDuration="1.430911988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:07.428868583 +0000 UTC m=+2841.804814674" watchObservedRunningTime="2026-08-04 18:34:07.430911988 +0000 UTC m=+2841.806858056"
Aug 04 18:34:07.443507 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.443462    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7" podStartSLOduration=2.03461563 podStartE2EDuration="2.443446216s" totalImagesPullingTime="408.830586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:07.443034664 +0000 UTC m=+2841.818980782" watchObservedRunningTime="2026-08-04 18:34:07.443446216 +0000 UTC m=+2841.819392307"
Aug 04 18:34:07.457351 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:07.457307    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr" podStartSLOduration=1.457295987 podStartE2EDuration="1.457295987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:07.455672772 +0000 UTC m=+2841.831618866" watchObservedRunningTime="2026-08-04 18:34:07.457295987 +0000 UTC m=+2841.833242077"
Aug 04 18:34:13.427419 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:13.427392    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:34:18.423996 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:18.423965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:34:18.424431 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:18.424261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:34:29.714679 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:29.714642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:30.170674 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:30.170634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:30.488440 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:30.488342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:30.962144 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:30.962110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:32.895213 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:32.895161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:32.994300 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:32.994260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:33.778244 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:33.778200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:33.981097 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:33.981068    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"]
Aug 04 18:34:33.985230 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:33.985206    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:33.987804 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:33.987779    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-95cf1a-serving-cert\""
Aug 04 18:34:33.997768 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:33.997747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"]
Aug 04 18:34:34.021091 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.021066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:34.030501 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.030433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5skcx\" (UniqueName: \"kubernetes.io/projected/3f8ec9f9-3fb8-42b4-8156-c026d030244e-kube-api-access-5skcx\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.030601 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.030584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.030646 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.030614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8ec9f9-3fb8-42b4-8156-c026d030244e-openshift-service-ca\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.131390 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.131357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8ec9f9-3fb8-42b4-8156-c026d030244e-openshift-service-ca\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.131562 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.131416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5skcx\" (UniqueName: \"kubernetes.io/projected/3f8ec9f9-3fb8-42b4-8156-c026d030244e-kube-api-access-5skcx\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.131668 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.131648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.131900 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:34:34.131879    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-serving-cert: secret "maas-api-e2e-api-b-95cf1a-serving-cert" not found
Aug 04 18:34:34.131979 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:34:34.131967    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls podName:3f8ec9f9-3fb8-42b4-8156-c026d030244e nodeName:}" failed. No retries permitted until 2026-08-04 18:34:34.63194458 +0000 UTC m=+2869.007890655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls") pod "maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp" (UID: "3f8ec9f9-3fb8-42b4-8156-c026d030244e") : secret "maas-api-e2e-api-b-95cf1a-serving-cert" not found
Aug 04 18:34:34.132209 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.132192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8ec9f9-3fb8-42b4-8156-c026d030244e-openshift-service-ca\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.144283 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.144260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5skcx\" (UniqueName: \"kubernetes.io/projected/3f8ec9f9-3fb8-42b4-8156-c026d030244e-kube-api-access-5skcx\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.177760 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.177718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:34.490429 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.490400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:34.591336 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.591298    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"]
Aug 04 18:34:34.592937 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.592907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:34.595186 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.595167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:34.597214 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.597192    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-95cf1a\""
Aug 04 18:34:34.597214 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.597200    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-95cf1a-dockercfg-pfspz\""
Aug 04 18:34:34.605827 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.605791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"]
Aug 04 18:34:34.635044 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.635017    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"]
Aug 04 18:34:34.636685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.636657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f75z\" (UniqueName: \"kubernetes.io/projected/34110968-4c1c-4867-bb0c-628cbb7b5f5d-kube-api-access-9f75z\") pod \"payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk\" (UID: \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:34.636777 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.636719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.636777 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.636762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34110968-4c1c-4867-bb0c-628cbb7b5f5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk\" (UID: \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:34.638574 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.638558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:34.639061 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.639043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls\") pod \"maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.649043 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.649011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"]
Aug 04 18:34:34.737432 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.737403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6292e395-5984-4de3-a71f-373cb7002fbe-plugins-config-volume\") pod \"payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h\" (UID: \"6292e395-5984-4de3-a71f-373cb7002fbe\") " pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:34.737604 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.737462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f75z\" (UniqueName: \"kubernetes.io/projected/34110968-4c1c-4867-bb0c-628cbb7b5f5d-kube-api-access-9f75z\") pod \"payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk\" (UID: \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:34.737604 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.737514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzftt\" (UniqueName: \"kubernetes.io/projected/6292e395-5984-4de3-a71f-373cb7002fbe-kube-api-access-bzftt\") pod \"payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h\" (UID: \"6292e395-5984-4de3-a71f-373cb7002fbe\") " pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:34.737604 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.737568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34110968-4c1c-4867-bb0c-628cbb7b5f5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk\" (UID: \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:34.738250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.738234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34110968-4c1c-4867-bb0c-628cbb7b5f5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk\" (UID: \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:34.744508 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.744458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f75z\" (UniqueName: \"kubernetes.io/projected/34110968-4c1c-4867-bb0c-628cbb7b5f5d-kube-api-access-9f75z\") pod \"payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk\" (UID: \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:34.838652 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.838625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzftt\" (UniqueName: \"kubernetes.io/projected/6292e395-5984-4de3-a71f-373cb7002fbe-kube-api-access-bzftt\") pod \"payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h\" (UID: \"6292e395-5984-4de3-a71f-373cb7002fbe\") " pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:34.838794 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.838701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6292e395-5984-4de3-a71f-373cb7002fbe-plugins-config-volume\") pod \"payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h\" (UID: \"6292e395-5984-4de3-a71f-373cb7002fbe\") " pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:34.839315 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.839297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6292e395-5984-4de3-a71f-373cb7002fbe-plugins-config-volume\") pod \"payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h\" (UID: \"6292e395-5984-4de3-a71f-373cb7002fbe\") " pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:34.846609 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.846585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzftt\" (UniqueName: \"kubernetes.io/projected/6292e395-5984-4de3-a71f-373cb7002fbe-kube-api-access-bzftt\") pod \"payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h\" (UID: \"6292e395-5984-4de3-a71f-373cb7002fbe\") " pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:34.900104 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.900075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:34.906989 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.906966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:34.960736 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:34.960692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:35.067718 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.067665    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"]
Aug 04 18:34:35.070735 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:34:35.070709    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8ec9f9_3fb8_42b4_8156_c026d030244e.slice/crio-af740902acaf1db759920469fba2ff2f8a4975a670c96f30e37bb0d7fd4c8680 WatchSource:0}: Error finding container af740902acaf1db759920469fba2ff2f8a4975a670c96f30e37bb0d7fd4c8680: Status 404 returned error can't find the container with id af740902acaf1db759920469fba2ff2f8a4975a670c96f30e37bb0d7fd4c8680
Aug 04 18:34:35.130506 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.130477    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"]
Aug 04 18:34:35.131721 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:34:35.131697    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6292e395_5984_4de3_a71f_373cb7002fbe.slice/crio-130c0880e92f616c06f2aaf702ec72853bce144bc098356373fc3dbdd32920d7 WatchSource:0}: Error finding container 130c0880e92f616c06f2aaf702ec72853bce144bc098356373fc3dbdd32920d7: Status 404 returned error can't find the container with id 130c0880e92f616c06f2aaf702ec72853bce144bc098356373fc3dbdd32920d7
Aug 04 18:34:35.290966 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.290646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"]
Aug 04 18:34:35.292461 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:34:35.292419    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34110968_4c1c_4867_bb0c_628cbb7b5f5d.slice/crio-63a7bb73b6b41db8306bae5542bb902fa507f993f3c750c48ba488077ec44df8 WatchSource:0}: Error finding container 63a7bb73b6b41db8306bae5542bb902fa507f993f3c750c48ba488077ec44df8: Status 404 returned error can't find the container with id 63a7bb73b6b41db8306bae5542bb902fa507f993f3c750c48ba488077ec44df8
Aug 04 18:34:35.562620 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.562526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h" event={"ID":"6292e395-5984-4de3-a71f-373cb7002fbe","Type":"ContainerStarted","Data":"621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e"}
Aug 04 18:34:35.562620 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.562600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h" event={"ID":"6292e395-5984-4de3-a71f-373cb7002fbe","Type":"ContainerStarted","Data":"130c0880e92f616c06f2aaf702ec72853bce144bc098356373fc3dbdd32920d7"}
Aug 04 18:34:35.562852 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.562634    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:35.564080 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.564043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk" event={"ID":"34110968-4c1c-4867-bb0c-628cbb7b5f5d","Type":"ContainerStarted","Data":"624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3"}
Aug 04 18:34:35.564201 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.564088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk" event={"ID":"34110968-4c1c-4867-bb0c-628cbb7b5f5d","Type":"ContainerStarted","Data":"63a7bb73b6b41db8306bae5542bb902fa507f993f3c750c48ba488077ec44df8"}
Aug 04 18:34:35.564201 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.564109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:35.565629 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.565601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp" event={"ID":"3f8ec9f9-3fb8-42b4-8156-c026d030244e","Type":"ContainerStarted","Data":"f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403"}
Aug 04 18:34:35.565739 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.565647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp" event={"ID":"3f8ec9f9-3fb8-42b4-8156-c026d030244e","Type":"ContainerStarted","Data":"af740902acaf1db759920469fba2ff2f8a4975a670c96f30e37bb0d7fd4c8680"}
Aug 04 18:34:35.565793 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.565761    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:35.582348 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.582296    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h" podStartSLOduration=1.582273823 podStartE2EDuration="1.582273823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:35.58117967 +0000 UTC m=+2869.957125761" watchObservedRunningTime="2026-08-04 18:34:35.582273823 +0000 UTC m=+2869.958219913"
Aug 04 18:34:35.597383 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.597339    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk" podStartSLOduration=1.597325353 podStartE2EDuration="1.597325353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:35.595913321 +0000 UTC m=+2869.971859413" watchObservedRunningTime="2026-08-04 18:34:35.597325353 +0000 UTC m=+2869.973271443"
Aug 04 18:34:35.614552 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:35.614507    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp" podStartSLOduration=2.313225448 podStartE2EDuration="2.614488336s" totalImagesPullingTime="301.262888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:35.611229154 +0000 UTC m=+2869.987175243" watchObservedRunningTime="2026-08-04 18:34:35.614488336 +0000 UTC m=+2869.990434427"
Aug 04 18:34:41.576191 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:41.576158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:34:46.572879 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:46.572840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:34:46.573254 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:46.573088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:34:57.893458 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:57.893425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:34:59.838890 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:34:59.838854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:16.093649 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.093612    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"]
Aug 04 18:35:16.096725 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.093892    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7" podUID="d511e9b2-338f-4088-97d1-f45161246ec5" containerName="maas-api" containerID="cri-o://1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229" gracePeriod=30
Aug 04 18:35:16.123521 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.123487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:16.151948 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.151917    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"]
Aug 04 18:35:16.152122 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.152100    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw" podUID="0ccd45df-bf29-4b53-b0d8-586d734ff605" containerName="payload-processing" containerID="cri-o://0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6" gracePeriod=30
Aug 04 18:35:16.159965 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.159943    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"]
Aug 04 18:35:16.160204 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.160181    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr" podUID="30176cdd-c704-4d5c-b613-bc0bd9a3aab8" containerName="payload-pre-processing" containerID="cri-o://8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf" gracePeriod=30
Aug 04 18:35:16.194798 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.194764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:16.254274 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.254247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:16.355112 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.354992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:16.417765 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.417740    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:35:16.459577 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.459555    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:35:16.464913 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.464894    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:35:16.609878 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.609777    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d511e9b2-338f-4088-97d1-f45161246ec5-openshift-service-ca\") pod \"d511e9b2-338f-4088-97d1-f45161246ec5\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") "
Aug 04 18:35:16.609878 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.609868    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5vpp\" (UniqueName: \"kubernetes.io/projected/d511e9b2-338f-4088-97d1-f45161246ec5-kube-api-access-s5vpp\") pod \"d511e9b2-338f-4088-97d1-f45161246ec5\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") "
Aug 04 18:35:16.610097 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.609918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-plugins-config-volume\") pod \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\" (UID: \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\") "
Aug 04 18:35:16.610097 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.609941    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4mw5\" (UniqueName: \"kubernetes.io/projected/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-kube-api-access-h4mw5\") pod \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\" (UID: \"30176cdd-c704-4d5c-b613-bc0bd9a3aab8\") "
Aug 04 18:35:16.610097 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbg9p\" (UniqueName: \"kubernetes.io/projected/0ccd45df-bf29-4b53-b0d8-586d734ff605-kube-api-access-xbg9p\") pod \"0ccd45df-bf29-4b53-b0d8-586d734ff605\" (UID: \"0ccd45df-bf29-4b53-b0d8-586d734ff605\") "
Aug 04 18:35:16.610271 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610162    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d511e9b2-338f-4088-97d1-f45161246ec5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d511e9b2-338f-4088-97d1-f45161246ec5" (UID: "d511e9b2-338f-4088-97d1-f45161246ec5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:16.610271 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610166    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ccd45df-bf29-4b53-b0d8-586d734ff605-plugins-config-volume\") pod \"0ccd45df-bf29-4b53-b0d8-586d734ff605\" (UID: \"0ccd45df-bf29-4b53-b0d8-586d734ff605\") "
Aug 04 18:35:16.610271 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d511e9b2-338f-4088-97d1-f45161246ec5-maas-api-tls\") pod \"d511e9b2-338f-4088-97d1-f45161246ec5\" (UID: \"d511e9b2-338f-4088-97d1-f45161246ec5\") "
Aug 04 18:35:16.610271 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610253    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30176cdd-c704-4d5c-b613-bc0bd9a3aab8" (UID: "30176cdd-c704-4d5c-b613-bc0bd9a3aab8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:16.610541 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610506    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccd45df-bf29-4b53-b0d8-586d734ff605-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ccd45df-bf29-4b53-b0d8-586d734ff605" (UID: "0ccd45df-bf29-4b53-b0d8-586d734ff605"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:16.610716 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610693    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:16.610854 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610718    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ccd45df-bf29-4b53-b0d8-586d734ff605-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:16.610854 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.610736    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d511e9b2-338f-4088-97d1-f45161246ec5-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:16.612107 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.612081    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d511e9b2-338f-4088-97d1-f45161246ec5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d511e9b2-338f-4088-97d1-f45161246ec5" (UID: "d511e9b2-338f-4088-97d1-f45161246ec5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:35:16.612189 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.612141    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d511e9b2-338f-4088-97d1-f45161246ec5-kube-api-access-s5vpp" (OuterVolumeSpecName: "kube-api-access-s5vpp") pod "d511e9b2-338f-4088-97d1-f45161246ec5" (UID: "d511e9b2-338f-4088-97d1-f45161246ec5"). InnerVolumeSpecName "kube-api-access-s5vpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:16.612239 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.612212    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ccd45df-bf29-4b53-b0d8-586d734ff605-kube-api-access-xbg9p" (OuterVolumeSpecName: "kube-api-access-xbg9p") pod "0ccd45df-bf29-4b53-b0d8-586d734ff605" (UID: "0ccd45df-bf29-4b53-b0d8-586d734ff605"). InnerVolumeSpecName "kube-api-access-xbg9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:16.612276 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.612238    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-kube-api-access-h4mw5" (OuterVolumeSpecName: "kube-api-access-h4mw5") pod "30176cdd-c704-4d5c-b613-bc0bd9a3aab8" (UID: "30176cdd-c704-4d5c-b613-bc0bd9a3aab8"). InnerVolumeSpecName "kube-api-access-h4mw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:16.662016 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.661993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:16.711266 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.711231    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5vpp\" (UniqueName: \"kubernetes.io/projected/d511e9b2-338f-4088-97d1-f45161246ec5-kube-api-access-s5vpp\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:16.711266 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.711264    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4mw5\" (UniqueName: \"kubernetes.io/projected/30176cdd-c704-4d5c-b613-bc0bd9a3aab8-kube-api-access-h4mw5\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:16.711266 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.711274    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbg9p\" (UniqueName: \"kubernetes.io/projected/0ccd45df-bf29-4b53-b0d8-586d734ff605-kube-api-access-xbg9p\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:16.711418 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.711284    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d511e9b2-338f-4088-97d1-f45161246ec5-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:16.784643 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.784621    2565 generic.go:356] "Generic (PLEG): container finished" podID="d511e9b2-338f-4088-97d1-f45161246ec5" containerID="1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229" exitCode=0
Aug 04 18:35:16.784733 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.784668    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"
Aug 04 18:35:16.784733 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.784710    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7" event={"ID":"d511e9b2-338f-4088-97d1-f45161246ec5","Type":"ContainerDied","Data":"1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229"}
Aug 04 18:35:16.784868 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.784767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7" event={"ID":"d511e9b2-338f-4088-97d1-f45161246ec5","Type":"ContainerDied","Data":"75584c8f46453cb372312642aaa4399218ec86d1de91c91ec07a5b71d669b947"}
Aug 04 18:35:16.784868 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.784799    2565 scope.go:117] "RemoveContainer" containerID="1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229"
Aug 04 18:35:16.786104 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.786080    2565 generic.go:356] "Generic (PLEG): container finished" podID="30176cdd-c704-4d5c-b613-bc0bd9a3aab8" containerID="8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf" exitCode=0
Aug 04 18:35:16.786172 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.786109    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"
Aug 04 18:35:16.786241 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.786190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr" event={"ID":"30176cdd-c704-4d5c-b613-bc0bd9a3aab8","Type":"ContainerDied","Data":"8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf"}
Aug 04 18:35:16.786304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.786248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr" event={"ID":"30176cdd-c704-4d5c-b613-bc0bd9a3aab8","Type":"ContainerDied","Data":"9baf48009855f3fc2312e03b455707dc284b7a724ad777f9a9ceb52330261773"}
Aug 04 18:35:16.787621 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.787514    2565 generic.go:356] "Generic (PLEG): container finished" podID="0ccd45df-bf29-4b53-b0d8-586d734ff605" containerID="0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6" exitCode=0
Aug 04 18:35:16.787621 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.787548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw" event={"ID":"0ccd45df-bf29-4b53-b0d8-586d734ff605","Type":"ContainerDied","Data":"0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6"}
Aug 04 18:35:16.787621 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.787564    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"
Aug 04 18:35:16.787621 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.787610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw" event={"ID":"0ccd45df-bf29-4b53-b0d8-586d734ff605","Type":"ContainerDied","Data":"3d9e53d5dc914796d80ab3bf34849be53f43103311e4f33442f165a4665d4ac9"}
Aug 04 18:35:16.801716 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.801693    2565 scope.go:117] "RemoveContainer" containerID="1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229"
Aug 04 18:35:16.802791 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:35:16.802763    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229\": container with ID starting with 1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229 not found: ID does not exist" containerID="1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229"
Aug 04 18:35:16.802916 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.802798    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229"} err="failed to get container status \"1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229\": rpc error: code = NotFound desc = could not find container \"1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229\": container with ID starting with 1b5f349dd846c11b2dc13896f2e5411f3ccdce95cf9acbc76715a2961030b229 not found: ID does not exist"
Aug 04 18:35:16.802916 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.802841    2565 scope.go:117] "RemoveContainer" containerID="8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf"
Aug 04 18:35:16.811794 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.811778    2565 scope.go:117] "RemoveContainer" containerID="8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf"
Aug 04 18:35:16.812052 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:35:16.812031    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf\": container with ID starting with 8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf not found: ID does not exist" containerID="8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf"
Aug 04 18:35:16.812130 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.812057    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf"} err="failed to get container status \"8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf\": rpc error: code = NotFound desc = could not find container \"8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf\": container with ID starting with 8bf6487bd15dc2de8a2e854e3d27077efd0fa139ed6d4aa3b12a36e4695780bf not found: ID does not exist"
Aug 04 18:35:16.812130 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.812073    2565 scope.go:117] "RemoveContainer" containerID="0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6"
Aug 04 18:35:16.816853 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.816833    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"]
Aug 04 18:35:16.820442 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.820424    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b81f-85bb6d755d-pp6j7"]
Aug 04 18:35:16.820981 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.820963    2565 scope.go:117] "RemoveContainer" containerID="0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6"
Aug 04 18:35:16.821187 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:35:16.821167    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6\": container with ID starting with 0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6 not found: ID does not exist" containerID="0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6"
Aug 04 18:35:16.821249 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.821191    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6"} err="failed to get container status \"0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6\": rpc error: code = NotFound desc = could not find container \"0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6\": container with ID starting with 0c082c589304cfb6a302662f888c45bd29c080aa958503793d7be4e2017701b6 not found: ID does not exist"
Aug 04 18:35:16.830022 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.830002    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"]
Aug 04 18:35:16.833658 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.833638    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-16b81f-5dcc697c56-r7vnr"]
Aug 04 18:35:16.847921 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.847896    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"]
Aug 04 18:35:16.849627 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:16.849607    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-16b81f-7df5d7c7b-vj9cw"]
Aug 04 18:35:18.066643 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:18.066611    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ccd45df-bf29-4b53-b0d8-586d734ff605" path="/var/lib/kubelet/pods/0ccd45df-bf29-4b53-b0d8-586d734ff605/volumes"
Aug 04 18:35:18.067040 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:18.066981    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30176cdd-c704-4d5c-b613-bc0bd9a3aab8" path="/var/lib/kubelet/pods/30176cdd-c704-4d5c-b613-bc0bd9a3aab8/volumes"
Aug 04 18:35:18.067318 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:18.067306    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d511e9b2-338f-4088-97d1-f45161246ec5" path="/var/lib/kubelet/pods/d511e9b2-338f-4088-97d1-f45161246ec5/volumes"
Aug 04 18:35:22.280966 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:22.280932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:22.381435 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:22.381400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:22.540402 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:22.540326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:22.762685 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:22.762658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:38.319394 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.313075    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"]
Aug 04 18:35:38.319394 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.313344    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp" podUID="3f8ec9f9-3fb8-42b4-8156-c026d030244e" containerName="maas-api" containerID="cri-o://f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403" gracePeriod=30
Aug 04 18:35:38.327405 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.327366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:38.357661 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.357627    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"]
Aug 04 18:35:38.358506 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.358311    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h" podUID="6292e395-5984-4de3-a71f-373cb7002fbe" containerName="payload-processing" containerID="cri-o://621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e" gracePeriod=30
Aug 04 18:35:38.364748 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.364723    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"]
Aug 04 18:35:38.365003 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.364941    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk" podUID="34110968-4c1c-4867-bb0c-628cbb7b5f5d" containerName="payload-pre-processing" containerID="cri-o://624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3" gracePeriod=30
Aug 04 18:35:38.426484 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.426456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:38.511356 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.511274    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:38.624060 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.624036    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:35:38.672171 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.672150    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:35:38.675102 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.675082    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:35:38.691172 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.691155    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5skcx\" (UniqueName: \"kubernetes.io/projected/3f8ec9f9-3fb8-42b4-8156-c026d030244e-kube-api-access-5skcx\") pod \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") "
Aug 04 18:35:38.691268 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.691224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8ec9f9-3fb8-42b4-8156-c026d030244e-openshift-service-ca\") pod \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") "
Aug 04 18:35:38.691318 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.691301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls\") pod \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\" (UID: \"3f8ec9f9-3fb8-42b4-8156-c026d030244e\") "
Aug 04 18:35:38.691606 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.691581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f8ec9f9-3fb8-42b4-8156-c026d030244e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f8ec9f9-3fb8-42b4-8156-c026d030244e" (UID: "3f8ec9f9-3fb8-42b4-8156-c026d030244e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:38.693172 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.693150    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f8ec9f9-3fb8-42b4-8156-c026d030244e" (UID: "3f8ec9f9-3fb8-42b4-8156-c026d030244e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:35:38.693256 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.693199    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f8ec9f9-3fb8-42b4-8156-c026d030244e-kube-api-access-5skcx" (OuterVolumeSpecName: "kube-api-access-5skcx") pod "3f8ec9f9-3fb8-42b4-8156-c026d030244e" (UID: "3f8ec9f9-3fb8-42b4-8156-c026d030244e"). InnerVolumeSpecName "kube-api-access-5skcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:38.792329 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6292e395-5984-4de3-a71f-373cb7002fbe-plugins-config-volume\") pod \"6292e395-5984-4de3-a71f-373cb7002fbe\" (UID: \"6292e395-5984-4de3-a71f-373cb7002fbe\") "
Aug 04 18:35:38.792510 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792362    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f75z\" (UniqueName: \"kubernetes.io/projected/34110968-4c1c-4867-bb0c-628cbb7b5f5d-kube-api-access-9f75z\") pod \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\" (UID: \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\") "
Aug 04 18:35:38.792510 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzftt\" (UniqueName: \"kubernetes.io/projected/6292e395-5984-4de3-a71f-373cb7002fbe-kube-api-access-bzftt\") pod \"6292e395-5984-4de3-a71f-373cb7002fbe\" (UID: \"6292e395-5984-4de3-a71f-373cb7002fbe\") "
Aug 04 18:35:38.792510 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34110968-4c1c-4867-bb0c-628cbb7b5f5d-plugins-config-volume\") pod \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\" (UID: \"34110968-4c1c-4867-bb0c-628cbb7b5f5d\") "
Aug 04 18:35:38.792677 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792654    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6292e395-5984-4de3-a71f-373cb7002fbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6292e395-5984-4de3-a71f-373cb7002fbe" (UID: "6292e395-5984-4de3-a71f-373cb7002fbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:38.792923 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792900    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34110968-4c1c-4867-bb0c-628cbb7b5f5d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "34110968-4c1c-4867-bb0c-628cbb7b5f5d" (UID: "34110968-4c1c-4867-bb0c-628cbb7b5f5d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:35:38.793024 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792908    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8ec9f9-3fb8-42b4-8156-c026d030244e-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:38.793024 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792941    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6292e395-5984-4de3-a71f-373cb7002fbe-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:38.793024 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792962    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8ec9f9-3fb8-42b4-8156-c026d030244e-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:38.793024 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.792970    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5skcx\" (UniqueName: \"kubernetes.io/projected/3f8ec9f9-3fb8-42b4-8156-c026d030244e-kube-api-access-5skcx\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:38.794556 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.794535    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34110968-4c1c-4867-bb0c-628cbb7b5f5d-kube-api-access-9f75z" (OuterVolumeSpecName: "kube-api-access-9f75z") pod "34110968-4c1c-4867-bb0c-628cbb7b5f5d" (UID: "34110968-4c1c-4867-bb0c-628cbb7b5f5d"). InnerVolumeSpecName "kube-api-access-9f75z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:38.794622 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.794576    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6292e395-5984-4de3-a71f-373cb7002fbe-kube-api-access-bzftt" (OuterVolumeSpecName: "kube-api-access-bzftt") pod "6292e395-5984-4de3-a71f-373cb7002fbe" (UID: "6292e395-5984-4de3-a71f-373cb7002fbe"). InnerVolumeSpecName "kube-api-access-bzftt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:35:38.858145 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.858086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:38.894039 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.894015    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzftt\" (UniqueName: \"kubernetes.io/projected/6292e395-5984-4de3-a71f-373cb7002fbe-kube-api-access-bzftt\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:38.894039 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.894036    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34110968-4c1c-4867-bb0c-628cbb7b5f5d-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:38.894171 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.894048    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f75z\" (UniqueName: \"kubernetes.io/projected/34110968-4c1c-4867-bb0c-628cbb7b5f5d-kube-api-access-9f75z\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:35:38.897509 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.897484    2565 generic.go:356] "Generic (PLEG): container finished" podID="6292e395-5984-4de3-a71f-373cb7002fbe" containerID="621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e" exitCode=0
Aug 04 18:35:38.897618 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.897529    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"
Aug 04 18:35:38.897618 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.897553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h" event={"ID":"6292e395-5984-4de3-a71f-373cb7002fbe","Type":"ContainerDied","Data":"621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e"}
Aug 04 18:35:38.897722 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.897628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h" event={"ID":"6292e395-5984-4de3-a71f-373cb7002fbe","Type":"ContainerDied","Data":"130c0880e92f616c06f2aaf702ec72853bce144bc098356373fc3dbdd32920d7"}
Aug 04 18:35:38.897722 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.897661    2565 scope.go:117] "RemoveContainer" containerID="621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e"
Aug 04 18:35:38.898945 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.898917    2565 generic.go:356] "Generic (PLEG): container finished" podID="34110968-4c1c-4867-bb0c-628cbb7b5f5d" containerID="624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3" exitCode=0
Aug 04 18:35:38.899056 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.898947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk" event={"ID":"34110968-4c1c-4867-bb0c-628cbb7b5f5d","Type":"ContainerDied","Data":"624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3"}
Aug 04 18:35:38.899056 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.899000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk" event={"ID":"34110968-4c1c-4867-bb0c-628cbb7b5f5d","Type":"ContainerDied","Data":"63a7bb73b6b41db8306bae5542bb902fa507f993f3c750c48ba488077ec44df8"}
Aug 04 18:35:38.899056 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.898954    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"
Aug 04 18:35:38.900371 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.900348    2565 generic.go:356] "Generic (PLEG): container finished" podID="3f8ec9f9-3fb8-42b4-8156-c026d030244e" containerID="f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403" exitCode=0
Aug 04 18:35:38.900490 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.900392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp" event={"ID":"3f8ec9f9-3fb8-42b4-8156-c026d030244e","Type":"ContainerDied","Data":"f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403"}
Aug 04 18:35:38.900490 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.900426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp" event={"ID":"3f8ec9f9-3fb8-42b4-8156-c026d030244e","Type":"ContainerDied","Data":"af740902acaf1db759920469fba2ff2f8a4975a670c96f30e37bb0d7fd4c8680"}
Aug 04 18:35:38.900490 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.900394    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"
Aug 04 18:35:38.914547 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.914522    2565 scope.go:117] "RemoveContainer" containerID="621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e"
Aug 04 18:35:38.914962 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:35:38.914918    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e\": container with ID starting with 621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e not found: ID does not exist" containerID="621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e"
Aug 04 18:35:38.915056 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.914969    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e"} err="failed to get container status \"621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e\": rpc error: code = NotFound desc = could not find container \"621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e\": container with ID starting with 621243e864f841629a426124d2ed6db9e9be0bb16ea9d2f1cc731c746ea0b37e not found: ID does not exist"
Aug 04 18:35:38.915192 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.915174    2565 scope.go:117] "RemoveContainer" containerID="624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3"
Aug 04 18:35:38.923540 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.923524    2565 scope.go:117] "RemoveContainer" containerID="624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3"
Aug 04 18:35:38.923764 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:35:38.923745    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3\": container with ID starting with 624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3 not found: ID does not exist" containerID="624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3"
Aug 04 18:35:38.923849 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.923771    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3"} err="failed to get container status \"624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3\": rpc error: code = NotFound desc = could not find container \"624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3\": container with ID starting with 624bf8daaf49f1af57904731fea5335fc02824e78e729fa131903c4afc8c68b3 not found: ID does not exist"
Aug 04 18:35:38.923849 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.923786    2565 scope.go:117] "RemoveContainer" containerID="f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403"
Aug 04 18:35:38.931450 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.931431    2565 scope.go:117] "RemoveContainer" containerID="f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403"
Aug 04 18:35:38.931608 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.931591    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"]
Aug 04 18:35:38.931701 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:35:38.931665    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403\": container with ID starting with f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403 not found: ID does not exist" containerID="f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403"
Aug 04 18:35:38.931743 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.931718    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403"} err="failed to get container status \"f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403\": rpc error: code = NotFound desc = could not find container \"f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403\": container with ID starting with f5392ec7817213c58c3b990ee336881c08920460ff314e33b142c634dcbf8403 not found: ID does not exist"
Aug 04 18:35:38.934697 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.934675    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-95cf1a-5b9cdf7bf6-9b86h"]
Aug 04 18:35:38.943444 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.943423    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"]
Aug 04 18:35:38.947617 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.947599    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-95cf1a-6c4c767fd8-xvfsk"]
Aug 04 18:35:38.956604 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.956587    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"]
Aug 04 18:35:38.958856 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:38.958836    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-95cf1a-546447cff4-hb4lp"]
Aug 04 18:35:40.065126 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:40.065092    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34110968-4c1c-4867-bb0c-628cbb7b5f5d" path="/var/lib/kubelet/pods/34110968-4c1c-4867-bb0c-628cbb7b5f5d/volumes"
Aug 04 18:35:40.065485 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:40.065472    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f8ec9f9-3fb8-42b4-8156-c026d030244e" path="/var/lib/kubelet/pods/3f8ec9f9-3fb8-42b4-8156-c026d030244e/volumes"
Aug 04 18:35:40.065789 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:40.065777    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6292e395-5984-4de3-a71f-373cb7002fbe" path="/var/lib/kubelet/pods/6292e395-5984-4de3-a71f-373cb7002fbe/volumes"
Aug 04 18:35:40.079055 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:40.079031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:44.575012 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:44.574981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:44.629124 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:44.629092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:44.832220 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:44.832142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:45.053522 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:45.053488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:45.351824 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:45.351789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:45.668621 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:45.668593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:45.768870 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:45.768837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:48.192716 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:48.192685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:48.291275 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:48.291246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:49.421054 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421015    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"]
Aug 04 18:35:49.421669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421645    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6292e395-5984-4de3-a71f-373cb7002fbe" containerName="payload-processing"
Aug 04 18:35:49.421669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421670    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6292e395-5984-4de3-a71f-373cb7002fbe" containerName="payload-processing"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421691    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30176cdd-c704-4d5c-b613-bc0bd9a3aab8" containerName="payload-pre-processing"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421700    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="30176cdd-c704-4d5c-b613-bc0bd9a3aab8" containerName="payload-pre-processing"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421717    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f8ec9f9-3fb8-42b4-8156-c026d030244e" containerName="maas-api"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421727    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f8ec9f9-3fb8-42b4-8156-c026d030244e" containerName="maas-api"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421741    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34110968-4c1c-4867-bb0c-628cbb7b5f5d" containerName="payload-pre-processing"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421750    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34110968-4c1c-4867-bb0c-628cbb7b5f5d" containerName="payload-pre-processing"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421766    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d511e9b2-338f-4088-97d1-f45161246ec5" containerName="maas-api"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421774    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d511e9b2-338f-4088-97d1-f45161246ec5" containerName="maas-api"
Aug 04 18:35:49.421790 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421788    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccd45df-bf29-4b53-b0d8-586d734ff605" containerName="payload-processing"
Aug 04 18:35:49.422084 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421796    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccd45df-bf29-4b53-b0d8-586d734ff605" containerName="payload-processing"
Aug 04 18:35:49.422084 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421922    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccd45df-bf29-4b53-b0d8-586d734ff605" containerName="payload-processing"
Aug 04 18:35:49.422084 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421934    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="34110968-4c1c-4867-bb0c-628cbb7b5f5d" containerName="payload-pre-processing"
Aug 04 18:35:49.422084 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421947    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6292e395-5984-4de3-a71f-373cb7002fbe" containerName="payload-processing"
Aug 04 18:35:49.422084 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421957    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f8ec9f9-3fb8-42b4-8156-c026d030244e" containerName="maas-api"
Aug 04 18:35:49.422084 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421969    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d511e9b2-338f-4088-97d1-f45161246ec5" containerName="maas-api"
Aug 04 18:35:49.422084 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.421979    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="30176cdd-c704-4d5c-b613-bc0bd9a3aab8" containerName="payload-pre-processing"
Aug 04 18:35:49.427402 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.427379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.429635 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.429611    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-4659f1-serving-cert\""
Aug 04 18:35:49.435203 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.435184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"]
Aug 04 18:35:49.456133 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.456107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:49.487457 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.487429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.487544 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.487504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8g5v\" (UniqueName: \"kubernetes.io/projected/98dd49db-12e8-411c-8794-594728dfbed7-kube-api-access-b8g5v\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.487594 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.487545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98dd49db-12e8-411c-8794-594728dfbed7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.588739 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.588711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.588897 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.588783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8g5v\" (UniqueName: \"kubernetes.io/projected/98dd49db-12e8-411c-8794-594728dfbed7-kube-api-access-b8g5v\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.588897 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.588829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98dd49db-12e8-411c-8794-594728dfbed7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.588897 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:35:49.588889    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-serving-cert: secret "maas-api-e2e-shared-a-4659f1-serving-cert" not found
Aug 04 18:35:49.589057 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:35:49.588972    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls podName:98dd49db-12e8-411c-8794-594728dfbed7 nodeName:}" failed. No retries permitted until 2026-08-04 18:35:50.088944418 +0000 UTC m=+2944.464890490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls") pod "maas-api-e2e-shared-a-4659f1-ff4fb464-t675s" (UID: "98dd49db-12e8-411c-8794-594728dfbed7") : secret "maas-api-e2e-shared-a-4659f1-serving-cert" not found
Aug 04 18:35:49.589446 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.589427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98dd49db-12e8-411c-8794-594728dfbed7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.596792 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.596770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8g5v\" (UniqueName: \"kubernetes.io/projected/98dd49db-12e8-411c-8794-594728dfbed7-kube-api-access-b8g5v\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:49.759180 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.759084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:49.900062 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.900000    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:49.998344 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.998304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:35:49.999779 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:49.999761    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"]
Aug 04 18:35:50.003504 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.003485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.005679 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.005655    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-4659f1\""
Aug 04 18:35:50.005844 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.005663    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-4659f1-dockercfg-xhmhv\""
Aug 04 18:35:50.011554 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.011502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"]
Aug 04 18:35:50.022893 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.022866    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"]
Aug 04 18:35:50.027054 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.027034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.035413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.035390    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"]
Aug 04 18:35:50.093624 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.093590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76277a5a-9b0e-4cd0-a525-cf4324582fcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr\" (UID: \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.093783 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.093678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:50.093783 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.093728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6g4m\" (UniqueName: \"kubernetes.io/projected/76277a5a-9b0e-4cd0-a525-cf4324582fcd-kube-api-access-h6g4m\") pod \"payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr\" (UID: \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.093783 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.093764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52dz6\" (UniqueName: \"kubernetes.io/projected/d61c8861-f3cf-4450-b13f-797a2f7e668c-kube-api-access-52dz6\") pod \"payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q\" (UID: \"d61c8861-f3cf-4450-b13f-797a2f7e668c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.093937 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.093887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d61c8861-f3cf-4450-b13f-797a2f7e668c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q\" (UID: \"d61c8861-f3cf-4450-b13f-797a2f7e668c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.096078 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.096050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls\") pod \"maas-api-e2e-shared-a-4659f1-ff4fb464-t675s\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:50.194593 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.194559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6g4m\" (UniqueName: \"kubernetes.io/projected/76277a5a-9b0e-4cd0-a525-cf4324582fcd-kube-api-access-h6g4m\") pod \"payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr\" (UID: \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.194782 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.194603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52dz6\" (UniqueName: \"kubernetes.io/projected/d61c8861-f3cf-4450-b13f-797a2f7e668c-kube-api-access-52dz6\") pod \"payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q\" (UID: \"d61c8861-f3cf-4450-b13f-797a2f7e668c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.194871 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.194787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d61c8861-f3cf-4450-b13f-797a2f7e668c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q\" (UID: \"d61c8861-f3cf-4450-b13f-797a2f7e668c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.194990 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.194966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76277a5a-9b0e-4cd0-a525-cf4324582fcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr\" (UID: \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.195535 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.195516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d61c8861-f3cf-4450-b13f-797a2f7e668c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q\" (UID: \"d61c8861-f3cf-4450-b13f-797a2f7e668c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.195585 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.195565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76277a5a-9b0e-4cd0-a525-cf4324582fcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr\" (UID: \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.201852 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.201830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52dz6\" (UniqueName: \"kubernetes.io/projected/d61c8861-f3cf-4450-b13f-797a2f7e668c-kube-api-access-52dz6\") pod \"payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q\" (UID: \"d61c8861-f3cf-4450-b13f-797a2f7e668c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.202046 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.202024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6g4m\" (UniqueName: \"kubernetes.io/projected/76277a5a-9b0e-4cd0-a525-cf4324582fcd-kube-api-access-h6g4m\") pod \"payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr\" (UID: \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.317438 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.317349    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.338674 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.338650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.340627 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.340600    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:50.485467 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.481126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"]
Aug 04 18:35:50.711724 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.711699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"]
Aug 04 18:35:50.713312 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:35:50.713283    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61c8861_f3cf_4450_b13f_797a2f7e668c.slice/crio-aacfe90d741139a06f63ea5d1e645bab6b5ef85159299ec6dfee851c4927559f WatchSource:0}: Error finding container aacfe90d741139a06f63ea5d1e645bab6b5ef85159299ec6dfee851c4927559f: Status 404 returned error can't find the container with id aacfe90d741139a06f63ea5d1e645bab6b5ef85159299ec6dfee851c4927559f
Aug 04 18:35:50.718214 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.718180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"]
Aug 04 18:35:50.720087 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:35:50.720063    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dd49db_12e8_411c_8794_594728dfbed7.slice/crio-185ad43c4bde0e77be41603d25d1b5d470ae33b488ed7687de86292373bbfac2 WatchSource:0}: Error finding container 185ad43c4bde0e77be41603d25d1b5d470ae33b488ed7687de86292373bbfac2: Status 404 returned error can't find the container with id 185ad43c4bde0e77be41603d25d1b5d470ae33b488ed7687de86292373bbfac2
Aug 04 18:35:50.962617 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.962485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q" event={"ID":"d61c8861-f3cf-4450-b13f-797a2f7e668c","Type":"ContainerStarted","Data":"d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f"}
Aug 04 18:35:50.962617 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.962552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q" event={"ID":"d61c8861-f3cf-4450-b13f-797a2f7e668c","Type":"ContainerStarted","Data":"aacfe90d741139a06f63ea5d1e645bab6b5ef85159299ec6dfee851c4927559f"}
Aug 04 18:35:50.962852 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.962685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:35:50.963793 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.963762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s" event={"ID":"98dd49db-12e8-411c-8794-594728dfbed7","Type":"ContainerStarted","Data":"185ad43c4bde0e77be41603d25d1b5d470ae33b488ed7687de86292373bbfac2"}
Aug 04 18:35:50.965341 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.965266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr" event={"ID":"76277a5a-9b0e-4cd0-a525-cf4324582fcd","Type":"ContainerStarted","Data":"cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c"}
Aug 04 18:35:50.965341 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.965316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr" event={"ID":"76277a5a-9b0e-4cd0-a525-cf4324582fcd","Type":"ContainerStarted","Data":"2b0374a4d8df04577dd6a00d374c868042bb69f5eb7bf67c4b8bfaa203fd2dd9"}
Aug 04 18:35:50.965341 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.965343    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:35:50.979439 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.979390    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q" podStartSLOduration=0.979373783 podStartE2EDuration="979.373783ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:35:50.976671391 +0000 UTC m=+2945.352617483" watchObservedRunningTime="2026-08-04 18:35:50.979373783 +0000 UTC m=+2945.355319874"
Aug 04 18:35:50.992001 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:50.991957    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr" podStartSLOduration=1.991943529 podStartE2EDuration="1.991943529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:35:50.989577173 +0000 UTC m=+2945.365523267" watchObservedRunningTime="2026-08-04 18:35:50.991943529 +0000 UTC m=+2945.367889627"
Aug 04 18:35:51.973512 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:51.973479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s" event={"ID":"98dd49db-12e8-411c-8794-594728dfbed7","Type":"ContainerStarted","Data":"27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2"}
Aug 04 18:35:51.973981 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:51.973932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:35:51.990743 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:51.990700    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s" podStartSLOduration=2.224870083 podStartE2EDuration="2.990686998s" totalImagesPullingTime="765.816915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:35:51.988553905 +0000 UTC m=+2946.364499994" watchObservedRunningTime="2026-08-04 18:35:51.990686998 +0000 UTC m=+2946.366633086"
Aug 04 18:35:58.988706 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:35:58.988675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:36:01.975750 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:01.975715    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:36:01.976178 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:01.976033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:36:13.149603 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:13.149525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:14.619396 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:14.619353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:16.370046 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:16.370013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:16.469060 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:16.469024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:17.616431 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.616396    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"]
Aug 04 18:36:17.620955 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.620933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.623419 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.623399    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e9be3f-serving-cert\""
Aug 04 18:36:17.632389 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.632363    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"]
Aug 04 18:36:17.639606 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.639580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn674\" (UniqueName: \"kubernetes.io/projected/ca14d431-209e-48bf-b948-9a13072bf6bc-kube-api-access-gn674\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.639751 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.639732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca14d431-209e-48bf-b948-9a13072bf6bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.639797 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.639771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.650250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.650226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:17.740535 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.740502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn674\" (UniqueName: \"kubernetes.io/projected/ca14d431-209e-48bf-b948-9a13072bf6bc-kube-api-access-gn674\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.740705 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.740591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca14d431-209e-48bf-b948-9a13072bf6bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.740705 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.740618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.740785 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:36:17.740727    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-serving-cert: secret "maas-api-e2e-shared-b-e9be3f-serving-cert" not found
Aug 04 18:36:17.740841 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:36:17.740790    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls podName:ca14d431-209e-48bf-b948-9a13072bf6bc nodeName:}" failed. No retries permitted until 2026-08-04 18:36:18.240774535 +0000 UTC m=+2972.616720608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls") pod "maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx" (UID: "ca14d431-209e-48bf-b948-9a13072bf6bc") : secret "maas-api-e2e-shared-b-e9be3f-serving-cert" not found
Aug 04 18:36:17.741259 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.741240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca14d431-209e-48bf-b948-9a13072bf6bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.751657 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.751628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn674\" (UniqueName: \"kubernetes.io/projected/ca14d431-209e-48bf-b948-9a13072bf6bc-kube-api-access-gn674\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:17.887524 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:17.887443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:18.086304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.086271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:18.184792 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.184759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:18.189218 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.189195    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"]
Aug 04 18:36:18.192894 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.192878    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:18.195417 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.195399    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-e9be3f\""
Aug 04 18:36:18.195667 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.195650    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-e9be3f-dockercfg-mrclz\""
Aug 04 18:36:18.205149 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.205130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"]
Aug 04 18:36:18.246155 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.246122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f40cf56-1b96-4f86-b21e-39b722cea603-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf\" (UID: \"9f40cf56-1b96-4f86-b21e-39b722cea603\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:18.246341 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.246269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:18.246341 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.246303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vhkb\" (UniqueName: \"kubernetes.io/projected/9f40cf56-1b96-4f86-b21e-39b722cea603-kube-api-access-9vhkb\") pod \"payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf\" (UID: \"9f40cf56-1b96-4f86-b21e-39b722cea603\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:18.248681 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.248657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:18.347271 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.347235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f40cf56-1b96-4f86-b21e-39b722cea603-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf\" (UID: \"9f40cf56-1b96-4f86-b21e-39b722cea603\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:18.347432 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.347374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vhkb\" (UniqueName: \"kubernetes.io/projected/9f40cf56-1b96-4f86-b21e-39b722cea603-kube-api-access-9vhkb\") pod \"payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf\" (UID: \"9f40cf56-1b96-4f86-b21e-39b722cea603\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:18.347984 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.347963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f40cf56-1b96-4f86-b21e-39b722cea603-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf\" (UID: \"9f40cf56-1b96-4f86-b21e-39b722cea603\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:18.355425 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.355396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vhkb\" (UniqueName: \"kubernetes.io/projected/9f40cf56-1b96-4f86-b21e-39b722cea603-kube-api-access-9vhkb\") pod \"payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf\" (UID: \"9f40cf56-1b96-4f86-b21e-39b722cea603\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:18.504285 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.504197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:18.535556 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.535530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:18.653679 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.653570    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"]
Aug 04 18:36:18.656954 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:36:18.656921    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f40cf56_1b96_4f86_b21e_39b722cea603.slice/crio-53a49879d3143e85c363d250d3233c18d52d2e60d1f868a179dc24d517272cd2 WatchSource:0}: Error finding container 53a49879d3143e85c363d250d3233c18d52d2e60d1f868a179dc24d517272cd2: Status 404 returned error can't find the container with id 53a49879d3143e85c363d250d3233c18d52d2e60d1f868a179dc24d517272cd2
Aug 04 18:36:18.682392 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:18.682370    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"]
Aug 04 18:36:18.686994 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:36:18.686964    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca14d431_209e_48bf_b948_9a13072bf6bc.slice/crio-f804e27d5eaa73599e2fba8f34775f35ae50addb84571bc6fd602a7ad48b7d74 WatchSource:0}: Error finding container f804e27d5eaa73599e2fba8f34775f35ae50addb84571bc6fd602a7ad48b7d74: Status 404 returned error can't find the container with id f804e27d5eaa73599e2fba8f34775f35ae50addb84571bc6fd602a7ad48b7d74
Aug 04 18:36:19.117781 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:19.117752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf" event={"ID":"9f40cf56-1b96-4f86-b21e-39b722cea603","Type":"ContainerStarted","Data":"44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742"}
Aug 04 18:36:19.117903 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:19.117828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf" event={"ID":"9f40cf56-1b96-4f86-b21e-39b722cea603","Type":"ContainerStarted","Data":"53a49879d3143e85c363d250d3233c18d52d2e60d1f868a179dc24d517272cd2"}
Aug 04 18:36:19.117903 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:19.117866    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:19.119223 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:19.119198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx" event={"ID":"ca14d431-209e-48bf-b948-9a13072bf6bc","Type":"ContainerStarted","Data":"f804e27d5eaa73599e2fba8f34775f35ae50addb84571bc6fd602a7ad48b7d74"}
Aug 04 18:36:19.133395 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:19.133355    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf" podStartSLOduration=1.133340893 podStartE2EDuration="1.133340893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:19.13187406 +0000 UTC m=+2973.507820147" watchObservedRunningTime="2026-08-04 18:36:19.133340893 +0000 UTC m=+2973.509286983"
Aug 04 18:36:20.125694 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:20.125651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx" event={"ID":"ca14d431-209e-48bf-b948-9a13072bf6bc","Type":"ContainerStarted","Data":"c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b"}
Aug 04 18:36:20.126141 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:20.125718    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:20.141883 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:20.141836    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx" podStartSLOduration=2.755478323 podStartE2EDuration="3.141804271s" totalImagesPullingTime="386.325948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:36:20.140048239 +0000 UTC m=+2974.515994331" watchObservedRunningTime="2026-08-04 18:36:20.141804271 +0000 UTC m=+2974.517750388"
Aug 04 18:36:26.136383 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:26.136347    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:36:30.127712 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:30.127681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:36:41.315671 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:41.315635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:36:46.278503 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:46.278473    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:36:46.285467 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:46.285447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:36:46.288446 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:46.288427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:36:46.294648 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:46.294632    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:36:47.878593 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:36:47.878556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:37:11.406377 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:37:11.406346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:37:13.993669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:37:13.993626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:38:34.000508 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:38:34.000471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:38:50.515645 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:38:50.515608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:40:26.853394 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:40:26.853360    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:40:27.009114 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:40:27.009085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:40:40.999567 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:40:40.999489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:41:09.926968 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:41:09.926936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:41:17.410613 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:41:17.410579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:41:46.310399 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:41:46.310373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:41:46.319952 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:41:46.319929    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:41:46.324304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:41:46.324285    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:41:46.331078 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:41:46.331054    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:42:08.606188 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:42:08.606102    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:42:08.707089 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:42:08.707058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:42:58.565096 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:42:58.565057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:42:59.401627 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:42:59.401596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:43:04.476822 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:43:04.476778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:43:27.822750 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:43:27.822715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:44:26.036982 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:44:26.036952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:44:26.136570 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:44:26.136543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:44:46.263422 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:44:46.263390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:44:47.281682 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:44:47.281648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:44:58.771450 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:44:58.771404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:07.005588 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:07.005555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:07.094184 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:07.094154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:09.601572 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:09.601540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:09.702281 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:09.702238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:10.685681 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.685646    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"]
Aug 04 18:45:10.689575 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.689555    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.691673 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.691652    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-e72e63-serving-cert\""
Aug 04 18:45:10.699681 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.699658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"]
Aug 04 18:45:10.724794 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.724768    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:10.758684 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.758655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba04015-2bf6-4032-b31b-68c4573136f5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.758838 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.758697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba04015-2bf6-4032-b31b-68c4573136f5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.758838 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.758744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs4cb\" (UniqueName: \"kubernetes.io/projected/4ba04015-2bf6-4032-b31b-68c4573136f5-kube-api-access-rs4cb\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.857272 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.857237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:10.859436 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.859418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba04015-2bf6-4032-b31b-68c4573136f5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.859492 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.859456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba04015-2bf6-4032-b31b-68c4573136f5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.859492 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.859484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs4cb\" (UniqueName: \"kubernetes.io/projected/4ba04015-2bf6-4032-b31b-68c4573136f5-kube-api-access-rs4cb\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.860168 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.860146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba04015-2bf6-4032-b31b-68c4573136f5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.861887 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.861857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba04015-2bf6-4032-b31b-68c4573136f5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:10.866819 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:10.866786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs4cb\" (UniqueName: \"kubernetes.io/projected/4ba04015-2bf6-4032-b31b-68c4573136f5-kube-api-access-rs4cb\") pod \"maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:11.002695 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.002622    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:11.138667 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.138641    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"]
Aug 04 18:45:11.140512 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:45:11.140488    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba04015_2bf6_4032_b31b_68c4573136f5.slice/crio-df504d967b0d591b0cbdb506add371cd5824ea9d95da2c72e955a64c0deb8ace WatchSource:0}: Error finding container df504d967b0d591b0cbdb506add371cd5824ea9d95da2c72e955a64c0deb8ace: Status 404 returned error can't find the container with id df504d967b0d591b0cbdb506add371cd5824ea9d95da2c72e955a64c0deb8ace
Aug 04 18:45:11.142583 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.142558    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:45:11.438419 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.438354    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"]
Aug 04 18:45:11.443608 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.443582    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:11.445851 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.445824    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-e72e63\""
Aug 04 18:45:11.445990 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.445832    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-e72e63-dockercfg-lwxfn\""
Aug 04 18:45:11.453031 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.453002    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"]
Aug 04 18:45:11.465217 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.465192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5294282-0b5d-45aa-9736-a44f67c70b5d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9\" (UID: \"b5294282-0b5d-45aa-9736-a44f67c70b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:11.465355 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.465231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgfbx\" (UniqueName: \"kubernetes.io/projected/b5294282-0b5d-45aa-9736-a44f67c70b5d-kube-api-access-mgfbx\") pod \"payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9\" (UID: \"b5294282-0b5d-45aa-9736-a44f67c70b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:11.491936 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.491907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:11.566275 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.566230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5294282-0b5d-45aa-9736-a44f67c70b5d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9\" (UID: \"b5294282-0b5d-45aa-9736-a44f67c70b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:11.566444 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.566282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgfbx\" (UniqueName: \"kubernetes.io/projected/b5294282-0b5d-45aa-9736-a44f67c70b5d-kube-api-access-mgfbx\") pod \"payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9\" (UID: \"b5294282-0b5d-45aa-9736-a44f67c70b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:11.567184 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.567162    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5294282-0b5d-45aa-9736-a44f67c70b5d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9\" (UID: \"b5294282-0b5d-45aa-9736-a44f67c70b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:11.574007 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.573978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgfbx\" (UniqueName: \"kubernetes.io/projected/b5294282-0b5d-45aa-9736-a44f67c70b5d-kube-api-access-mgfbx\") pod \"payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9\" (UID: \"b5294282-0b5d-45aa-9736-a44f67c70b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:11.592935 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.592906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:11.756370 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.756287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:11.760521 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.760493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5" event={"ID":"4ba04015-2bf6-4032-b31b-68c4573136f5","Type":"ContainerStarted","Data":"8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4"}
Aug 04 18:45:11.760669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.760542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5" event={"ID":"4ba04015-2bf6-4032-b31b-68c4573136f5","Type":"ContainerStarted","Data":"df504d967b0d591b0cbdb506add371cd5824ea9d95da2c72e955a64c0deb8ace"}
Aug 04 18:45:11.760669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.760566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:11.788505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.788449    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5" podStartSLOduration=1.334549538 podStartE2EDuration="1.788428868s" totalImagesPullingTime="453.87933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:11.78729621 +0000 UTC m=+3506.163242380" watchObservedRunningTime="2026-08-04 18:45:11.788428868 +0000 UTC m=+3506.164374958"
Aug 04 18:45:11.899872 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:11.894535    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"]
Aug 04 18:45:11.899872 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:45:11.899098    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5294282_0b5d_45aa_9736_a44f67c70b5d.slice/crio-f3232d17532cb38bfb49a5062b4d6e1c2226e7de311bf96e23a17d41ef4fdefc WatchSource:0}: Error finding container f3232d17532cb38bfb49a5062b4d6e1c2226e7de311bf96e23a17d41ef4fdefc: Status 404 returned error can't find the container with id f3232d17532cb38bfb49a5062b4d6e1c2226e7de311bf96e23a17d41ef4fdefc
Aug 04 18:45:12.767065 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:12.767028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9" event={"ID":"b5294282-0b5d-45aa-9736-a44f67c70b5d","Type":"ContainerStarted","Data":"7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177"}
Aug 04 18:45:12.767473 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:12.767091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9" event={"ID":"b5294282-0b5d-45aa-9736-a44f67c70b5d","Type":"ContainerStarted","Data":"f3232d17532cb38bfb49a5062b4d6e1c2226e7de311bf96e23a17d41ef4fdefc"}
Aug 04 18:45:12.782668 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:12.782625    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9" podStartSLOduration=1.7826062089999999 podStartE2EDuration="1.782606209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:12.781335205 +0000 UTC m=+3507.157281307" watchObservedRunningTime="2026-08-04 18:45:12.782606209 +0000 UTC m=+3507.158552352"
Aug 04 18:45:13.772555 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:13.772521    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:17.774044 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:17.774008    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:45:24.780983 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:24.780953    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:45:34.563346 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:34.563314    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:35.232887 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:35.232853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:35.622111 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:35.622011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:36.230954 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:36.230914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:39.320233 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:39.320199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:39.924578 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:39.924537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:40.025094 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.025039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:40.451741 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.451708    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"]
Aug 04 18:45:40.455471 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.455450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:40.457570 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.457547    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-c7bd98\""
Aug 04 18:45:40.457673 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.457608    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-c7bd98-dockercfg-2dvr7\""
Aug 04 18:45:40.467801 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.467774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"]
Aug 04 18:45:40.481821 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.481785    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"]
Aug 04 18:45:40.486561 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.486529    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:40.496360 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.496332    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"]
Aug 04 18:45:40.538428 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.538395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbt4\" (UniqueName: \"kubernetes.io/projected/2ef2e3fa-b175-461a-bbac-1c36af40d570-kube-api-access-ntbt4\") pod \"payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67\" (UID: \"2ef2e3fa-b175-461a-bbac-1c36af40d570\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:40.538576 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.538518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef2e3fa-b175-461a-bbac-1c36af40d570-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67\" (UID: \"2ef2e3fa-b175-461a-bbac-1c36af40d570\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:40.582669 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.582635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:40.639360 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.639322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt7q2\" (UniqueName: \"kubernetes.io/projected/662c83a5-00eb-4b69-a94c-f056865715d6-kube-api-access-kt7q2\") pod \"payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67\" (UID: \"662c83a5-00eb-4b69-a94c-f056865715d6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:40.639538 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.639390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef2e3fa-b175-461a-bbac-1c36af40d570-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67\" (UID: \"2ef2e3fa-b175-461a-bbac-1c36af40d570\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:40.639538 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.639476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/662c83a5-00eb-4b69-a94c-f056865715d6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67\" (UID: \"662c83a5-00eb-4b69-a94c-f056865715d6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:40.639538 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.639511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbt4\" (UniqueName: \"kubernetes.io/projected/2ef2e3fa-b175-461a-bbac-1c36af40d570-kube-api-access-ntbt4\") pod \"payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67\" (UID: \"2ef2e3fa-b175-461a-bbac-1c36af40d570\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:40.640107 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.640086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef2e3fa-b175-461a-bbac-1c36af40d570-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67\" (UID: \"2ef2e3fa-b175-461a-bbac-1c36af40d570\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:40.649430 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.649408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbt4\" (UniqueName: \"kubernetes.io/projected/2ef2e3fa-b175-461a-bbac-1c36af40d570-kube-api-access-ntbt4\") pod \"payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67\" (UID: \"2ef2e3fa-b175-461a-bbac-1c36af40d570\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:40.740453 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.740376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt7q2\" (UniqueName: \"kubernetes.io/projected/662c83a5-00eb-4b69-a94c-f056865715d6-kube-api-access-kt7q2\") pod \"payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67\" (UID: \"662c83a5-00eb-4b69-a94c-f056865715d6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:40.740584 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.740482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/662c83a5-00eb-4b69-a94c-f056865715d6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67\" (UID: \"662c83a5-00eb-4b69-a94c-f056865715d6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:40.741169 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.741149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/662c83a5-00eb-4b69-a94c-f056865715d6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67\" (UID: \"662c83a5-00eb-4b69-a94c-f056865715d6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:40.754349 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.754330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt7q2\" (UniqueName: \"kubernetes.io/projected/662c83a5-00eb-4b69-a94c-f056865715d6-kube-api-access-kt7q2\") pod \"payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67\" (UID: \"662c83a5-00eb-4b69-a94c-f056865715d6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:40.767161 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.767141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:40.798831 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.798794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:40.876838 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.876762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:45:40.925151 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.924946    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"]
Aug 04 18:45:40.926513 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:45:40.926481    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef2e3fa_b175_461a_bbac_1c36af40d570.slice/crio-f1c17c394a28db29256643da46acea68af7554ead3c119315f537205fe73fa7a WatchSource:0}: Error finding container f1c17c394a28db29256643da46acea68af7554ead3c119315f537205fe73fa7a: Status 404 returned error can't find the container with id f1c17c394a28db29256643da46acea68af7554ead3c119315f537205fe73fa7a
Aug 04 18:45:40.948931 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:40.948901    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"]
Aug 04 18:45:40.949217 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:45:40.949188    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662c83a5_00eb_4b69_a94c_f056865715d6.slice/crio-82a5760e920ed8d994f05286ce4f4f33f76ab367486350f889eaf460b6da6897 WatchSource:0}: Error finding container 82a5760e920ed8d994f05286ce4f4f33f76ab367486350f889eaf460b6da6897: Status 404 returned error can't find the container with id 82a5760e920ed8d994f05286ce4f4f33f76ab367486350f889eaf460b6da6897
Aug 04 18:45:41.931483 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:41.931447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67" event={"ID":"2ef2e3fa-b175-461a-bbac-1c36af40d570","Type":"ContainerStarted","Data":"09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15"}
Aug 04 18:45:41.931920 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:41.931510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:41.931920 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:41.931532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67" event={"ID":"2ef2e3fa-b175-461a-bbac-1c36af40d570","Type":"ContainerStarted","Data":"f1c17c394a28db29256643da46acea68af7554ead3c119315f537205fe73fa7a"}
Aug 04 18:45:41.933006 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:41.932986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67" event={"ID":"662c83a5-00eb-4b69-a94c-f056865715d6","Type":"ContainerStarted","Data":"9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a"}
Aug 04 18:45:41.933140 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:41.933026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67" event={"ID":"662c83a5-00eb-4b69-a94c-f056865715d6","Type":"ContainerStarted","Data":"82a5760e920ed8d994f05286ce4f4f33f76ab367486350f889eaf460b6da6897"}
Aug 04 18:45:41.933140 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:41.933106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:45:41.947352 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:41.947314    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67" podStartSLOduration=1.947302367 podStartE2EDuration="1.947302367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:41.945669793 +0000 UTC m=+3536.321615884" watchObservedRunningTime="2026-08-04 18:45:41.947302367 +0000 UTC m=+3536.323248456"
Aug 04 18:45:41.962275 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:41.962224    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67" podStartSLOduration=1.962210855 podStartE2EDuration="1.962210855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:41.959957065 +0000 UTC m=+3536.335903156" watchObservedRunningTime="2026-08-04 18:45:41.962210855 +0000 UTC m=+3536.338156944"
Aug 04 18:45:52.942179 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:52.942150    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:45:52.942644 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:45:52.942350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:46:03.739942 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:03.739907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:46:10.587148 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:10.587120    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q425w_ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46/payload-processing/0.log"
Aug 04 18:46:10.715296 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:10.715271    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67_662c83a5-00eb-4b69-a94c-f056865715d6/payload-processing/0.log"
Aug 04 18:46:14.999224 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:14.999192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:46:46.345191 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:46.345166    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:46:46.351768 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:46.351746    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:46:46.357196 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:46.357179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:46:46.363429 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:46.363412    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:46:50.241864 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:50.241829    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9_b5294282-0b5d-45aa-9736-a44f67c70b5d/payload-processing/0.log"
Aug 04 18:46:50.363919 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:50.363889    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q425w_ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46/payload-processing/0.log"
Aug 04 18:46:50.482658 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:50.482634    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67_662c83a5-00eb-4b69-a94c-f056865715d6/payload-processing/0.log"
Aug 04 18:46:50.744137 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:50.744106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:46:52.169395 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:52.169352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:46:59.350922 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:59.350881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:46:59.450134 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:46:59.450103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:00.477618 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:00.477575    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:00.820166 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:00.820049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:00.965410 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:00.965377    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:01.061856 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.061826    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:01.074172 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.074099    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"]
Aug 04 18:47:01.077854 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.077834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:01.080078 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.080058    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-ecd1c1-dockercfg-pbjjq\""
Aug 04 18:47:01.080202 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.080059    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-ecd1c1\""
Aug 04 18:47:01.088710 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.088685    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"]
Aug 04 18:47:01.100431 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.100396    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"]
Aug 04 18:47:01.104955 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.104935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:01.115030 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.115009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"]
Aug 04 18:47:01.147050 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.147015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fxsp\" (UniqueName: \"kubernetes.io/projected/14fc67d2-fa23-431a-a1db-526c10bf6bff-kube-api-access-9fxsp\") pod \"payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t\" (UID: \"14fc67d2-fa23-431a-a1db-526c10bf6bff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:01.147204 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.147065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7f6\" (UniqueName: \"kubernetes.io/projected/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-kube-api-access-tc7f6\") pod \"payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg\" (UID: \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:01.147204 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.147171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14fc67d2-fa23-431a-a1db-526c10bf6bff-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t\" (UID: \"14fc67d2-fa23-431a-a1db-526c10bf6bff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:01.147338 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.147230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg\" (UID: \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:01.248114 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.248081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg\" (UID: \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:01.248308 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.248140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fxsp\" (UniqueName: \"kubernetes.io/projected/14fc67d2-fa23-431a-a1db-526c10bf6bff-kube-api-access-9fxsp\") pod \"payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t\" (UID: \"14fc67d2-fa23-431a-a1db-526c10bf6bff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:01.248308 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.248169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7f6\" (UniqueName: \"kubernetes.io/projected/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-kube-api-access-tc7f6\") pod \"payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg\" (UID: \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:01.248308 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.248225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14fc67d2-fa23-431a-a1db-526c10bf6bff-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t\" (UID: \"14fc67d2-fa23-431a-a1db-526c10bf6bff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:01.248917 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.248896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14fc67d2-fa23-431a-a1db-526c10bf6bff-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t\" (UID: \"14fc67d2-fa23-431a-a1db-526c10bf6bff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:01.249046 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.249024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg\" (UID: \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:01.258161 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.258139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7f6\" (UniqueName: \"kubernetes.io/projected/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-kube-api-access-tc7f6\") pod \"payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg\" (UID: \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:01.258299 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.258278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fxsp\" (UniqueName: \"kubernetes.io/projected/14fc67d2-fa23-431a-a1db-526c10bf6bff-kube-api-access-9fxsp\") pod \"payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t\" (UID: \"14fc67d2-fa23-431a-a1db-526c10bf6bff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:01.390132 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.390048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:01.418297 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.418273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:01.551534 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.551500    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"]
Aug 04 18:47:01.554558 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:47:01.554497    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb6068c_1de6_43a7_a022_acd5ef9d3ebe.slice/crio-3ea690cecc25bd69d5da542d2e4587189844af02b515aa186656a7ac6aba507d WatchSource:0}: Error finding container 3ea690cecc25bd69d5da542d2e4587189844af02b515aa186656a7ac6aba507d: Status 404 returned error can't find the container with id 3ea690cecc25bd69d5da542d2e4587189844af02b515aa186656a7ac6aba507d
Aug 04 18:47:01.785596 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:01.785570    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"]
Aug 04 18:47:01.787215 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:47:01.787179    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fc67d2_fa23_431a_a1db_526c10bf6bff.slice/crio-117a24783271cc9ae9846e0f80af8f3a6e930054c25cfb9559f3a3beb823b538 WatchSource:0}: Error finding container 117a24783271cc9ae9846e0f80af8f3a6e930054c25cfb9559f3a3beb823b538: Status 404 returned error can't find the container with id 117a24783271cc9ae9846e0f80af8f3a6e930054c25cfb9559f3a3beb823b538
Aug 04 18:47:02.343206 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:02.343171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg" event={"ID":"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe","Type":"ContainerStarted","Data":"5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802"}
Aug 04 18:47:02.343393 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:02.343236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg" event={"ID":"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe","Type":"ContainerStarted","Data":"3ea690cecc25bd69d5da542d2e4587189844af02b515aa186656a7ac6aba507d"}
Aug 04 18:47:02.343393 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:02.343273    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:02.344888 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:02.344861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t" event={"ID":"14fc67d2-fa23-431a-a1db-526c10bf6bff","Type":"ContainerStarted","Data":"592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570"}
Aug 04 18:47:02.345016 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:02.344904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t" event={"ID":"14fc67d2-fa23-431a-a1db-526c10bf6bff","Type":"ContainerStarted","Data":"117a24783271cc9ae9846e0f80af8f3a6e930054c25cfb9559f3a3beb823b538"}
Aug 04 18:47:02.345016 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:02.345006    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:02.357781 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:02.357742    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg" podStartSLOduration=1.357729595 podStartE2EDuration="1.357729595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:47:02.357032447 +0000 UTC m=+3616.732978539" watchObservedRunningTime="2026-08-04 18:47:02.357729595 +0000 UTC m=+3616.733675684"
Aug 04 18:47:02.372787 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:02.372745    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t" podStartSLOduration=1.372731766 podStartE2EDuration="1.372731766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:47:02.370473553 +0000 UTC m=+3616.746419643" watchObservedRunningTime="2026-08-04 18:47:02.372731766 +0000 UTC m=+3616.748677879"
Aug 04 18:47:13.352342 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:13.352311    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:13.353057 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:13.353035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:23.189762 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:23.189725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:24.305643 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:24.305614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:31.072845 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.072682    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"]
Aug 04 18:47:31.073464 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.073151    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t" podUID="14fc67d2-fa23-431a-a1db-526c10bf6bff" containerName="payload-processing" containerID="cri-o://592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570" gracePeriod=30
Aug 04 18:47:31.081473 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.081446    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"]
Aug 04 18:47:31.082053 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.081867    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg" podUID="dbb6068c-1de6-43a7-a022-acd5ef9d3ebe" containerName="payload-pre-processing" containerID="cri-o://5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802" gracePeriod=30
Aug 04 18:47:31.337632 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.337575    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:31.372289 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.372257    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:31.451087 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.451058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14fc67d2-fa23-431a-a1db-526c10bf6bff-plugins-config-volume\") pod \"14fc67d2-fa23-431a-a1db-526c10bf6bff\" (UID: \"14fc67d2-fa23-431a-a1db-526c10bf6bff\") "
Aug 04 18:47:31.451266 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.451148    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fxsp\" (UniqueName: \"kubernetes.io/projected/14fc67d2-fa23-431a-a1db-526c10bf6bff-kube-api-access-9fxsp\") pod \"14fc67d2-fa23-431a-a1db-526c10bf6bff\" (UID: \"14fc67d2-fa23-431a-a1db-526c10bf6bff\") "
Aug 04 18:47:31.451440 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.451415    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fc67d2-fa23-431a-a1db-526c10bf6bff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14fc67d2-fa23-431a-a1db-526c10bf6bff" (UID: "14fc67d2-fa23-431a-a1db-526c10bf6bff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:31.453175 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.453157    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fc67d2-fa23-431a-a1db-526c10bf6bff-kube-api-access-9fxsp" (OuterVolumeSpecName: "kube-api-access-9fxsp") pod "14fc67d2-fa23-431a-a1db-526c10bf6bff" (UID: "14fc67d2-fa23-431a-a1db-526c10bf6bff"). InnerVolumeSpecName "kube-api-access-9fxsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:47:31.498859 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.498794    2565 generic.go:356] "Generic (PLEG): container finished" podID="14fc67d2-fa23-431a-a1db-526c10bf6bff" containerID="592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570" exitCode=0
Aug 04 18:47:31.499018 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.498875    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"
Aug 04 18:47:31.499018 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.498876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t" event={"ID":"14fc67d2-fa23-431a-a1db-526c10bf6bff","Type":"ContainerDied","Data":"592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570"}
Aug 04 18:47:31.499018 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.498957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t" event={"ID":"14fc67d2-fa23-431a-a1db-526c10bf6bff","Type":"ContainerDied","Data":"117a24783271cc9ae9846e0f80af8f3a6e930054c25cfb9559f3a3beb823b538"}
Aug 04 18:47:31.499018 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.498988    2565 scope.go:117] "RemoveContainer" containerID="592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570"
Aug 04 18:47:31.500202 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.500179    2565 generic.go:356] "Generic (PLEG): container finished" podID="dbb6068c-1de6-43a7-a022-acd5ef9d3ebe" containerID="5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802" exitCode=0
Aug 04 18:47:31.500298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.500221    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"
Aug 04 18:47:31.500298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.500262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg" event={"ID":"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe","Type":"ContainerDied","Data":"5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802"}
Aug 04 18:47:31.500298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.500296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg" event={"ID":"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe","Type":"ContainerDied","Data":"3ea690cecc25bd69d5da542d2e4587189844af02b515aa186656a7ac6aba507d"}
Aug 04 18:47:31.510660 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.510643    2565 scope.go:117] "RemoveContainer" containerID="592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570"
Aug 04 18:47:31.511084 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:47:31.511060    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570\": container with ID starting with 592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570 not found: ID does not exist" containerID="592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570"
Aug 04 18:47:31.511178 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.511093    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570"} err="failed to get container status \"592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570\": rpc error: code = NotFound desc = could not find container \"592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570\": container with ID starting with 592b80be6feddda793873307c31b20de1deebe44229a6b8738c634676bdbc570 not found: ID does not exist"
Aug 04 18:47:31.511178 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.511115    2565 scope.go:117] "RemoveContainer" containerID="5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802"
Aug 04 18:47:31.519696 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.519670    2565 scope.go:117] "RemoveContainer" containerID="5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802"
Aug 04 18:47:31.519974 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:47:31.519955    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802\": container with ID starting with 5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802 not found: ID does not exist" containerID="5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802"
Aug 04 18:47:31.520049 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.519981    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802"} err="failed to get container status \"5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802\": rpc error: code = NotFound desc = could not find container \"5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802\": container with ID starting with 5f2ed70bc053a23dc73409703744818ece12b79688ed242156899a25228c4802 not found: ID does not exist"
Aug 04 18:47:31.523256 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.523237    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"]
Aug 04 18:47:31.526739 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.526720    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ecd1c1-7cb64b8bd6-qkp4t"]
Aug 04 18:47:31.551975 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.551932    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc7f6\" (UniqueName: \"kubernetes.io/projected/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-kube-api-access-tc7f6\") pod \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\" (UID: \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\") "
Aug 04 18:47:31.552106 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.552069    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-plugins-config-volume\") pod \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\" (UID: \"dbb6068c-1de6-43a7-a022-acd5ef9d3ebe\") "
Aug 04 18:47:31.552426 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.552404    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dbb6068c-1de6-43a7-a022-acd5ef9d3ebe" (UID: "dbb6068c-1de6-43a7-a022-acd5ef9d3ebe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:31.552469 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.552418    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14fc67d2-fa23-431a-a1db-526c10bf6bff-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:31.552469 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.552451    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fxsp\" (UniqueName: \"kubernetes.io/projected/14fc67d2-fa23-431a-a1db-526c10bf6bff-kube-api-access-9fxsp\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:31.554017 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.553999    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-kube-api-access-tc7f6" (OuterVolumeSpecName: "kube-api-access-tc7f6") pod "dbb6068c-1de6-43a7-a022-acd5ef9d3ebe" (UID: "dbb6068c-1de6-43a7-a022-acd5ef9d3ebe"). InnerVolumeSpecName "kube-api-access-tc7f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:47:31.653122 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.653041    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:31.653122 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.653072    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc7f6\" (UniqueName: \"kubernetes.io/projected/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe-kube-api-access-tc7f6\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:31.820598 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.820563    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"]
Aug 04 18:47:31.824193 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:31.824169    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ecd1c1-dd958cd5b-kv2gg"]
Aug 04 18:47:32.066779 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:32.066747    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fc67d2-fa23-431a-a1db-526c10bf6bff" path="/var/lib/kubelet/pods/14fc67d2-fa23-431a-a1db-526c10bf6bff/volumes"
Aug 04 18:47:32.067157 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:32.067143    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb6068c-1de6-43a7-a022-acd5ef9d3ebe" path="/var/lib/kubelet/pods/dbb6068c-1de6-43a7-a022-acd5ef9d3ebe/volumes"
Aug 04 18:47:32.389157 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:32.389069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:32.529639 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:32.529610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:37.575157 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:37.575123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:37.672629 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:37.672593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:37.733070 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:37.733036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:37.901181 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:37.901101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:56.741513 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:56.741478    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"]
Aug 04 18:47:56.742912 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:56.741875    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5" podUID="4ba04015-2bf6-4032-b31b-68c4573136f5" containerName="maas-api" containerID="cri-o://8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4" gracePeriod=30
Aug 04 18:47:56.780167 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:56.780133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:56.798171 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:56.798147    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"]
Aug 04 18:47:56.798377 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:56.798350    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9" podUID="b5294282-0b5d-45aa-9736-a44f67c70b5d" containerName="payload-processing" containerID="cri-o://7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177" gracePeriod=30
Aug 04 18:47:56.880566 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:56.880527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:56.939985 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:56.939953    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:57.055322 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.055297    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:47:57.080663 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.080634    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:47:57.203706 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.203678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs4cb\" (UniqueName: \"kubernetes.io/projected/4ba04015-2bf6-4032-b31b-68c4573136f5-kube-api-access-rs4cb\") pod \"4ba04015-2bf6-4032-b31b-68c4573136f5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") "
Aug 04 18:47:57.203883 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.203717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba04015-2bf6-4032-b31b-68c4573136f5-maas-api-tls\") pod \"4ba04015-2bf6-4032-b31b-68c4573136f5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") "
Aug 04 18:47:57.203883 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.203738    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgfbx\" (UniqueName: \"kubernetes.io/projected/b5294282-0b5d-45aa-9736-a44f67c70b5d-kube-api-access-mgfbx\") pod \"b5294282-0b5d-45aa-9736-a44f67c70b5d\" (UID: \"b5294282-0b5d-45aa-9736-a44f67c70b5d\") "
Aug 04 18:47:57.203883 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.203805    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba04015-2bf6-4032-b31b-68c4573136f5-openshift-service-ca\") pod \"4ba04015-2bf6-4032-b31b-68c4573136f5\" (UID: \"4ba04015-2bf6-4032-b31b-68c4573136f5\") "
Aug 04 18:47:57.203883 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.203854    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5294282-0b5d-45aa-9736-a44f67c70b5d-plugins-config-volume\") pod \"b5294282-0b5d-45aa-9736-a44f67c70b5d\" (UID: \"b5294282-0b5d-45aa-9736-a44f67c70b5d\") "
Aug 04 18:47:57.204193 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.204168    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ba04015-2bf6-4032-b31b-68c4573136f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ba04015-2bf6-4032-b31b-68c4573136f5" (UID: "4ba04015-2bf6-4032-b31b-68c4573136f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:57.204298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.204259    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5294282-0b5d-45aa-9736-a44f67c70b5d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5294282-0b5d-45aa-9736-a44f67c70b5d" (UID: "b5294282-0b5d-45aa-9736-a44f67c70b5d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:47:57.204298 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.204276    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba04015-2bf6-4032-b31b-68c4573136f5-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:57.205798 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.205775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba04015-2bf6-4032-b31b-68c4573136f5-kube-api-access-rs4cb" (OuterVolumeSpecName: "kube-api-access-rs4cb") pod "4ba04015-2bf6-4032-b31b-68c4573136f5" (UID: "4ba04015-2bf6-4032-b31b-68c4573136f5"). InnerVolumeSpecName "kube-api-access-rs4cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:47:57.205910 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.205890    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ba04015-2bf6-4032-b31b-68c4573136f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ba04015-2bf6-4032-b31b-68c4573136f5" (UID: "4ba04015-2bf6-4032-b31b-68c4573136f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:47:57.205952 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.205893    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5294282-0b5d-45aa-9736-a44f67c70b5d-kube-api-access-mgfbx" (OuterVolumeSpecName: "kube-api-access-mgfbx") pod "b5294282-0b5d-45aa-9736-a44f67c70b5d" (UID: "b5294282-0b5d-45aa-9736-a44f67c70b5d"). InnerVolumeSpecName "kube-api-access-mgfbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:47:57.300862 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.300789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:47:57.305127 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.305106    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5294282-0b5d-45aa-9736-a44f67c70b5d-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:57.305127 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.305128    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs4cb\" (UniqueName: \"kubernetes.io/projected/4ba04015-2bf6-4032-b31b-68c4573136f5-kube-api-access-rs4cb\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:57.305250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.305138    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ba04015-2bf6-4032-b31b-68c4573136f5-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:57.305250 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.305149    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgfbx\" (UniqueName: \"kubernetes.io/projected/b5294282-0b5d-45aa-9736-a44f67c70b5d-kube-api-access-mgfbx\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:47:57.641171 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.641083    2565 generic.go:356] "Generic (PLEG): container finished" podID="b5294282-0b5d-45aa-9736-a44f67c70b5d" containerID="7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177" exitCode=0
Aug 04 18:47:57.641171 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.641124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9" event={"ID":"b5294282-0b5d-45aa-9736-a44f67c70b5d","Type":"ContainerDied","Data":"7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177"}
Aug 04 18:47:57.641366 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.641180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9" event={"ID":"b5294282-0b5d-45aa-9736-a44f67c70b5d","Type":"ContainerDied","Data":"f3232d17532cb38bfb49a5062b4d6e1c2226e7de311bf96e23a17d41ef4fdefc"}
Aug 04 18:47:57.641366 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.641207    2565 scope.go:117] "RemoveContainer" containerID="7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177"
Aug 04 18:47:57.641366 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.641130    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"
Aug 04 18:47:57.642624 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.642584    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ba04015-2bf6-4032-b31b-68c4573136f5" containerID="8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4" exitCode=0
Aug 04 18:47:57.642624 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.642624    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"
Aug 04 18:47:57.642783 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.642665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5" event={"ID":"4ba04015-2bf6-4032-b31b-68c4573136f5","Type":"ContainerDied","Data":"8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4"}
Aug 04 18:47:57.642783 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.642719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5" event={"ID":"4ba04015-2bf6-4032-b31b-68c4573136f5","Type":"ContainerDied","Data":"df504d967b0d591b0cbdb506add371cd5824ea9d95da2c72e955a64c0deb8ace"}
Aug 04 18:47:57.651111 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.651024    2565 scope.go:117] "RemoveContainer" containerID="7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177"
Aug 04 18:47:57.651368 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:47:57.651343    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177\": container with ID starting with 7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177 not found: ID does not exist" containerID="7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177"
Aug 04 18:47:57.651464 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.651378    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177"} err="failed to get container status \"7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177\": rpc error: code = NotFound desc = could not find container \"7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177\": container with ID starting with 7cb8d223c937198b9fa5a6e641775083f33d14e7e915aa5d4fc0b6052a572177 not found: ID does not exist"
Aug 04 18:47:57.651464 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.651399    2565 scope.go:117] "RemoveContainer" containerID="8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4"
Aug 04 18:47:57.659016 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.659000    2565 scope.go:117] "RemoveContainer" containerID="8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4"
Aug 04 18:47:57.659217 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:47:57.659199    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4\": container with ID starting with 8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4 not found: ID does not exist" containerID="8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4"
Aug 04 18:47:57.659269 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.659223    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4"} err="failed to get container status \"8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4\": rpc error: code = NotFound desc = could not find container \"8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4\": container with ID starting with 8056096fcc7f36fcb0c79e995cb0e7971ef06748eb02e362153e2738e746edb4 not found: ID does not exist"
Aug 04 18:47:57.666502 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.666481    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"]
Aug 04 18:47:57.669780 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.669759    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e72e63-857756c779-pmwg5"]
Aug 04 18:47:57.678828 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.678790    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"]
Aug 04 18:47:57.680739 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:57.680715    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e72e63-6bf457cff8-tn4h9"]
Aug 04 18:47:58.066933 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:58.066902    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ba04015-2bf6-4032-b31b-68c4573136f5" path="/var/lib/kubelet/pods/4ba04015-2bf6-4032-b31b-68c4573136f5/volumes"
Aug 04 18:47:58.067301 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:47:58.067270    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5294282-0b5d-45aa-9736-a44f67c70b5d" path="/var/lib/kubelet/pods/b5294282-0b5d-45aa-9736-a44f67c70b5d/volumes"
Aug 04 18:48:02.329187 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:02.329156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:27.613485 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:27.613447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:27.714322 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:27.714264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:39.260042 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:39.260002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:39.566849 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:39.566747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:45.145430 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:45.145390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:45.210917 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:45.210880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:45.445865 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:45.445832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:45.650699 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:45.650663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:56.157433 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.157400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:56.182772 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.182739    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"]
Aug 04 18:48:56.183037 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.183010    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67" podUID="662c83a5-00eb-4b69-a94c-f056865715d6" containerName="payload-processing" containerID="cri-o://9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a" gracePeriod=30
Aug 04 18:48:56.204165 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.203471    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"]
Aug 04 18:48:56.204165 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.203827    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67" podUID="2ef2e3fa-b175-461a-bbac-1c36af40d570" containerName="payload-pre-processing" containerID="cri-o://09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15" gracePeriod=30
Aug 04 18:48:56.229748 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.229715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:56.295893 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.295862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:56.401324 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.401296    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:56.482332 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.482308    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:48:56.485256 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.485229    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:48:56.578042 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.578011    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef2e3fa-b175-461a-bbac-1c36af40d570-plugins-config-volume\") pod \"2ef2e3fa-b175-461a-bbac-1c36af40d570\" (UID: \"2ef2e3fa-b175-461a-bbac-1c36af40d570\") "
Aug 04 18:48:56.578042 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.578044    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt7q2\" (UniqueName: \"kubernetes.io/projected/662c83a5-00eb-4b69-a94c-f056865715d6-kube-api-access-kt7q2\") pod \"662c83a5-00eb-4b69-a94c-f056865715d6\" (UID: \"662c83a5-00eb-4b69-a94c-f056865715d6\") "
Aug 04 18:48:56.578243 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.578121    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntbt4\" (UniqueName: \"kubernetes.io/projected/2ef2e3fa-b175-461a-bbac-1c36af40d570-kube-api-access-ntbt4\") pod \"2ef2e3fa-b175-461a-bbac-1c36af40d570\" (UID: \"2ef2e3fa-b175-461a-bbac-1c36af40d570\") "
Aug 04 18:48:56.578243 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.578197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/662c83a5-00eb-4b69-a94c-f056865715d6-plugins-config-volume\") pod \"662c83a5-00eb-4b69-a94c-f056865715d6\" (UID: \"662c83a5-00eb-4b69-a94c-f056865715d6\") "
Aug 04 18:48:56.578559 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.578530    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ef2e3fa-b175-461a-bbac-1c36af40d570-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ef2e3fa-b175-461a-bbac-1c36af40d570" (UID: "2ef2e3fa-b175-461a-bbac-1c36af40d570"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:48:56.578661 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.578613    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/662c83a5-00eb-4b69-a94c-f056865715d6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "662c83a5-00eb-4b69-a94c-f056865715d6" (UID: "662c83a5-00eb-4b69-a94c-f056865715d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:48:56.580222 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.580194    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/662c83a5-00eb-4b69-a94c-f056865715d6-kube-api-access-kt7q2" (OuterVolumeSpecName: "kube-api-access-kt7q2") pod "662c83a5-00eb-4b69-a94c-f056865715d6" (UID: "662c83a5-00eb-4b69-a94c-f056865715d6"). InnerVolumeSpecName "kube-api-access-kt7q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:48:56.580315 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.580219    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef2e3fa-b175-461a-bbac-1c36af40d570-kube-api-access-ntbt4" (OuterVolumeSpecName: "kube-api-access-ntbt4") pod "2ef2e3fa-b175-461a-bbac-1c36af40d570" (UID: "2ef2e3fa-b175-461a-bbac-1c36af40d570"). InnerVolumeSpecName "kube-api-access-ntbt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:48:56.679670 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.679637    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntbt4\" (UniqueName: \"kubernetes.io/projected/2ef2e3fa-b175-461a-bbac-1c36af40d570-kube-api-access-ntbt4\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:48:56.679670 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.679665    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/662c83a5-00eb-4b69-a94c-f056865715d6-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:48:56.679670 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.679675    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef2e3fa-b175-461a-bbac-1c36af40d570-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:48:56.679941 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.679684    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt7q2\" (UniqueName: \"kubernetes.io/projected/662c83a5-00eb-4b69-a94c-f056865715d6-kube-api-access-kt7q2\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:48:56.709257 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.709171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:48:56.954132 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.954099    2565 generic.go:356] "Generic (PLEG): container finished" podID="662c83a5-00eb-4b69-a94c-f056865715d6" containerID="9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a" exitCode=0
Aug 04 18:48:56.954297 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.954146    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"
Aug 04 18:48:56.954297 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.954186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67" event={"ID":"662c83a5-00eb-4b69-a94c-f056865715d6","Type":"ContainerDied","Data":"9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a"}
Aug 04 18:48:56.954297 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.954233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67" event={"ID":"662c83a5-00eb-4b69-a94c-f056865715d6","Type":"ContainerDied","Data":"82a5760e920ed8d994f05286ce4f4f33f76ab367486350f889eaf460b6da6897"}
Aug 04 18:48:56.954297 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.954245    2565 scope.go:117] "RemoveContainer" containerID="9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a"
Aug 04 18:48:56.955679 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.955656    2565 generic.go:356] "Generic (PLEG): container finished" podID="2ef2e3fa-b175-461a-bbac-1c36af40d570" containerID="09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15" exitCode=0
Aug 04 18:48:56.955796 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.955706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67" event={"ID":"2ef2e3fa-b175-461a-bbac-1c36af40d570","Type":"ContainerDied","Data":"09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15"}
Aug 04 18:48:56.955796 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.955743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67" event={"ID":"2ef2e3fa-b175-461a-bbac-1c36af40d570","Type":"ContainerDied","Data":"f1c17c394a28db29256643da46acea68af7554ead3c119315f537205fe73fa7a"}
Aug 04 18:48:56.955796 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.955712    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"
Aug 04 18:48:56.964021 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.963999    2565 scope.go:117] "RemoveContainer" containerID="9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a"
Aug 04 18:48:56.964281 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:48:56.964263    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a\": container with ID starting with 9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a not found: ID does not exist" containerID="9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a"
Aug 04 18:48:56.964364 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.964294    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a"} err="failed to get container status \"9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a\": rpc error: code = NotFound desc = could not find container \"9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a\": container with ID starting with 9c2f1b50ebb6a1a833c6f8900bcf8ae41a3b2b806e3dc257009f14a9f4d1b25a not found: ID does not exist"
Aug 04 18:48:56.964364 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.964317    2565 scope.go:117] "RemoveContainer" containerID="09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15"
Aug 04 18:48:56.974937 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.974909    2565 scope.go:117] "RemoveContainer" containerID="09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15"
Aug 04 18:48:56.976152 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:48:56.976131    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15\": container with ID starting with 09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15 not found: ID does not exist" containerID="09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15"
Aug 04 18:48:56.976256 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.976156    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15"} err="failed to get container status \"09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15\": rpc error: code = NotFound desc = could not find container \"09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15\": container with ID starting with 09ca227869d3b2e7a0e3bd894afa3b2f06d1bba0b753245fffe86e96097d0b15 not found: ID does not exist"
Aug 04 18:48:56.978009 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.977989    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"]
Aug 04 18:48:56.980921 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.980899    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c7bd98-8f6ccdf66-zqv67"]
Aug 04 18:48:56.990595 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.990572    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"]
Aug 04 18:48:56.992450 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:56.992432    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c7bd98-5cff9d76c6-6vr67"]
Aug 04 18:48:58.066143 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:58.066111    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ef2e3fa-b175-461a-bbac-1c36af40d570" path="/var/lib/kubelet/pods/2ef2e3fa-b175-461a-bbac-1c36af40d570/volumes"
Aug 04 18:48:58.066658 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:48:58.066641    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="662c83a5-00eb-4b69-a94c-f056865715d6" path="/var/lib/kubelet/pods/662c83a5-00eb-4b69-a94c-f056865715d6/volumes"
Aug 04 18:49:02.507828 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:02.507756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:02.575684 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:02.575642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:02.777116 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:02.777027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:02.987878 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:02.987803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:13.600089 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.600051    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"]
Aug 04 18:49:13.600619 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.600254    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s" podUID="98dd49db-12e8-411c-8794-594728dfbed7" containerName="maas-api" containerID="cri-o://27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2" gracePeriod=30
Aug 04 18:49:13.622062 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.622029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:13.649988 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.649949    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"]
Aug 04 18:49:13.650221 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.650191    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q" podUID="d61c8861-f3cf-4450-b13f-797a2f7e668c" containerName="payload-processing" containerID="cri-o://d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f" gracePeriod=30
Aug 04 18:49:13.661107 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.661075    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"]
Aug 04 18:49:13.661494 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.661465    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr" podUID="76277a5a-9b0e-4cd0-a525-cf4324582fcd" containerName="payload-pre-processing" containerID="cri-o://cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c" gracePeriod=30
Aug 04 18:49:13.690886 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.690849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:13.756852 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.756765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:13.942160 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.941797    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:49:13.975074 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.975049    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:49:13.986413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:13.986381    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:49:14.053393 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.053357    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6g4m\" (UniqueName: \"kubernetes.io/projected/76277a5a-9b0e-4cd0-a525-cf4324582fcd-kube-api-access-h6g4m\") pod \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\" (UID: \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\") "
Aug 04 18:49:14.053600 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.053409    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52dz6\" (UniqueName: \"kubernetes.io/projected/d61c8861-f3cf-4450-b13f-797a2f7e668c-kube-api-access-52dz6\") pod \"d61c8861-f3cf-4450-b13f-797a2f7e668c\" (UID: \"d61c8861-f3cf-4450-b13f-797a2f7e668c\") "
Aug 04 18:49:14.053600 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.053439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls\") pod \"98dd49db-12e8-411c-8794-594728dfbed7\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") "
Aug 04 18:49:14.053600 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.053478    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76277a5a-9b0e-4cd0-a525-cf4324582fcd-plugins-config-volume\") pod \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\" (UID: \"76277a5a-9b0e-4cd0-a525-cf4324582fcd\") "
Aug 04 18:49:14.053600 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.053532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8g5v\" (UniqueName: \"kubernetes.io/projected/98dd49db-12e8-411c-8794-594728dfbed7-kube-api-access-b8g5v\") pod \"98dd49db-12e8-411c-8794-594728dfbed7\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") "
Aug 04 18:49:14.053600 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.053588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d61c8861-f3cf-4450-b13f-797a2f7e668c-plugins-config-volume\") pod \"d61c8861-f3cf-4450-b13f-797a2f7e668c\" (UID: \"d61c8861-f3cf-4450-b13f-797a2f7e668c\") "
Aug 04 18:49:14.053900 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.053627    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98dd49db-12e8-411c-8794-594728dfbed7-openshift-service-ca\") pod \"98dd49db-12e8-411c-8794-594728dfbed7\" (UID: \"98dd49db-12e8-411c-8794-594728dfbed7\") "
Aug 04 18:49:14.054301 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.054268    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d61c8861-f3cf-4450-b13f-797a2f7e668c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d61c8861-f3cf-4450-b13f-797a2f7e668c" (UID: "d61c8861-f3cf-4450-b13f-797a2f7e668c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:14.054395 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.054304    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98dd49db-12e8-411c-8794-594728dfbed7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "98dd49db-12e8-411c-8794-594728dfbed7" (UID: "98dd49db-12e8-411c-8794-594728dfbed7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:14.054708 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.054686    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76277a5a-9b0e-4cd0-a525-cf4324582fcd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76277a5a-9b0e-4cd0-a525-cf4324582fcd" (UID: "76277a5a-9b0e-4cd0-a525-cf4324582fcd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:14.056006 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.055976    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "98dd49db-12e8-411c-8794-594728dfbed7" (UID: "98dd49db-12e8-411c-8794-594728dfbed7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:49:14.056585 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.056548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d61c8861-f3cf-4450-b13f-797a2f7e668c-kube-api-access-52dz6" (OuterVolumeSpecName: "kube-api-access-52dz6") pod "d61c8861-f3cf-4450-b13f-797a2f7e668c" (UID: "d61c8861-f3cf-4450-b13f-797a2f7e668c"). InnerVolumeSpecName "kube-api-access-52dz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:14.056695 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.056618    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98dd49db-12e8-411c-8794-594728dfbed7-kube-api-access-b8g5v" (OuterVolumeSpecName: "kube-api-access-b8g5v") pod "98dd49db-12e8-411c-8794-594728dfbed7" (UID: "98dd49db-12e8-411c-8794-594728dfbed7"). InnerVolumeSpecName "kube-api-access-b8g5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:14.056784 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.056758    2565 generic.go:356] "Generic (PLEG): container finished" podID="98dd49db-12e8-411c-8794-594728dfbed7" containerID="27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2" exitCode=0
Aug 04 18:49:14.056852 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.056839    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"
Aug 04 18:49:14.056909 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.056846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s" event={"ID":"98dd49db-12e8-411c-8794-594728dfbed7","Type":"ContainerDied","Data":"27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2"}
Aug 04 18:49:14.056984 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.056949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s" event={"ID":"98dd49db-12e8-411c-8794-594728dfbed7","Type":"ContainerDied","Data":"185ad43c4bde0e77be41603d25d1b5d470ae33b488ed7687de86292373bbfac2"}
Aug 04 18:49:14.057046 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.056983    2565 scope.go:117] "RemoveContainer" containerID="27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2"
Aug 04 18:49:14.057046 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.057017    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76277a5a-9b0e-4cd0-a525-cf4324582fcd-kube-api-access-h6g4m" (OuterVolumeSpecName: "kube-api-access-h6g4m") pod "76277a5a-9b0e-4cd0-a525-cf4324582fcd" (UID: "76277a5a-9b0e-4cd0-a525-cf4324582fcd"). InnerVolumeSpecName "kube-api-access-h6g4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:14.058449 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.058428    2565 generic.go:356] "Generic (PLEG): container finished" podID="76277a5a-9b0e-4cd0-a525-cf4324582fcd" containerID="cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c" exitCode=0
Aug 04 18:49:14.058548 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.058481    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"
Aug 04 18:49:14.058548 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.058501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr" event={"ID":"76277a5a-9b0e-4cd0-a525-cf4324582fcd","Type":"ContainerDied","Data":"cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c"}
Aug 04 18:49:14.058662 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.058554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr" event={"ID":"76277a5a-9b0e-4cd0-a525-cf4324582fcd","Type":"ContainerDied","Data":"2b0374a4d8df04577dd6a00d374c868042bb69f5eb7bf67c4b8bfaa203fd2dd9"}
Aug 04 18:49:14.060082 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.060064    2565 generic.go:356] "Generic (PLEG): container finished" podID="d61c8861-f3cf-4450-b13f-797a2f7e668c" containerID="d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f" exitCode=0
Aug 04 18:49:14.060201 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.060182    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"
Aug 04 18:49:14.069113 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.069071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q" event={"ID":"d61c8861-f3cf-4450-b13f-797a2f7e668c","Type":"ContainerDied","Data":"d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f"}
Aug 04 18:49:14.069436 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.069417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q" event={"ID":"d61c8861-f3cf-4450-b13f-797a2f7e668c","Type":"ContainerDied","Data":"aacfe90d741139a06f63ea5d1e645bab6b5ef85159299ec6dfee851c4927559f"}
Aug 04 18:49:14.069534 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.069363    2565 scope.go:117] "RemoveContainer" containerID="27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2"
Aug 04 18:49:14.069760 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:49:14.069740    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2\": container with ID starting with 27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2 not found: ID does not exist" containerID="27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2"
Aug 04 18:49:14.069864 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.069768    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2"} err="failed to get container status \"27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2\": rpc error: code = NotFound desc = could not find container \"27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2\": container with ID starting with 27afd0a5bf5833adf1e6df160d19f714ba4667fc9d83f5f98ac8319febe413f2 not found: ID does not exist"
Aug 04 18:49:14.069864 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.069785    2565 scope.go:117] "RemoveContainer" containerID="cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c"
Aug 04 18:49:14.079716 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.079495    2565 scope.go:117] "RemoveContainer" containerID="cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c"
Aug 04 18:49:14.079862 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:49:14.079834    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c\": container with ID starting with cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c not found: ID does not exist" containerID="cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c"
Aug 04 18:49:14.079989 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.079871    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c"} err="failed to get container status \"cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c\": rpc error: code = NotFound desc = could not find container \"cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c\": container with ID starting with cda6aae6ec8c3a2ceb4478559f018bdedb3b2bfedb1417bfdd2cb930c50e115c not found: ID does not exist"
Aug 04 18:49:14.079989 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.079892    2565 scope.go:117] "RemoveContainer" containerID="d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f"
Aug 04 18:49:14.081909 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.081886    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"]
Aug 04 18:49:14.085041 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.085017    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4659f1-ff4fb464-t675s"]
Aug 04 18:49:14.088481 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.088465    2565 scope.go:117] "RemoveContainer" containerID="d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f"
Aug 04 18:49:14.088771 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:49:14.088751    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f\": container with ID starting with d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f not found: ID does not exist" containerID="d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f"
Aug 04 18:49:14.088849 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.088778    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f"} err="failed to get container status \"d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f\": rpc error: code = NotFound desc = could not find container \"d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f\": container with ID starting with d7e4682d82a1f9e9505260ee641934e5333c4ecc7da539ab81d00ba6eb93137f not found: ID does not exist"
Aug 04 18:49:14.095461 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.095440    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"]
Aug 04 18:49:14.099215 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.099193    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4659f1-796c48bcd-64c9q"]
Aug 04 18:49:14.108698 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.108651    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"]
Aug 04 18:49:14.110690 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.110669    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4659f1-587d7fb496-7mbhr"]
Aug 04 18:49:14.155265 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.155237    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6g4m\" (UniqueName: \"kubernetes.io/projected/76277a5a-9b0e-4cd0-a525-cf4324582fcd-kube-api-access-h6g4m\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:14.155265 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.155264    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52dz6\" (UniqueName: \"kubernetes.io/projected/d61c8861-f3cf-4450-b13f-797a2f7e668c-kube-api-access-52dz6\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:14.155505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.155281    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98dd49db-12e8-411c-8794-594728dfbed7-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:14.155505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.155295    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76277a5a-9b0e-4cd0-a525-cf4324582fcd-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:14.155505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.155307    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8g5v\" (UniqueName: \"kubernetes.io/projected/98dd49db-12e8-411c-8794-594728dfbed7-kube-api-access-b8g5v\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:14.155505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.155321    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d61c8861-f3cf-4450-b13f-797a2f7e668c-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:14.155505 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.155335    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98dd49db-12e8-411c-8794-594728dfbed7-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:14.222295 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.222262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:14.322498 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:14.322466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:16.066101 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:16.066068    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76277a5a-9b0e-4cd0-a525-cf4324582fcd" path="/var/lib/kubelet/pods/76277a5a-9b0e-4cd0-a525-cf4324582fcd/volumes"
Aug 04 18:49:16.066484 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:16.066453    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98dd49db-12e8-411c-8794-594728dfbed7" path="/var/lib/kubelet/pods/98dd49db-12e8-411c-8794-594728dfbed7/volumes"
Aug 04 18:49:16.066765 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:16.066751    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d61c8861-f3cf-4450-b13f-797a2f7e668c" path="/var/lib/kubelet/pods/d61c8861-f3cf-4450-b13f-797a2f7e668c/volumes"
Aug 04 18:49:20.314287 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:20.314256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:20.372338 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:20.372301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:20.755326 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:20.755290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:20.855947 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:20.855908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:31.287052 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.287008    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"]
Aug 04 18:49:31.288851 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.288394    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx" podUID="ca14d431-209e-48bf-b948-9a13072bf6bc" containerName="maas-api" containerID="cri-o://c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b" gracePeriod=30
Aug 04 18:49:31.346687 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.346655    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"]
Aug 04 18:49:31.346908 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.346879    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf" podUID="9f40cf56-1b96-4f86-b21e-39b722cea603" containerName="payload-pre-processing" containerID="cri-o://44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742" gracePeriod=30
Aug 04 18:49:31.514908 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.514313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:31.577570 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.577527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:31.607261 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.607236    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:49:31.627705 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.627675    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn674\" (UniqueName: \"kubernetes.io/projected/ca14d431-209e-48bf-b948-9a13072bf6bc-kube-api-access-gn674\") pod \"ca14d431-209e-48bf-b948-9a13072bf6bc\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") "
Aug 04 18:49:31.627890 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.627779    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca14d431-209e-48bf-b948-9a13072bf6bc-openshift-service-ca\") pod \"ca14d431-209e-48bf-b948-9a13072bf6bc\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") "
Aug 04 18:49:31.627890 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.627868    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls\") pod \"ca14d431-209e-48bf-b948-9a13072bf6bc\" (UID: \"ca14d431-209e-48bf-b948-9a13072bf6bc\") "
Aug 04 18:49:31.628235 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.628196    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca14d431-209e-48bf-b948-9a13072bf6bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca14d431-209e-48bf-b948-9a13072bf6bc" (UID: "ca14d431-209e-48bf-b948-9a13072bf6bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:31.630393 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.630355    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca14d431-209e-48bf-b948-9a13072bf6bc" (UID: "ca14d431-209e-48bf-b948-9a13072bf6bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:49:31.630393 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.630365    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca14d431-209e-48bf-b948-9a13072bf6bc-kube-api-access-gn674" (OuterVolumeSpecName: "kube-api-access-gn674") pod "ca14d431-209e-48bf-b948-9a13072bf6bc" (UID: "ca14d431-209e-48bf-b948-9a13072bf6bc"). InnerVolumeSpecName "kube-api-access-gn674". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:31.634122 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.634102    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:49:31.729125 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.729090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vhkb\" (UniqueName: \"kubernetes.io/projected/9f40cf56-1b96-4f86-b21e-39b722cea603-kube-api-access-9vhkb\") pod \"9f40cf56-1b96-4f86-b21e-39b722cea603\" (UID: \"9f40cf56-1b96-4f86-b21e-39b722cea603\") "
Aug 04 18:49:31.729343 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.729152    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f40cf56-1b96-4f86-b21e-39b722cea603-plugins-config-volume\") pod \"9f40cf56-1b96-4f86-b21e-39b722cea603\" (UID: \"9f40cf56-1b96-4f86-b21e-39b722cea603\") "
Aug 04 18:49:31.729424 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.729402    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca14d431-209e-48bf-b948-9a13072bf6bc-openshift-service-ca\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:31.729485 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.729430    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca14d431-209e-48bf-b948-9a13072bf6bc-maas-api-tls\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:31.729485 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.729446    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn674\" (UniqueName: \"kubernetes.io/projected/ca14d431-209e-48bf-b948-9a13072bf6bc-kube-api-access-gn674\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:31.729597 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.729580    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f40cf56-1b96-4f86-b21e-39b722cea603-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f40cf56-1b96-4f86-b21e-39b722cea603" (UID: "9f40cf56-1b96-4f86-b21e-39b722cea603"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:49:31.731280 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.731254    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f40cf56-1b96-4f86-b21e-39b722cea603-kube-api-access-9vhkb" (OuterVolumeSpecName: "kube-api-access-9vhkb") pod "9f40cf56-1b96-4f86-b21e-39b722cea603" (UID: "9f40cf56-1b96-4f86-b21e-39b722cea603"). InnerVolumeSpecName "kube-api-access-9vhkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:49:31.830334 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.830238    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vhkb\" (UniqueName: \"kubernetes.io/projected/9f40cf56-1b96-4f86-b21e-39b722cea603-kube-api-access-9vhkb\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:31.830334 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.830269    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f40cf56-1b96-4f86-b21e-39b722cea603-plugins-config-volume\") on node \"ip-10-0-140-41.ec2.internal\" DevicePath \"\""
Aug 04 18:49:31.864571 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:31.864543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:32.164402 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.164364    2565 generic.go:356] "Generic (PLEG): container finished" podID="9f40cf56-1b96-4f86-b21e-39b722cea603" containerID="44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742" exitCode=0
Aug 04 18:49:32.164636 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.164453    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"
Aug 04 18:49:32.164636 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.164477    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf" event={"ID":"9f40cf56-1b96-4f86-b21e-39b722cea603","Type":"ContainerDied","Data":"44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742"}
Aug 04 18:49:32.164636 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.164627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf" event={"ID":"9f40cf56-1b96-4f86-b21e-39b722cea603","Type":"ContainerDied","Data":"53a49879d3143e85c363d250d3233c18d52d2e60d1f868a179dc24d517272cd2"}
Aug 04 18:49:32.164833 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.164660    2565 scope.go:117] "RemoveContainer" containerID="44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742"
Aug 04 18:49:32.166300 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.166275    2565 generic.go:356] "Generic (PLEG): container finished" podID="ca14d431-209e-48bf-b948-9a13072bf6bc" containerID="c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b" exitCode=0
Aug 04 18:49:32.166415 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.166323    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"
Aug 04 18:49:32.166415 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.166315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx" event={"ID":"ca14d431-209e-48bf-b948-9a13072bf6bc","Type":"ContainerDied","Data":"c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b"}
Aug 04 18:49:32.166507 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.166448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx" event={"ID":"ca14d431-209e-48bf-b948-9a13072bf6bc","Type":"ContainerDied","Data":"f804e27d5eaa73599e2fba8f34775f35ae50addb84571bc6fd602a7ad48b7d74"}
Aug 04 18:49:32.174019 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.174002    2565 scope.go:117] "RemoveContainer" containerID="44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742"
Aug 04 18:49:32.174315 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:49:32.174298    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742\": container with ID starting with 44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742 not found: ID does not exist" containerID="44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742"
Aug 04 18:49:32.174368 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.174324    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742"} err="failed to get container status \"44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742\": rpc error: code = NotFound desc = could not find container \"44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742\": container with ID starting with 44dc2583b224a9ab50e8c5b537914cc75ea595f13dfe97eddaaa0c40e9b7d742 not found: ID does not exist"
Aug 04 18:49:32.174368 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.174341    2565 scope.go:117] "RemoveContainer" containerID="c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b"
Aug 04 18:49:32.181960 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.181934    2565 scope.go:117] "RemoveContainer" containerID="c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b"
Aug 04 18:49:32.182380 ip-10-0-140-41 kubenswrapper[2565]: E0804 18:49:32.182352    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b\": container with ID starting with c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b not found: ID does not exist" containerID="c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b"
Aug 04 18:49:32.182486 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.182416    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b"} err="failed to get container status \"c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b\": rpc error: code = NotFound desc = could not find container \"c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b\": container with ID starting with c62365b04505f4f26829d1930e3feaea1e57016f9b3b6c32ba7a4d07a5b4254b not found: ID does not exist"
Aug 04 18:49:32.185027 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.185006    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"]
Aug 04 18:49:32.188555 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.188535    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9be3f-5d97688d88-qjvmx"]
Aug 04 18:49:32.198277 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.198250    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"]
Aug 04 18:49:32.201637 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:32.201614    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e9be3f-6dc5fc7c4d-jqwqf"]
Aug 04 18:49:34.065476 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:34.065443    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f40cf56-1b96-4f86-b21e-39b722cea603" path="/var/lib/kubelet/pods/9f40cf56-1b96-4f86-b21e-39b722cea603/volumes"
Aug 04 18:49:34.065874 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:34.065853    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca14d431-209e-48bf-b948-9a13072bf6bc" path="/var/lib/kubelet/pods/ca14d431-209e-48bf-b948-9a13072bf6bc/volumes"
Aug 04 18:49:37.763723 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:37.763687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:38.113407 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:38.113309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:38.887143 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:38.887104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:39.766011 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:39.765983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:40.871092 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:40.871055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:44.363216 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:44.363188    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59ccb7c8d4-8lfz8_cb1970af-d707-4dd5-b81c-de172058704d/manager/0.log"
Aug 04 18:49:44.698100 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:44.698072    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-kqd7g_e367b66c-ace3-405b-b891-1a0863821fc6/copy-manifests/0.log"
Aug 04 18:49:44.709617 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:44.709568    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-kqd7g_e367b66c-ace3-405b-b891-1a0863821fc6/manager/0.log"
Aug 04 18:49:45.276898 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:45.276863    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-757fdc8c4c-766p5_c9412a3a-a429-4660-b29a-c12b3697dbee/maas-api/0.log"
Aug 04 18:49:45.729628 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:45.729588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-lc6d9_8231a682-3694-435e-b6be-7ddacc9221b7/postgres/0.log"
Aug 04 18:49:47.618803 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:47.618773    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q7n7r_1eab0375-0d78-40ed-824a-a94efcf0686d/discovery/0.log"
Aug 04 18:49:48.083672 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:48.083644    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kxx8m_e94ea3e8-2515-42d8-95a2-6d6960813964/payload-pre-processing/0.log"
Aug 04 18:49:48.200516 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:48.200486    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q425w_ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46/payload-processing/0.log"
Aug 04 18:49:48.655917 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:48.655867    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gxn6q_9a86e8f5-892b-4b12-88f7-ed8d2b5ec315/main/0.log"
Aug 04 18:49:48.764456 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:48.764426    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-p2tx6_ee72a9de-48c4-4062-a013-8b2f6dc4f874/main/0.log"
Aug 04 18:49:48.995043 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:48.994942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnrrz6_699e273f-1614-4dae-867f-4e4f3592e40a/main/0.log"
Aug 04 18:49:52.089114 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:52.089079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:55.036118 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:55.036085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:55.818717 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:55.818682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log" limit=1024
Aug 04 18:49:59.044940 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:59.044902    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-klx4c_8e562400-1f9a-4afc-a619-692f88f28a7c/global-pull-secret-syncer/0.log"
Aug 04 18:49:59.172834 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:59.172780    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6f6dw_57a3cc32-de81-472c-9981-4ebb1727ebb7/konnectivity-agent/0.log"
Aug 04 18:49:59.271945 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:49:59.271916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-41.ec2.internal_24c79eaecf472aa8b18dbcd77a42fa38/haproxy/0.log"
Aug 04 18:50:05.604038 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.604006    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-mqkb2_a5314310-d5cd-4777-8d51-a03cb7e8cdaf/cluster-monitoring-operator/0.log"
Aug 04 18:50:05.635972 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.635944    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lmzg7_54cfdead-6d17-4e5e-81da-741b32842ad1/kube-state-metrics/0.log"
Aug 04 18:50:05.653798 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.653771    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lmzg7_54cfdead-6d17-4e5e-81da-741b32842ad1/kube-rbac-proxy-main/0.log"
Aug 04 18:50:05.676693 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.676667    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lmzg7_54cfdead-6d17-4e5e-81da-741b32842ad1/kube-rbac-proxy-self/0.log"
Aug 04 18:50:05.704913 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.704889    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-bf96b58cb-mtrwb_909414d5-2276-4709-a111-c1291d0e275c/metrics-server/0.log"
Aug 04 18:50:05.729146 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.729124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-nxq4p_0e297c4b-e335-4108-bf83-fd805fcf090c/monitoring-plugin/0.log"
Aug 04 18:50:05.912732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.912693    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xvrsn_08e8855b-e6f6-488f-9b06-fec999662064/node-exporter/0.log"
Aug 04 18:50:05.939331 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.939301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xvrsn_08e8855b-e6f6-488f-9b06-fec999662064/kube-rbac-proxy/0.log"
Aug 04 18:50:05.964268 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:05.964241    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xvrsn_08e8855b-e6f6-488f-9b06-fec999662064/init-textfile/0.log"
Aug 04 18:50:06.115022 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.114994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d436223-ab74-43ef-98df-ca5699e678e6/prometheus/0.log"
Aug 04 18:50:06.136337 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.136314    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d436223-ab74-43ef-98df-ca5699e678e6/config-reloader/0.log"
Aug 04 18:50:06.158636 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.158615    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d436223-ab74-43ef-98df-ca5699e678e6/thanos-sidecar/0.log"
Aug 04 18:50:06.180985 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.180960    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d436223-ab74-43ef-98df-ca5699e678e6/kube-rbac-proxy-web/0.log"
Aug 04 18:50:06.202068 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.202039    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d436223-ab74-43ef-98df-ca5699e678e6/kube-rbac-proxy/0.log"
Aug 04 18:50:06.221903 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.221876    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d436223-ab74-43ef-98df-ca5699e678e6/kube-rbac-proxy-thanos/0.log"
Aug 04 18:50:06.242529 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.242506    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d436223-ab74-43ef-98df-ca5699e678e6/init-config-reloader/0.log"
Aug 04 18:50:06.278997 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.278967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-76jcl_a287b924-fe8d-47ef-a949-9247f781aba7/prometheus-operator/0.log"
Aug 04 18:50:06.298447 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.298413    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-76jcl_a287b924-fe8d-47ef-a949-9247f781aba7/kube-rbac-proxy/0.log"
Aug 04 18:50:06.324641 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.324573    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-7dvmz_3a6165fd-ad6f-41da-b974-438d9298231a/prometheus-operator-admission-webhook/0.log"
Aug 04 18:50:06.445119 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.445073    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dd876f8f4-4q7hm_21375c41-a4ec-4a0e-91c9-66a13d16b25b/thanos-query/0.log"
Aug 04 18:50:06.464623 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.464595    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dd876f8f4-4q7hm_21375c41-a4ec-4a0e-91c9-66a13d16b25b/kube-rbac-proxy-web/0.log"
Aug 04 18:50:06.484361 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.484341    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dd876f8f4-4q7hm_21375c41-a4ec-4a0e-91c9-66a13d16b25b/kube-rbac-proxy/0.log"
Aug 04 18:50:06.503608 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.503586    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dd876f8f4-4q7hm_21375c41-a4ec-4a0e-91c9-66a13d16b25b/prom-label-proxy/0.log"
Aug 04 18:50:06.523606 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.523586    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dd876f8f4-4q7hm_21375c41-a4ec-4a0e-91c9-66a13d16b25b/kube-rbac-proxy-rules/0.log"
Aug 04 18:50:06.542517 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:06.542497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dd876f8f4-4q7hm_21375c41-a4ec-4a0e-91c9-66a13d16b25b/kube-rbac-proxy-metrics/0.log"
Aug 04 18:50:08.568130 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:08.568095    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/1.log"
Aug 04 18:50:08.572444 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:08.572419    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-nwjch_8e8bb1ad-3b9e-4daf-863b-3005f885d1a3/console-operator/2.log"
Aug 04 18:50:09.511638 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.511524    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"]
Aug 04 18:50:09.512186 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512166    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d61c8861-f3cf-4450-b13f-797a2f7e668c" containerName="payload-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512190    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d61c8861-f3cf-4450-b13f-797a2f7e668c" containerName="payload-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512203    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba04015-2bf6-4032-b31b-68c4573136f5" containerName="maas-api"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512213    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba04015-2bf6-4032-b31b-68c4573136f5" containerName="maas-api"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512222    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="662c83a5-00eb-4b69-a94c-f056865715d6" containerName="payload-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512231    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="662c83a5-00eb-4b69-a94c-f056865715d6" containerName="payload-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512244    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98dd49db-12e8-411c-8794-594728dfbed7" containerName="maas-api"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512252    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="98dd49db-12e8-411c-8794-594728dfbed7" containerName="maas-api"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512261    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef2e3fa-b175-461a-bbac-1c36af40d570" containerName="payload-pre-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512269    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef2e3fa-b175-461a-bbac-1c36af40d570" containerName="payload-pre-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512278    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76277a5a-9b0e-4cd0-a525-cf4324582fcd" containerName="payload-pre-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512286    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="76277a5a-9b0e-4cd0-a525-cf4324582fcd" containerName="payload-pre-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512295    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5294282-0b5d-45aa-9736-a44f67c70b5d" containerName="payload-processing"
Aug 04 18:50:09.512304 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512303    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5294282-0b5d-45aa-9736-a44f67c70b5d" containerName="payload-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512316    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb6068c-1de6-43a7-a022-acd5ef9d3ebe" containerName="payload-pre-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512324    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb6068c-1de6-43a7-a022-acd5ef9d3ebe" containerName="payload-pre-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512332    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14fc67d2-fa23-431a-a1db-526c10bf6bff" containerName="payload-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512340    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fc67d2-fa23-431a-a1db-526c10bf6bff" containerName="payload-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512353    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f40cf56-1b96-4f86-b21e-39b722cea603" containerName="payload-pre-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512358    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f40cf56-1b96-4f86-b21e-39b722cea603" containerName="payload-pre-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512377    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca14d431-209e-48bf-b948-9a13072bf6bc" containerName="maas-api"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512382    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca14d431-209e-48bf-b948-9a13072bf6bc" containerName="maas-api"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512471    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d61c8861-f3cf-4450-b13f-797a2f7e668c" containerName="payload-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512480    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="662c83a5-00eb-4b69-a94c-f056865715d6" containerName="payload-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512490    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="98dd49db-12e8-411c-8794-594728dfbed7" containerName="maas-api"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512498    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="14fc67d2-fa23-431a-a1db-526c10bf6bff" containerName="payload-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512508    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef2e3fa-b175-461a-bbac-1c36af40d570" containerName="payload-pre-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512513    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb6068c-1de6-43a7-a022-acd5ef9d3ebe" containerName="payload-pre-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512518    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5294282-0b5d-45aa-9736-a44f67c70b5d" containerName="payload-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512523    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f40cf56-1b96-4f86-b21e-39b722cea603" containerName="payload-pre-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512528    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba04015-2bf6-4032-b31b-68c4573136f5" containerName="maas-api"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512535    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="76277a5a-9b0e-4cd0-a525-cf4324582fcd" containerName="payload-pre-processing"
Aug 04 18:50:09.512732 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.512540    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca14d431-209e-48bf-b948-9a13072bf6bc" containerName="maas-api"
Aug 04 18:50:09.515723 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.515708    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.517987 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.517967    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lbkp\"/\"kube-root-ca.crt\""
Aug 04 18:50:09.518798 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.518776    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8lbkp\"/\"default-dockercfg-4g7qg\""
Aug 04 18:50:09.518911 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.518796    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lbkp\"/\"openshift-service-ca.crt\""
Aug 04 18:50:09.522445 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.522423    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"]
Aug 04 18:50:09.684569 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.684537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-podres\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.684955 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.684593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-lib-modules\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.684955 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.684648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-proc\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.684955 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.684723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-sys\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.684955 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.684749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79sl9\" (UniqueName: \"kubernetes.io/projected/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-kube-api-access-79sl9\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786174 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-lib-modules\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786174 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-proc\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-sys\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79sl9\" (UniqueName: \"kubernetes.io/projected/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-kube-api-access-79sl9\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-lib-modules\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786280    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-proc\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-sys\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-podres\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.786413 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.786382    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-podres\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.794315 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.794293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79sl9\" (UniqueName: \"kubernetes.io/projected/e76257a6-fc9f-45ac-a4f0-ccda8e9228d4-kube-api-access-79sl9\") pod \"perf-node-gather-daemonset-25jbl\" (UID: \"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4\") " pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.822655 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.822630    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-2jzgz_8d15cd03-d6ca-4ccf-9bdf-e218d90df70e/volume-data-source-validator/0.log"
Aug 04 18:50:09.826577 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.826554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:09.958739 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:09.958713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"]
Aug 04 18:50:09.960564 ip-10-0-140-41 kubenswrapper[2565]: W0804 18:50:09.960530    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode76257a6_fc9f_45ac_a4f0_ccda8e9228d4.slice/crio-b7c6920a7453a1e362145a99da22fafa63fa458f1b8b06791c39e22c00152cdd WatchSource:0}: Error finding container b7c6920a7453a1e362145a99da22fafa63fa458f1b8b06791c39e22c00152cdd: Status 404 returned error can't find the container with id b7c6920a7453a1e362145a99da22fafa63fa458f1b8b06791c39e22c00152cdd
Aug 04 18:50:10.355894 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:10.355789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl" event={"ID":"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4","Type":"ContainerStarted","Data":"9e57c41b2f5f9578f6c348dc62c81ba9904e41a2201ac043ee48b5fe23cf7c91"}
Aug 04 18:50:10.355894 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:10.355853    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:10.355894 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:10.355871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl" event={"ID":"e76257a6-fc9f-45ac-a4f0-ccda8e9228d4","Type":"ContainerStarted","Data":"b7c6920a7453a1e362145a99da22fafa63fa458f1b8b06791c39e22c00152cdd"}
Aug 04 18:50:10.371119 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:10.371063    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl" podStartSLOduration=1.3710449869999999 podStartE2EDuration="1.371044987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:50:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:50:10.369864734 +0000 UTC m=+3804.745810828" watchObservedRunningTime="2026-08-04 18:50:10.371044987 +0000 UTC m=+3804.746991078"
Aug 04 18:50:11.000053 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:11.000013    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-24xzt_c88e9a87-eb1f-4b5b-850b-6b875d47aeaf/dns/0.log"
Aug 04 18:50:11.021717 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:11.021688    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-24xzt_c88e9a87-eb1f-4b5b-850b-6b875d47aeaf/kube-rbac-proxy/0.log"
Aug 04 18:50:11.210032 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:11.210000    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qr9v_275a9e0e-2f45-401e-9fdc-718d96ed4b4f/dns-node-resolver/0.log"
Aug 04 18:50:11.772803 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:11.772757    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6788467c67-bmdkk_e6463be9-90d7-481c-b761-daca4af7eb17/registry/0.log"
Aug 04 18:50:11.815061 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:11.815031    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gqsbj_9e53d194-23f4-4468-aadc-7ed60f31d5f9/node-ca/0.log"
Aug 04 18:50:12.913797 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:12.913765    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q7n7r_1eab0375-0d78-40ed-824a-a94efcf0686d/discovery/0.log"
Aug 04 18:50:13.042073 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:13.042048    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kxx8m_e94ea3e8-2515-42d8-95a2-6d6960813964/payload-pre-processing/0.log"
Aug 04 18:50:13.072327 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:13.072294    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q425w_ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46/payload-processing/0.log"
Aug 04 18:50:13.884580 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:13.884548    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2lw7t_881e50bc-0fb6-49af-8435-aa822c5a73a6/serve-healthcheck-canary/0.log"
Aug 04 18:50:14.554075 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:14.554039    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w89xx_9d36ed11-34b6-4eb0-bb57-1274343ee28e/kube-rbac-proxy/0.log"
Aug 04 18:50:14.573572 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:14.573547    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w89xx_9d36ed11-34b6-4eb0-bb57-1274343ee28e/exporter/0.log"
Aug 04 18:50:14.592608 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:14.592583    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w89xx_9d36ed11-34b6-4eb0-bb57-1274343ee28e/extractor/0.log"
Aug 04 18:50:16.370518 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:16.370494    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8lbkp/perf-node-gather-daemonset-25jbl"
Aug 04 18:50:17.142151 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:17.142114    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59ccb7c8d4-8lfz8_cb1970af-d707-4dd5-b81c-de172058704d/manager/0.log"
Aug 04 18:50:17.322341 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:17.322272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-kqd7g_e367b66c-ace3-405b-b891-1a0863821fc6/manager/0.log"
Aug 04 18:50:17.337916 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:17.337886    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddfbf4d9-kqd7g_e367b66c-ace3-405b-b891-1a0863821fc6/copy-manifests/0.log"
Aug 04 18:50:18.751949 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:18.751920    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-564c4ff8f7-8m4z4_b5a8e5c3-29b3-452f-9140-85c45408d382/manager/0.log"
Aug 04 18:50:19.919200 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:19.919167    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q7n7r_1eab0375-0d78-40ed-824a-a94efcf0686d/discovery/0.log"
Aug 04 18:50:19.987512 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:19.987483    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kxx8m_e94ea3e8-2515-42d8-95a2-6d6960813964/payload-pre-processing/0.log"
Aug 04 18:50:20.008916 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:20.008892    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q425w_ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46/payload-processing/0.log"
Aug 04 18:50:21.563594 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:21.563560    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q7n7r_1eab0375-0d78-40ed-824a-a94efcf0686d/discovery/0.log"
Aug 04 18:50:21.656189 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:21.656155    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kxx8m_e94ea3e8-2515-42d8-95a2-6d6960813964/payload-pre-processing/0.log"
Aug 04 18:50:21.682764 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:21.682735    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q425w_ae8456a8-0a6e-42be-b2d3-c1a1de6b4d46/payload-processing/0.log"
Aug 04 18:50:23.791479 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:23.791453    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-4n45f_f21a9ee4-e688-48a4-9ab3-6544dcb6cb39/migrator/0.log"
Aug 04 18:50:23.817956 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:23.817932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-4n45f_f21a9ee4-e688-48a4-9ab3-6544dcb6cb39/graceful-termination/0.log"
Aug 04 18:50:25.249184 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.249156    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdgb2_a004816b-7a77-4c0d-b216-55cc1a10c5ad/kube-multus-additional-cni-plugins/0.log"
Aug 04 18:50:25.269067 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.269032    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdgb2_a004816b-7a77-4c0d-b216-55cc1a10c5ad/egress-router-binary-copy/0.log"
Aug 04 18:50:25.287239 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.287210    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdgb2_a004816b-7a77-4c0d-b216-55cc1a10c5ad/cni-plugins/0.log"
Aug 04 18:50:25.305697 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.305677    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdgb2_a004816b-7a77-4c0d-b216-55cc1a10c5ad/bond-cni-plugin/0.log"
Aug 04 18:50:25.324510 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.324489    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdgb2_a004816b-7a77-4c0d-b216-55cc1a10c5ad/routeoverride-cni/0.log"
Aug 04 18:50:25.344923 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.344900    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdgb2_a004816b-7a77-4c0d-b216-55cc1a10c5ad/whereabouts-cni-bincopy/0.log"
Aug 04 18:50:25.363242 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.363218    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdgb2_a004816b-7a77-4c0d-b216-55cc1a10c5ad/whereabouts-cni/0.log"
Aug 04 18:50:25.582214 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.582189    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pkt8g_73af7eef-da57-4f85-afd7-03d2afd93fa5/kube-multus/0.log"
Aug 04 18:50:25.642969 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.642945    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-npn9x_4e559837-8dd8-48d2-979d-b0dd4c207878/network-metrics-daemon/0.log"
Aug 04 18:50:25.659772 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:25.659750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-npn9x_4e559837-8dd8-48d2-979d-b0dd4c207878/kube-rbac-proxy/0.log"
Aug 04 18:50:26.475765 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.475723    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-controller/0.log"
Aug 04 18:50:26.490822 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.490779    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/0.log"
Aug 04 18:50:26.490931 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.490868    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovn-acl-logging/1.log"
Aug 04 18:50:26.509197 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.509179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/kube-rbac-proxy-node/0.log"
Aug 04 18:50:26.529755 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.529733    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/kube-rbac-proxy-ovn-metrics/0.log"
Aug 04 18:50:26.546314 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.546292    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/northd/0.log"
Aug 04 18:50:26.565375 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.565358    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/nbdb/0.log"
Aug 04 18:50:26.585068 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.585050    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/sbdb/0.log"
Aug 04 18:50:26.635310 ip-10-0-140-41 kubenswrapper[2565]: I0804 18:50:26.635286    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jbsc4_b4a73f01-afac-4068-a7ca-90cfc5465bf5/ovnkube-controller/0.log"