Jul 30 09:47:51.311211 ip-10-0-131-179 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 09:47:51.311224 ip-10-0-131-179 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 09:47:51.311233 ip-10-0-131-179 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 09:47:51.311520 ip-10-0-131-179 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 09:48:02.931418 ip-10-0-131-179 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 09:48:02.931460 ip-10-0-131-179 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5743f029851043b99a9540f61ef1a595 --
Jul 30 09:49:41.515131 ip-10-0-131-179 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 09:49:41.992500 ip-10-0-131-179 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 09:49:41.992500 ip-10-0-131-179 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 09:49:41.992500 ip-10-0-131-179 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 09:49:41.992500 ip-10-0-131-179 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 09:49:41.992500 ip-10-0-131-179 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 09:49:41.995679 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:41.995585    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 09:49:41.999390 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999374    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 09:49:41.999390 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999390    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999396    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999401    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999405    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999409    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999412    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999415    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999417    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999421    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999424    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999427    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999431    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999434    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999437    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999440    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999443    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999446    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999448    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999451    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 09:49:41.999459 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999454    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999457    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999459    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999462    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999465    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999469    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999473    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999476    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999479    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999482    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999485    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999488    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999492    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999495    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999499    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999502    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999505    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999508    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999518    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999520    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 09:49:41.999984 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999523    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999526    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999528    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999531    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999534    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999537    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999540    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999543    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999545    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999549    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999551    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999554    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999557    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999559    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999563    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999566    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999568    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999571    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999574    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999576    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 09:49:42.000474 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999579    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999581    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999584    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999587    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999589    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999592    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999594    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999597    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999599    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999602    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999604    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999610    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999613    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999616    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999618    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999621    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999623    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999626    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999628    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999631    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 09:49:42.000992 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999633    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999636    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999638    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999641    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999644    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999646    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999654    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999657    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999660    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999663    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999665    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999668    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999671    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999673    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999676    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999678    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999681    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999684    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:41.999686    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000409    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 09:49:42.001484 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000416    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000419    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000421    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000425    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000429    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000432    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000434    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000437    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000440    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000443    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000446    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000448    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000451    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000454    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000456    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000459    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000461    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000464    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000470    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 09:49:42.001981 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000474    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000479    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000482    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000485    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000489    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000491    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000494    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000497    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000500    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000503    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000505    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000508    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000510    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000514    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000517    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000522    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000527    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000530    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000534    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000537    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 09:49:42.002451 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000541    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000544    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000547    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000549    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000552    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000554    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000557    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000560    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000562    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000565    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000567    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000572    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000575    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000577    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000580    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000583    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000586    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000588    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000591    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000594    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 09:49:42.002975 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000596    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000599    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000602    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000604    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000606    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000609    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000612    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000614    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000617    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000619    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000622    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000625    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000629    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000631    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000634    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000637    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000639    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000642    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000644    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000647    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 09:49:42.003486 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000650    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000652    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000655    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000658    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000661    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000664    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000666    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000669    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000671    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000674    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000677    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000679    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000682    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000684    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000687    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000690    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000692    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000695    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.000698    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001106    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 09:49:42.004008 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001112    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001115    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001118    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001121    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001124    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001127    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001130    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001132    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001135    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001138    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001140    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001143    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001146    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001148    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001151    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001154    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001157    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001160    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001163    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001166    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 09:49:42.004497 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001169    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001171    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001174    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001177    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001179    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001182    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001185    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001187    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001190    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001193    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001195    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001198    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001200    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001203    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001205    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001208    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001211    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001214    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001217    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001221    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 09:49:42.005041 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001224    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001226    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001229    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001231    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001234    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001237    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001239    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001245    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001249    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001252    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001255    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001258    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001261    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001264    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001266    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001269    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001272    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001274    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001277    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001279    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 09:49:42.005625 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001282    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001285    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001287    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001290    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001293    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001295    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001298    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001301    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001303    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001306    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001309    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001311    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001314    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001316    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001319    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001321    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001324    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001326    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001331    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001334    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 09:49:42.006134 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001337    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001340    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001342    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001345    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001347    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001350    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001354    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001358    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001362    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001364    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001367    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001370    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001372    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001375    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001378    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001381    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001384    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.001387    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001481    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001492    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 09:49:42.006654 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001502    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001507    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001512    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001516    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001521    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001525    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001529    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001532    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001535    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001538    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001543    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001549    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001552    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001556    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001559    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001562    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001567    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001570    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001573    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001577    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001580    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001584    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001588    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 09:49:42.007172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001591    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001594    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001597    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001600    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001603    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001607    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001610    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001614    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001617    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001620    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001623    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001626    2581 flags.go:64] FLAG: --enable-server="true"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001630    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001635    2581 flags.go:64] FLAG: --event-burst="100"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001638    2581 flags.go:64] FLAG: --event-qps="50"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001642    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001645    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001648    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001651    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001656    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001661    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001664    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001667    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001671    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001674    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 09:49:42.007732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001677    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001680    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001683    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001686    2581 flags.go:64] FLAG: --feature-gates=""
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001690    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001693    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001696    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001700    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001703    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001706    2581 flags.go:64] FLAG: --help="false"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001709    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001712    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001715    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001718    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001721    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001725    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001728    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001731    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001734    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001737    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001740    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001744    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001746    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001750    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 09:49:42.008408 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001753    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001756    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001761    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001766    2581 flags.go:64] FLAG: --lock-file=""
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001769    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001772    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001775    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001780    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001783    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001786    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001789    2581 flags.go:64] FLAG: --logging-format="text"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001792    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001795    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001798    2581 flags.go:64] FLAG: --manifest-url=""
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001801    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001806    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001809    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001813    2581 flags.go:64] FLAG: --max-pods="110"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001828    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001832    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001835    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001838    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001841    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001844    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001847    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 09:49:42.009061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001855    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001858    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001861    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001865    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001868    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001874    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001878    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001881    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001884    2581 flags.go:64] FLAG: --port="10250"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001888    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001892    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04475e664055d2600"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001896    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001899    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001902    2581 flags.go:64] FLAG: --register-node="true"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001905    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001910    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001913    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001916    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001919    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001923    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001926    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001929    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001933    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001936    2581 flags.go:64] FLAG: --runonce="false"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001939    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 09:49:42.009684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001942    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001945    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001949    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001952    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001955    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001958    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001961    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001964    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001967    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001971    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001974    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001977    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001980    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001983    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001989    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001992    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.001996    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002000    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002005    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002008    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002011    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002014    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002017    2581 flags.go:64] FLAG: --v="2"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002021    2581 flags.go:64] FLAG: --version="false"
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002025    2581 flags.go:64] FLAG: --vmodule=""
Jul 30 09:49:42.010359 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002030    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.002033    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002155    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002159    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002162    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002165    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002168    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002173    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002176    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002179    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002182    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002185    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002188    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002191    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002194    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002197    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002199    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002202    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002205    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 09:49:42.011003 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002208    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002211    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002214    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002218    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002222    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002225    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002229    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002232    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002235    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002237    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002240    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002242    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002245    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002248    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002250    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002253    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002256    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002258    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002261    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002264    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 09:49:42.011478 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002266    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002269    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002272    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002274    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002277    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002280    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002282    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002285    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002288    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002290    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002293    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002296    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002299    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002301    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002304    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002307    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002311    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002314    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002318    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002320    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 09:49:42.012056 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002323    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002326    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002329    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002332    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002334    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002337    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002339    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002342    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002344    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002347    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002349    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002352    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002355    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002358    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002360    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002363    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002366    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002368    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002371    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002373    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 09:49:42.012543 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002376    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002379    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002381    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002383    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002386    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002390    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002393    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002397    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002401    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002404    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002408    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002411    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002413    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002416    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002418    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002421    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002424    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002428    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002431    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 09:49:42.013051 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002434    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002437    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.002440    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.003106    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.011560    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.011583    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.012486    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.012496    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012573    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012582    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012587    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012591    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012595    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012600    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012604    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 09:49:42.013697 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012609    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012613    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012617    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012621    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012625    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012629    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012633    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012637    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012641    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012644    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012648    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012652    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012658    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012662    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012666    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012670    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012674    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012678    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012682    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 09:49:42.014315 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012685    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012689    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012693    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012698    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012703    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012707    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012711    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012714    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012718    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012721    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012725    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012729    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012733    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012737    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012741    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012746    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012751    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012756    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012760    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 09:49:42.015070 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012764    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012769    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012774    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012779    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012783    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012793    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012797    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012801    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012805    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012809    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012812    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012828    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012833    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012837    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012840    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012844    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012848    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012853    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012858    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 09:49:42.015553 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012862    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012866    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012869    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012873    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012876    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012881    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012884    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012888    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012891    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012894    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012899    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012903    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012907    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012910    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012913    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012917    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012920    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012924    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012928    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012932    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 09:49:42.016040 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012935    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012939    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012943    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012946    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012949    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012954    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012958    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012961    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012965    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012969    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012973    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012977    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012982    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012985    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.012989    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 09:49:42.016565 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.012995    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013316    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013328    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013663    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013688    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013697    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013706    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013715    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013724    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013731    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013741    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013749    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013757    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013766    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013774    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013788    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013795    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013802    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013809    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013831    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 09:49:42.017026 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013836    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013840    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013845    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013850    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013854    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013858    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013863    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013867    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013876    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013881    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013885    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013889    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013894    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013898    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013903    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013907    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013915    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013921    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013928    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 09:49:42.017520 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013935    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013945    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013950    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013955    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013960    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013964    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013969    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013976    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013982    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013987    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013992    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.013997    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014001    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014011    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014015    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014019    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014024    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014029    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014033    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 09:49:42.017991 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014038    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014042    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014046    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014051    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014055    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014061    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014065    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014074    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014078    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014082    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014088    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014093    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014098    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014102    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014109    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014114    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014119    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014124    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014129    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014138    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 09:49:42.018464 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014142    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014147    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014151    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014155    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014160    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014164    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014168    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014173    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014177    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014181    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014185    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014189    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014199    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014204    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014208    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014213    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014217    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014222    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014227    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014231    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 09:49:42.018960 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014236    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 09:49:42.019447 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:42.014240    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 09:49:42.019447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.014250    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 09:49:42.019447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.014561    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 09:49:42.019447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.016611    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 09:49:42.019447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.018113    2581 server.go:1019] "Starting client certificate rotation"
Jul 30 09:49:42.019447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.018214    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 09:49:42.019447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.019223    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 09:49:42.020909 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.020884    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 09:49:42.022495 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.022477    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 09:49:42.038135 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.038111    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 30 09:49:42.041169 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.041148    2581 log.go:25] "Validated CRI v1 image API"
Jul 30 09:49:42.042000 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.041983    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 09:49:42.044663 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.044643    2581 fs.go:135] Filesystem UUIDs: map[0ed87429-6311-4bf4-827c-8a41436cb1d0:/dev/nvme0n1p3 294eb537-d7db-46b7-b653-1d7c3eaea285:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 30 09:49:42.044724 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.044663    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 09:49:42.051078 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.050960    2581 manager.go:216] Machine: {Timestamp:2026-07-30 09:49:42.049477 +0000 UTC m=+0.393540447 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106728 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec218e164cdb6f2e3d5b01b45e0f1f21 SystemUUID:ec218e16-4cdb-6f2e-3d5b-01b45e0f1f21 BootID:5743f029-8510-43b9-9a95-40f61ef1a595 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:9b:82:29:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:9b:82:29:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:ff:cd:b6:26:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 09:49:42.051078 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.051067    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 09:49:42.051220 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.051154    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 09:49:42.052709 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.052691    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 09:49:42.054275 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.054251    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 09:49:42.054415 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.054278    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-179.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 09:49:42.055252 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.055242    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 09:49:42.055290 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.055254    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 09:49:42.055290 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.055262    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 09:49:42.055290 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.055278    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 09:49:42.056223 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.056214    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 09:49:42.058173 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058162    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 09:49:42.058304 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058294    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 09:49:42.058343 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058325    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 09:49:42.058343 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058340    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 09:49:42.058400 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058355    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 09:49:42.058400 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058365    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 30 09:49:42.058400 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058374    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 09:49:42.058769 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058752    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 09:49:42.058769 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.058771    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 09:49:42.061213 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.061197    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 09:49:42.065586 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.065570    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 09:49:42.065654 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.065602    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 09:49:42.067341 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067329    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 09:49:42.067385 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067346    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 09:49:42.067385 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067353    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 09:49:42.067385 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067359    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 09:49:42.067385 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067373    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 09:49:42.067385 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067382    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 09:49:42.067527 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067390    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 09:49:42.067527 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067396    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 09:49:42.067527 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067403    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 09:49:42.067527 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067409    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 09:49:42.067527 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067417    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 09:49:42.067527 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.067423    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 09:49:42.068342 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.068331    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 09:49:42.068342 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.068343    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 09:49:42.069680 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.069657    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 09:49:42.069743 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.069679    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 09:49:42.071549 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.071536    2581 server.go:1268] "Started kubelet"
Jul 30 09:49:42.071638 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.071604    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 09:49:42.071687 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.071637    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 09:49:42.071719 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.071706    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 09:49:42.072449 ip-10-0-131-179 systemd[1]: Started Kubernetes Kubelet.
Jul 30 09:49:42.074211 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.074199    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 09:49:42.074528 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.074510    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 09:49:42.076519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.076495    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q7hwl"
Jul 30 09:49:42.078978 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.078958    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-179.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 09:49:42.079366 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.079342    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 09:49:42.080183 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.078948    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-179.ec2.internal.18c7085f2895b650  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-179.ec2.internal,UID:ip-10-0-131-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-179.ec2.internal,},FirstTimestamp:2026-07-30 09:49:42.071506512 +0000 UTC m=+0.415569959,LastTimestamp:2026-07-30 09:49:42.071506512 +0000 UTC m=+0.415569959,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-179.ec2.internal,}"
Jul 30 09:49:42.082547 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.082526    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 09:49:42.082646 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.082534    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 09:49:42.083054 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.082923    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.083224 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083198    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 09:49:42.083300 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083202    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 09:49:42.083383 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083365    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 09:49:42.083490 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083435    2581 factory.go:55] Registering systemd factory
Jul 30 09:49:42.083490 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083451    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 30 09:49:42.083651 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083631    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q7hwl"
Jul 30 09:49:42.083734 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083667    2581 factory.go:153] Registering CRI-O factory
Jul 30 09:49:42.083734 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083684    2581 factory.go:223] Registration of the crio container factory successfully
Jul 30 09:49:42.083841 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083735    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 09:49:42.083841 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083756    2581 factory.go:103] Registering Raw factory
Jul 30 09:49:42.083841 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083766    2581 manager.go:1196] Started watching for new ooms in manager
Jul 30 09:49:42.084039 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.083669    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 09:49:42.084110 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.084042    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 09:49:42.084110 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.084086    2581 manager.go:349] Starting recovery of all containers
Jul 30 09:49:42.085419 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.085393    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 09:49:42.085525 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.085503    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 09:49:42.095675 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.095655    2581 manager.go:354] Recovery completed
Jul 30 09:49:42.100001 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.099988    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 09:49:42.101768 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.101747    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 09:49:42.101880 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.101783    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 09:49:42.101880 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.101796    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientPID"
Jul 30 09:49:42.102397 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.102382    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 09:49:42.102397 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.102394    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 09:49:42.102511 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.102409    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 09:49:42.102511 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.102461    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 09:49:42.103247 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.103232    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 09:49:42.103334 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.103261    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 09:49:42.103334 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.103275    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientPID"
Jul 30 09:49:42.104298 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.104286    2581 policy_none.go:49] "None policy: Start"
Jul 30 09:49:42.104341 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.104302    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 09:49:42.104341 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.104313    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 09:49:42.105462 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.105452    2581 policy_none.go:47] "Start"
Jul 30 09:49:42.138546 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.138376    2581 manager.go:337] "Starting Device Plugin manager"
Jul 30 09:49:42.138649 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.138571    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 09:49:42.138649 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.138586    2581 server.go:87] "Starting device plugin registration server"
Jul 30 09:49:42.138913 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.138898    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 09:49:42.138960 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.138916    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 09:49:42.139032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.139016    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 09:49:42.139357 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.139097    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 09:49:42.139357 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.139110    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 09:49:42.139661 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.139636    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 09:49:42.139733 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.139690    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.220106 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.220071    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 09:49:42.221568 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.221312    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 09:49:42.221568 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.221359    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 09:49:42.221568 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.221388    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 09:49:42.221568 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.221428    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 09:49:42.223909 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.223890    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 09:49:42.239940 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.239919    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 09:49:42.240870 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.240850    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 09:49:42.240966 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.240886    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 09:49:42.240966 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.240904    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientPID"
Jul 30 09:49:42.240966 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.240931    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.247095 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.247051    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.247095 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.247072    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-179.ec2.internal\": node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.259903 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.259883    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.322494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.322454    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal"]
Jul 30 09:49:42.322666 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.322546    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 09:49:42.323542 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.323525    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 09:49:42.323615 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.323557    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 09:49:42.323615 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.323570    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientPID"
Jul 30 09:49:42.325075 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.325062    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 09:49:42.325188 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.325172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.325240 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.325204    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 09:49:42.325990 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.325964    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 09:49:42.325990 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.325976    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 09:49:42.325990 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.325990    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 09:49:42.326160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.326001    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientPID"
Jul 30 09:49:42.326160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.326002    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 09:49:42.326160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.326015    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientPID"
Jul 30 09:49:42.327533 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.327514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.327633 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.327545    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 09:49:42.328230 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.328215    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 09:49:42.328307 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.328248    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 09:49:42.328307 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.328265    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeHasSufficientPID"
Jul 30 09:49:42.353622 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.353599    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-179.ec2.internal\" not found" node="ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.358112 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.358094    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-179.ec2.internal\" not found" node="ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.360131 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.360112    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.386005 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.385978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9188f6af6c589fb0b7f34a2297e208ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal\" (UID: \"9188f6af6c589fb0b7f34a2297e208ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.386005 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.386006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9188f6af6c589fb0b7f34a2297e208ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal\" (UID: \"9188f6af6c589fb0b7f34a2297e208ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.386176 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.386023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7b463b0db8cbb6cbf3303819f4fbf03-config\") pod \"kube-apiserver-proxy-ip-10-0-131-179.ec2.internal\" (UID: \"e7b463b0db8cbb6cbf3303819f4fbf03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.461113 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.461080    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.486779 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.486748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9188f6af6c589fb0b7f34a2297e208ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal\" (UID: \"9188f6af6c589fb0b7f34a2297e208ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.486900 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.486785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9188f6af6c589fb0b7f34a2297e208ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal\" (UID: \"9188f6af6c589fb0b7f34a2297e208ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.486900 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.486809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7b463b0db8cbb6cbf3303819f4fbf03-config\") pod \"kube-apiserver-proxy-ip-10-0-131-179.ec2.internal\" (UID: \"e7b463b0db8cbb6cbf3303819f4fbf03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.486900 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.486835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9188f6af6c589fb0b7f34a2297e208ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal\" (UID: \"9188f6af6c589fb0b7f34a2297e208ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.486900 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.486860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9188f6af6c589fb0b7f34a2297e208ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal\" (UID: \"9188f6af6c589fb0b7f34a2297e208ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.486900 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.486884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7b463b0db8cbb6cbf3303819f4fbf03-config\") pod \"kube-apiserver-proxy-ip-10-0-131-179.ec2.internal\" (UID: \"e7b463b0db8cbb6cbf3303819f4fbf03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.562085 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.562056    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.661123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.661084    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.662249 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.662230    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.662306 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:42.662268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:42.762626 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.762577    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.862958 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.862869    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:42.963804 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:42.963752    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-179.ec2.internal\" not found"
Jul 30 09:49:43.018027 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.017988    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 09:49:43.018525 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.018147    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 09:49:43.054145 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.054116    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 09:49:43.058948 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.058931    2581 apiserver.go:52] "Watching apiserver"
Jul 30 09:49:43.067702 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.067672    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 09:49:43.068814 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.068795    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-xbzwq","kube-system/konnectivity-agent-68zjd","openshift-cluster-node-tuning-operator/tuned-lwvnt","openshift-dns/node-resolver-bv2lv","openshift-multus/multus-wxshh","openshift-network-diagnostics/network-check-target-7wp2w","openshift-ovn-kubernetes/ovnkube-node-qtsn9","kube-system/global-pull-secret-syncer-lpltn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7","openshift-image-registry/node-ca-8fhn2","openshift-multus/multus-additional-cni-plugins-6prkf","openshift-multus/network-metrics-daemon-6c4xt"]
Jul 30 09:49:43.070380 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.070365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.071576 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.071550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:49:43.073478 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.073268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.073613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.073520    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 09:49:43.073839 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.073801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 09:49:43.074056 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.074035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 09:49:43.074162 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.074142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mhgvj\""
Jul 30 09:49:43.074685 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.074665    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-86wz5\""
Jul 30 09:49:43.074888 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.074871    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 09:49:43.075139 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.075123    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 09:49:43.075926 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.075735    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 09:49:43.075926 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.075743    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hbpdk\""
Jul 30 09:49:43.076137 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.076113    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 09:49:43.076253 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.076185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.077621 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.077595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.078337 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.078297    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 09:49:43.078528 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.078510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zdjfv\""
Jul 30 09:49:43.078603 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.078517    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 09:49:43.079088 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.079067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:43.079209 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.079186    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:43.079526 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.079506    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 09:49:43.079646 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.079534    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 09:49:43.079937 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.079907    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 09:49:43.080037 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.080003    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 09:49:43.080092 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.080079    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kr9w5\""
Jul 30 09:49:43.080649 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.080632    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.081948 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.081929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.082040 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.081994    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:43.082644 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.082621    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 09:49:43.082739 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.082647    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 09:49:43.082739 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.082681    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:43.082852 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.082826    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 09:49:43.082934 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.082879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 09:49:43.083054 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.083035    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 09:49:43.083150 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.083040    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nqnfm\""
Jul 30 09:49:43.083225 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.083198    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 09:49:43.083225 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.083219    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 09:49:43.084010 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.083989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.085782 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.085765    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 09:49:43.085885 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.085785    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2955s\""
Jul 30 09:49:43.085885 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.085863    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 09:49:43.086074 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.086057    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 09:49:43.086143 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.086073    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.087671 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.087656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.087940 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.087876    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 09:44:42 +0000 UTC" deadline="2028-04-05 07:24:31.836149694 +0000 UTC"
Jul 30 09:49:43.088027 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.087941    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14757h34m48.748212312s"
Jul 30 09:49:43.088085 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.088032    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 09:49:43.088085 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.088048    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 09:49:43.088215 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.088033    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 09:49:43.088500 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.088485    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hlmzz\""
Jul 30 09:49:43.089460 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.089440    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 09:49:43.089460 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.089450    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pkblx\""
Jul 30 09:49:43.089588 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.089477    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 09:49:43.089711 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.089697    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:43.089768 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.089751    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:49:43.090248 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-kubelet\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090346 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090346 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55368fb6-e950-4d09-9283-6c53a4946933-hosts-file\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.090346 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-cni-multus\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.090499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysctl-d\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.090499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090374    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-var-lib-kubelet\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.090499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-host\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.090499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-ovn\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-ovnkube-script-lib\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-os-release\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-socket-dir-parent\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e7c60fa-cb09-4408-9884-72da3cd0776c-kubelet-config\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-node-log\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-daemon-config\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090612    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-multus-certs\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-kubernetes\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090662    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-cni-bin\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8e669b5-1ce0-404e-abe4-033e16dff345-ovn-node-metrics-cert\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8w7\" (UniqueName: \"kubernetes.io/projected/e8e669b5-1ce0-404e-abe4-033e16dff345-kube-api-access-5g8w7\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.090808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55368fb6-e950-4d09-9283-6c53a4946933-tmp-dir\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-cni-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-run-netns\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-etc-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-run\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.090998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-modprobe-d\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-log-socket\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-device-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-cnibin\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c64c4728-534c-48f4-96f2-296c35c37661-agent-certs\") pod \"konnectivity-agent-68zjd\" (UID: \"c64c4728-534c-48f4-96f2-296c35c37661\") " pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-systemd-units\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-slash\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-etc-selinux\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3da972f-9412-4c93-bb03-17e040ebca18-iptables-alerter-script\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.091435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd7ab166-0228-46f6-ac36-f38a1ebe365f-cni-binary-copy\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-cni-bin\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-cni-netd\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-socket-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-registration-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3da972f-9412-4c93-bb03-17e040ebca18-host-slash\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-kubelet\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-sys\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-etc-kubernetes\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj6cx\" (UniqueName: \"kubernetes.io/projected/dd7ab166-0228-46f6-ac36-f38a1ebe365f-kube-api-access-vj6cx\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysconfig\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-sys-fs\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjgg\" (UniqueName: \"kubernetes.io/projected/f3da972f-9412-4c93-bb03-17e040ebca18-kube-api-access-njjgg\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-systemd\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgn25\" (UniqueName: \"kubernetes.io/projected/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-kube-api-access-dgn25\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e7c60fa-cb09-4408-9884-72da3cd0776c-dbus\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.092123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysctl-conf\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-k8s-cni-cncf-io\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d636d07b-2602-411d-a566-9c7986c613cf-etc-tuned\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d636d07b-2602-411d-a566-9c7986c613cf-tmp\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-var-lib-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-env-overrides\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.091983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-hostroot\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-conf-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-ovnkube-config\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mckb5\" (UniqueName: \"kubernetes.io/projected/55368fb6-e950-4d09-9283-6c53a4946933-kube-api-access-mckb5\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-netns\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-system-cni-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-systemd\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-lib-modules\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c64c4728-534c-48f4-96f2-296c35c37661-konnectivity-ca\") pod \"konnectivity-agent-68zjd\" (UID: \"c64c4728-534c-48f4-96f2-296c35c37661\") " pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:49:43.092712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.092267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bth7p\" (UniqueName: \"kubernetes.io/projected/d636d07b-2602-411d-a566-9c7986c613cf-kube-api-access-bth7p\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.095990 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.095958    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal"]
Jul 30 09:49:43.096172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.096130    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 09:49:43.096261 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.096212    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal"
Jul 30 09:49:43.098912 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.098848    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 09:49:43.102981 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.102962    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 09:49:43.103058 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.103012    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal"]
Jul 30 09:49:43.125916 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.125850    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gw7v"
Jul 30 09:49:43.134618 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.134596    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gw7v"
Jul 30 09:49:43.169403 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.169381    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 09:49:43.183923 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.183895    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 09:49:43.193388 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-kubernetes\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.193524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-cni-bin\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8e669b5-1ce0-404e-abe4-033e16dff345-ovn-node-metrics-cert\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8w7\" (UniqueName: \"kubernetes.io/projected/e8e669b5-1ce0-404e-abe4-033e16dff345-kube-api-access-5g8w7\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-kubernetes\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.193524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-cni-bin\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55368fb6-e950-4d09-9283-6c53a4946933-tmp-dir\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-cni-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9439732-bedf-4e4f-ada8-150cf78abe3d-serviceca\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cnibin\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-run-netns\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-etc-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-cni-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-run\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-modprobe-d\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-etc-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-run-netns\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-log-socket\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-run\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-device-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193829    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-cnibin\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.193915 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-modprobe-d\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-log-socket\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c64c4728-534c-48f4-96f2-296c35c37661-agent-certs\") pod \"konnectivity-agent-68zjd\" (UID: \"c64c4728-534c-48f4-96f2-296c35c37661\") " pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-device-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-systemd-units\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-slash\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-cnibin\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.193968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-systemd-units\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-slash\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194041    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-etc-selinux\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55368fb6-e950-4d09-9283-6c53a4946933-tmp-dir\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3da972f-9412-4c93-bb03-17e040ebca18-iptables-alerter-script\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd7ab166-0228-46f6-ac36-f38a1ebe365f-cni-binary-copy\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-cni-bin\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-cni-netd\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.194772 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-etc-selinux\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-socket-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-cni-bin\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194197    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-cni-netd\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-registration-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3da972f-9412-4c93-bb03-17e040ebca18-host-slash\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-kubelet\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-sys\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-etc-kubernetes\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194313    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-socket-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194320    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3da972f-9412-4c93-bb03-17e040ebca18-host-slash\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj6cx\" (UniqueName: \"kubernetes.io/projected/dd7ab166-0228-46f6-ac36-f38a1ebe365f-kube-api-access-vj6cx\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9439732-bedf-4e4f-ada8-150cf78abe3d-host\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-sys\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs5w4\" (UniqueName: \"kubernetes.io/projected/f0c02eae-446c-47fc-924f-6a7e61b4b34a-kube-api-access-cs5w4\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-kubelet\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.195494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysconfig\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194501    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysconfig\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-registration-dir\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194536    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-etc-kubernetes\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-sys-fs\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjgg\" (UniqueName: \"kubernetes.io/projected/f3da972f-9412-4c93-bb03-17e040ebca18-kube-api-access-njjgg\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194619    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-sys-fs\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-os-release\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-systemd\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3da972f-9412-4c93-bb03-17e040ebca18-iptables-alerter-script\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194676    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd7ab166-0228-46f6-ac36-f38a1ebe365f-cni-binary-copy\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgn25\" (UniqueName: \"kubernetes.io/projected/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-kube-api-access-dgn25\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e7c60fa-cb09-4408-9884-72da3cd0776c-dbus\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysctl-conf\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-systemd\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-k8s-cni-cncf-io\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.196296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e7c60fa-cb09-4408-9884-72da3cd0776c-dbus\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysctl-conf\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmrj6\" (UniqueName: \"kubernetes.io/projected/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-kube-api-access-fmrj6\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d636d07b-2602-411d-a566-9c7986c613cf-etc-tuned\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-k8s-cni-cncf-io\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d636d07b-2602-411d-a566-9c7986c613cf-tmp\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-var-lib-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-env-overrides\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-hostroot\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-conf-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.194840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-ovnkube-config\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.195817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-hostroot\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-ovnkube-config\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-conf-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mckb5\" (UniqueName: \"kubernetes.io/projected/55368fb6-e950-4d09-9283-6c53a4946933-kube-api-access-mckb5\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-var-lib-openvswitch\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-netns\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-netns\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-system-cni-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-env-overrides\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-systemd\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.196715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-systemd\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.196928    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.197009    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret podName:2e7c60fa-cb09-4408-9884-72da3cd0776c nodeName:}" failed. No retries permitted until 2026-07-30 09:49:43.696988 +0000 UTC m=+2.041051461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret") pod "global-pull-secret-syncer-lpltn" (UID: "2e7c60fa-cb09-4408-9884-72da3cd0776c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-system-cni-dir\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-system-cni-dir\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-lib-modules\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c64c4728-534c-48f4-96f2-296c35c37661-konnectivity-ca\") pod \"konnectivity-agent-68zjd\" (UID: \"c64c4728-534c-48f4-96f2-296c35c37661\") " pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bth7p\" (UniqueName: \"kubernetes.io/projected/d636d07b-2602-411d-a566-9c7986c613cf-kube-api-access-bth7p\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-kubelet\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.197871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197887    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-lib-modules\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55368fb6-e950-4d09-9283-6c53a4946933-hosts-file\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg4cc\" (UniqueName: \"kubernetes.io/projected/f9439732-bedf-4e4f-ada8-150cf78abe3d-kube-api-access-pg4cc\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.197989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-cni-multus\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8e669b5-1ce0-404e-abe4-033e16dff345-ovn-node-metrics-cert\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-var-lib-cni-multus\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-host-kubelet\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55368fb6-e950-4d09-9283-6c53a4946933-hosts-file\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysctl-d\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-var-lib-kubelet\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-host\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-etc-sysctl-d\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-ovn\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-ovnkube-script-lib\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.198676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c64c4728-534c-48f4-96f2-296c35c37661-konnectivity-ca\") pod \"konnectivity-agent-68zjd\" (UID: \"c64c4728-534c-48f4-96f2-296c35c37661\") " pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-var-lib-kubelet\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-os-release\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-run-ovn\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-os-release\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-socket-dir-parent\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d636d07b-2602-411d-a566-9c7986c613cf-host\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e7c60fa-cb09-4408-9884-72da3cd0776c-kubelet-config\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-socket-dir-parent\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-node-log\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e7c60fa-cb09-4408-9884-72da3cd0776c-kubelet-config\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-daemon-config\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8e669b5-1ce0-404e-abe4-033e16dff345-node-log\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-multus-certs\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.198994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd7ab166-0228-46f6-ac36-f38a1ebe365f-host-run-multus-certs\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.199127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8e669b5-1ce0-404e-abe4-033e16dff345-ovnkube-script-lib\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.199517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.199237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd7ab166-0228-46f6-ac36-f38a1ebe365f-multus-daemon-config\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.200560 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.200539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c64c4728-534c-48f4-96f2-296c35c37661-agent-certs\") pod \"konnectivity-agent-68zjd\" (UID: \"c64c4728-534c-48f4-96f2-296c35c37661\") " pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:49:43.202025 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.202004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d636d07b-2602-411d-a566-9c7986c613cf-tmp\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.202118 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.202041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d636d07b-2602-411d-a566-9c7986c613cf-etc-tuned\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.204104 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.204085    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 09:49:43.204104 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.204106    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 09:49:43.204250 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.204118    2581 projected.go:196] Error preparing data for projected volume kube-api-access-nvlzf for pod openshift-network-diagnostics/network-check-target-7wp2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:43.204250 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.204203    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf podName:c706a557-b56a-4b78-9b36-348511935520 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:43.704186861 +0000 UTC m=+2.048250320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nvlzf" (UniqueName: "kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf") pod "network-check-target-7wp2w" (UID: "c706a557-b56a-4b78-9b36-348511935520") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:43.206207 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.206146    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mckb5\" (UniqueName: \"kubernetes.io/projected/55368fb6-e950-4d09-9283-6c53a4946933-kube-api-access-mckb5\") pod \"node-resolver-bv2lv\" (UID: \"55368fb6-e950-4d09-9283-6c53a4946933\") " pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.207038 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.207010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj6cx\" (UniqueName: \"kubernetes.io/projected/dd7ab166-0228-46f6-ac36-f38a1ebe365f-kube-api-access-vj6cx\") pod \"multus-wxshh\" (UID: \"dd7ab166-0228-46f6-ac36-f38a1ebe365f\") " pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.207160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.207059    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bth7p\" (UniqueName: \"kubernetes.io/projected/d636d07b-2602-411d-a566-9c7986c613cf-kube-api-access-bth7p\") pod \"tuned-lwvnt\" (UID: \"d636d07b-2602-411d-a566-9c7986c613cf\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.207503 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.207478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjgg\" (UniqueName: \"kubernetes.io/projected/f3da972f-9412-4c93-bb03-17e040ebca18-kube-api-access-njjgg\") pod \"iptables-alerter-xbzwq\" (UID: \"f3da972f-9412-4c93-bb03-17e040ebca18\") " pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.207565 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.207539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8w7\" (UniqueName: \"kubernetes.io/projected/e8e669b5-1ce0-404e-abe4-033e16dff345-kube-api-access-5g8w7\") pod \"ovnkube-node-qtsn9\" (UID: \"e8e669b5-1ce0-404e-abe4-033e16dff345\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.207635 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.207617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgn25\" (UniqueName: \"kubernetes.io/projected/451c46bf-e01e-4d7d-9cb9-e86f7340fb41-kube-api-access-dgn25\") pod \"aws-ebs-csi-driver-node-mpzj7\" (UID: \"451c46bf-e01e-4d7d-9cb9-e86f7340fb41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.262149 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.262120    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 09:49:43.284630 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.284589    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9188f6af6c589fb0b7f34a2297e208ce.slice/crio-79f97fb50ce50b2b372af25d31e8e03cf7172942312ee843a4f7a0ba5a723788 WatchSource:0}: Error finding container 79f97fb50ce50b2b372af25d31e8e03cf7172942312ee843a4f7a0ba5a723788: Status 404 returned error can't find the container with id 79f97fb50ce50b2b372af25d31e8e03cf7172942312ee843a4f7a0ba5a723788
Jul 30 09:49:43.284876 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.284856    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b463b0db8cbb6cbf3303819f4fbf03.slice/crio-46a2878710ba968f2ed9e739422a22e8279bc5a9e0696dc66426dad2dd488118 WatchSource:0}: Error finding container 46a2878710ba968f2ed9e739422a22e8279bc5a9e0696dc66426dad2dd488118: Status 404 returned error can't find the container with id 46a2878710ba968f2ed9e739422a22e8279bc5a9e0696dc66426dad2dd488118
Jul 30 09:49:43.289073 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.289057    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 09:49:43.300283 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-os-release\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300369 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmrj6\" (UniqueName: \"kubernetes.io/projected/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-kube-api-access-fmrj6\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:43.300369 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300369 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300541 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-system-cni-dir\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300541 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300484    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg4cc\" (UniqueName: \"kubernetes.io/projected/f9439732-bedf-4e4f-ada8-150cf78abe3d-kube-api-access-pg4cc\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.300541 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300541 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:43.300541 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-os-release\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-system-cni-dir\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.300604    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9439732-bedf-4e4f-ada8-150cf78abe3d-serviceca\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cnibin\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.300677    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs podName:f9b12b5e-bde1-4dca-8f5e-575a7f2448ef nodeName:}" failed. No retries permitted until 2026-07-30 09:49:43.800654548 +0000 UTC m=+2.144718007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs") pod "network-metrics-daemon-6c4xt" (UID: "f9b12b5e-bde1-4dca-8f5e-575a7f2448ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cnibin\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9439732-bedf-4e4f-ada8-150cf78abe3d-host\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.300801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.301199 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs5w4\" (UniqueName: \"kubernetes.io/projected/f0c02eae-446c-47fc-924f-6a7e61b4b34a-kube-api-access-cs5w4\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.301199 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9439732-bedf-4e4f-ada8-150cf78abe3d-host\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.301199 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.300976    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.301199 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.301018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9439732-bedf-4e4f-ada8-150cf78abe3d-serviceca\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.301601 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.301578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.301680 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.301663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0c02eae-446c-47fc-924f-6a7e61b4b34a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.308981 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.308955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmrj6\" (UniqueName: \"kubernetes.io/projected/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-kube-api-access-fmrj6\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:43.309291 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.309273    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg4cc\" (UniqueName: \"kubernetes.io/projected/f9439732-bedf-4e4f-ada8-150cf78abe3d-kube-api-access-pg4cc\") pod \"node-ca-8fhn2\" (UID: \"f9439732-bedf-4e4f-ada8-150cf78abe3d\") " pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.309663 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.309646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs5w4\" (UniqueName: \"kubernetes.io/projected/f0c02eae-446c-47fc-924f-6a7e61b4b34a-kube-api-access-cs5w4\") pod \"multus-additional-cni-plugins-6prkf\" (UID: \"f0c02eae-446c-47fc-924f-6a7e61b4b34a\") " pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.392555 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.392480    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbzwq"
Jul 30 09:49:43.401233 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.401202    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3da972f_9412_4c93_bb03_17e040ebca18.slice/crio-d328330f8605ad2dd7421a125f7aa3b58b81284d61c3cb11154087067933010f WatchSource:0}: Error finding container d328330f8605ad2dd7421a125f7aa3b58b81284d61c3cb11154087067933010f: Status 404 returned error can't find the container with id d328330f8605ad2dd7421a125f7aa3b58b81284d61c3cb11154087067933010f
Jul 30 09:49:43.412676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.412656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:49:43.421329 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.421298    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64c4728_534c_48f4_96f2_296c35c37661.slice/crio-34970f0d306f327225c7f3da7b84b06b6335af45188e5cb6e2c9220e0548f6b4 WatchSource:0}: Error finding container 34970f0d306f327225c7f3da7b84b06b6335af45188e5cb6e2c9220e0548f6b4: Status 404 returned error can't find the container with id 34970f0d306f327225c7f3da7b84b06b6335af45188e5cb6e2c9220e0548f6b4
Jul 30 09:49:43.433120 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.433099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lwvnt"
Jul 30 09:49:43.441293 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.441271    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd636d07b_2602_411d_a566_9c7986c613cf.slice/crio-5893e5362aeb25968259ca9da243f5a0875d5713b0e62d56744d9993884917af WatchSource:0}: Error finding container 5893e5362aeb25968259ca9da243f5a0875d5713b0e62d56744d9993884917af: Status 404 returned error can't find the container with id 5893e5362aeb25968259ca9da243f5a0875d5713b0e62d56744d9993884917af
Jul 30 09:49:43.442858 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.442840    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bv2lv"
Jul 30 09:49:43.451846 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.451817    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55368fb6_e950_4d09_9283_6c53a4946933.slice/crio-4a56f3612a9e07fbd2f28d1b18ac3b970a208e636bdb3cf40ded142e9668fe97 WatchSource:0}: Error finding container 4a56f3612a9e07fbd2f28d1b18ac3b970a208e636bdb3cf40ded142e9668fe97: Status 404 returned error can't find the container with id 4a56f3612a9e07fbd2f28d1b18ac3b970a208e636bdb3cf40ded142e9668fe97
Jul 30 09:49:43.460733 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.460714    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wxshh"
Jul 30 09:49:43.468141 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.468116    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7ab166_0228_46f6_ac36_f38a1ebe365f.slice/crio-7d2a0da58383c1550c24f91aa22f1db4b0e2632926e0e50c10a4987d93f99f53 WatchSource:0}: Error finding container 7d2a0da58383c1550c24f91aa22f1db4b0e2632926e0e50c10a4987d93f99f53: Status 404 returned error can't find the container with id 7d2a0da58383c1550c24f91aa22f1db4b0e2632926e0e50c10a4987d93f99f53
Jul 30 09:49:43.471989 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.471968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:49:43.479851 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.479805    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e669b5_1ce0_404e_abe4_033e16dff345.slice/crio-3ffe817f03c0d4dbc6654d75311737ed997d75ff02f139c07ccdd423993fd54a WatchSource:0}: Error finding container 3ffe817f03c0d4dbc6654d75311737ed997d75ff02f139c07ccdd423993fd54a: Status 404 returned error can't find the container with id 3ffe817f03c0d4dbc6654d75311737ed997d75ff02f139c07ccdd423993fd54a
Jul 30 09:49:43.485000 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.484976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7"
Jul 30 09:49:43.492541 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.492516    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451c46bf_e01e_4d7d_9cb9_e86f7340fb41.slice/crio-5306434c4df6d7937a1b617a6246a2c8bbf0e929ccca730cb0e7ea4ba2609d2c WatchSource:0}: Error finding container 5306434c4df6d7937a1b617a6246a2c8bbf0e929ccca730cb0e7ea4ba2609d2c: Status 404 returned error can't find the container with id 5306434c4df6d7937a1b617a6246a2c8bbf0e929ccca730cb0e7ea4ba2609d2c
Jul 30 09:49:43.515746 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.515715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8fhn2"
Jul 30 09:49:43.521237 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.521209    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6prkf"
Jul 30 09:49:43.524289 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.524264    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9439732_bedf_4e4f_ada8_150cf78abe3d.slice/crio-1dfbb914ccd7114fca9a8a696ea0884ee04f81fecd3acf2551fa70a46d2394e7 WatchSource:0}: Error finding container 1dfbb914ccd7114fca9a8a696ea0884ee04f81fecd3acf2551fa70a46d2394e7: Status 404 returned error can't find the container with id 1dfbb914ccd7114fca9a8a696ea0884ee04f81fecd3acf2551fa70a46d2394e7
Jul 30 09:49:43.529119 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:49:43.529096    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c02eae_446c_47fc_924f_6a7e61b4b34a.slice/crio-a0e4821f2a704eb6a39b95952e5276b82f81432c096e766e55d2e0172645e718 WatchSource:0}: Error finding container a0e4821f2a704eb6a39b95952e5276b82f81432c096e766e55d2e0172645e718: Status 404 returned error can't find the container with id a0e4821f2a704eb6a39b95952e5276b82f81432c096e766e55d2e0172645e718
Jul 30 09:49:43.703066 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.702963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:43.703218 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.703124    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:43.703218 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.703189    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret podName:2e7c60fa-cb09-4408-9884-72da3cd0776c nodeName:}" failed. No retries permitted until 2026-07-30 09:49:44.703174039 +0000 UTC m=+3.047237477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret") pod "global-pull-secret-syncer-lpltn" (UID: "2e7c60fa-cb09-4408-9884-72da3cd0776c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:43.803978 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.803941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:43.804191 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:43.804001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:43.804191 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.804122    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:43.804191 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.804141    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 09:49:43.804191 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.804160    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 09:49:43.804191 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.804172    2581 projected.go:196] Error preparing data for projected volume kube-api-access-nvlzf for pod openshift-network-diagnostics/network-check-target-7wp2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:43.804191 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.804188    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs podName:f9b12b5e-bde1-4dca-8f5e-575a7f2448ef nodeName:}" failed. No retries permitted until 2026-07-30 09:49:44.804173327 +0000 UTC m=+3.148236763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs") pod "network-metrics-daemon-6c4xt" (UID: "f9b12b5e-bde1-4dca-8f5e-575a7f2448ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:43.804432 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:43.804237    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf podName:c706a557-b56a-4b78-9b36-348511935520 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:44.804220251 +0000 UTC m=+3.148283709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvlzf" (UniqueName: "kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf") pod "network-check-target-7wp2w" (UID: "c706a557-b56a-4b78-9b36-348511935520") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:44.022054 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.021956    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 09:49:44.137624 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.137553    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 09:44:43 +0000 UTC" deadline="2028-04-02 03:41:33.124697531 +0000 UTC"
Jul 30 09:49:44.137624 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.137621    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14681h51m48.98708111s"
Jul 30 09:49:44.252985 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.252858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal" event={"ID":"e7b463b0db8cbb6cbf3303819f4fbf03","Type":"ContainerStarted","Data":"46a2878710ba968f2ed9e739422a22e8279bc5a9e0696dc66426dad2dd488118"}
Jul 30 09:49:44.265113 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.264887    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6prkf" event={"ID":"f0c02eae-446c-47fc-924f-6a7e61b4b34a","Type":"ContainerStarted","Data":"a0e4821f2a704eb6a39b95952e5276b82f81432c096e766e55d2e0172645e718"}
Jul 30 09:49:44.273394 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.273253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8fhn2" event={"ID":"f9439732-bedf-4e4f-ada8-150cf78abe3d","Type":"ContainerStarted","Data":"1dfbb914ccd7114fca9a8a696ea0884ee04f81fecd3acf2551fa70a46d2394e7"}
Jul 30 09:49:44.302696 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.302651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7" event={"ID":"451c46bf-e01e-4d7d-9cb9-e86f7340fb41","Type":"ContainerStarted","Data":"5306434c4df6d7937a1b617a6246a2c8bbf0e929ccca730cb0e7ea4ba2609d2c"}
Jul 30 09:49:44.318697 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.318643    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"3ffe817f03c0d4dbc6654d75311737ed997d75ff02f139c07ccdd423993fd54a"}
Jul 30 09:49:44.339670 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.339603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lwvnt" event={"ID":"d636d07b-2602-411d-a566-9c7986c613cf","Type":"ContainerStarted","Data":"5893e5362aeb25968259ca9da243f5a0875d5713b0e62d56744d9993884917af"}
Jul 30 09:49:44.347045 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.346974    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbzwq" event={"ID":"f3da972f-9412-4c93-bb03-17e040ebca18","Type":"ContainerStarted","Data":"d328330f8605ad2dd7421a125f7aa3b58b81284d61c3cb11154087067933010f"}
Jul 30 09:49:44.363859 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.363764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal" event={"ID":"9188f6af6c589fb0b7f34a2297e208ce","Type":"ContainerStarted","Data":"79f97fb50ce50b2b372af25d31e8e03cf7172942312ee843a4f7a0ba5a723788"}
Jul 30 09:49:44.400795 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.400681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wxshh" event={"ID":"dd7ab166-0228-46f6-ac36-f38a1ebe365f","Type":"ContainerStarted","Data":"7d2a0da58383c1550c24f91aa22f1db4b0e2632926e0e50c10a4987d93f99f53"}
Jul 30 09:49:44.427174 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.427100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bv2lv" event={"ID":"55368fb6-e950-4d09-9283-6c53a4946933","Type":"ContainerStarted","Data":"4a56f3612a9e07fbd2f28d1b18ac3b970a208e636bdb3cf40ded142e9668fe97"}
Jul 30 09:49:44.435107 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.435023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-68zjd" event={"ID":"c64c4728-534c-48f4-96f2-296c35c37661","Type":"ContainerStarted","Data":"34970f0d306f327225c7f3da7b84b06b6335af45188e5cb6e2c9220e0548f6b4"}
Jul 30 09:49:44.713406 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.712657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:44.713406 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:44.712896    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:44.713406 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:44.712971    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret podName:2e7c60fa-cb09-4408-9884-72da3cd0776c nodeName:}" failed. No retries permitted until 2026-07-30 09:49:46.712949475 +0000 UTC m=+5.057012928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret") pod "global-pull-secret-syncer-lpltn" (UID: "2e7c60fa-cb09-4408-9884-72da3cd0776c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:44.813992 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.813951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:44.814207 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:44.814021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:44.814207 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:44.814188    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 09:49:44.814207 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:44.814208    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 09:49:44.814373 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:44.814221    2581 projected.go:196] Error preparing data for projected volume kube-api-access-nvlzf for pod openshift-network-diagnostics/network-check-target-7wp2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:44.814373 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:44.814285    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf podName:c706a557-b56a-4b78-9b36-348511935520 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:46.81426622 +0000 UTC m=+5.158329681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvlzf" (UniqueName: "kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf") pod "network-check-target-7wp2w" (UID: "c706a557-b56a-4b78-9b36-348511935520") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:44.814723 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:44.814703    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:44.814804 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:44.814761    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs podName:f9b12b5e-bde1-4dca-8f5e-575a7f2448ef nodeName:}" failed. No retries permitted until 2026-07-30 09:49:46.814745736 +0000 UTC m=+5.158809178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs") pod "network-metrics-daemon-6c4xt" (UID: "f9b12b5e-bde1-4dca-8f5e-575a7f2448ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:45.138167 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:45.138111    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 09:44:43 +0000 UTC" deadline="2028-03-07 21:58:33.560955344 +0000 UTC"
Jul 30 09:49:45.138167 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:45.138155    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14076h8m48.422805876s"
Jul 30 09:49:45.222519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:45.221793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:45.222519 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:45.221950    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:45.222519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:45.222198    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:45.222519 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:45.222320    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:49:45.222519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:45.222376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:45.222519 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:45.222481    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:46.733839 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:46.733798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:46.734351 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:46.733977    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:46.734351 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:46.734048    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret podName:2e7c60fa-cb09-4408-9884-72da3cd0776c nodeName:}" failed. No retries permitted until 2026-07-30 09:49:50.734027931 +0000 UTC m=+9.078091415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret") pod "global-pull-secret-syncer-lpltn" (UID: "2e7c60fa-cb09-4408-9884-72da3cd0776c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:46.834884 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:46.834782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:46.834884 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:46.834875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:46.835151 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:46.835055    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 09:49:46.835151 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:46.835076    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 09:49:46.835151 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:46.835091    2581 projected.go:196] Error preparing data for projected volume kube-api-access-nvlzf for pod openshift-network-diagnostics/network-check-target-7wp2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:46.835314 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:46.835153    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf podName:c706a557-b56a-4b78-9b36-348511935520 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:50.835133125 +0000 UTC m=+9.179196567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvlzf" (UniqueName: "kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf") pod "network-check-target-7wp2w" (UID: "c706a557-b56a-4b78-9b36-348511935520") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:46.835591 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:46.835569    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:46.835664 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:46.835634    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs podName:f9b12b5e-bde1-4dca-8f5e-575a7f2448ef nodeName:}" failed. No retries permitted until 2026-07-30 09:49:50.835616528 +0000 UTC m=+9.179679969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs") pod "network-metrics-daemon-6c4xt" (UID: "f9b12b5e-bde1-4dca-8f5e-575a7f2448ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:47.222416 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:47.222330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:47.222605 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:47.222493    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:49:47.222941 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:47.222919    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:47.223056 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:47.223019    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:47.223127 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:47.223071    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:47.223179 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:47.223146    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:49.222826 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:49.221847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:49.222826 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:49.221988    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:49.222826 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:49.222432    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:49.222826 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:49.222528    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:49.222826 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:49.222598    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:49.222826 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:49.222689    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:49:50.769127 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:50.769080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:50.769631 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:50.769266    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:50.769631 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:50.769361    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret podName:2e7c60fa-cb09-4408-9884-72da3cd0776c nodeName:}" failed. No retries permitted until 2026-07-30 09:49:58.769328911 +0000 UTC m=+17.113392363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret") pod "global-pull-secret-syncer-lpltn" (UID: "2e7c60fa-cb09-4408-9884-72da3cd0776c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:50.869836 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:50.869796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:50.870013 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:50.869942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:50.870013 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:50.869972    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:50.870146 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:50.870043    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs podName:f9b12b5e-bde1-4dca-8f5e-575a7f2448ef nodeName:}" failed. No retries permitted until 2026-07-30 09:49:58.870021798 +0000 UTC m=+17.214085257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs") pod "network-metrics-daemon-6c4xt" (UID: "f9b12b5e-bde1-4dca-8f5e-575a7f2448ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:50.870214 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:50.870148    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 09:49:50.870214 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:50.870170    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 09:49:50.870214 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:50.870184    2581 projected.go:196] Error preparing data for projected volume kube-api-access-nvlzf for pod openshift-network-diagnostics/network-check-target-7wp2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:50.870340 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:50.870245    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf podName:c706a557-b56a-4b78-9b36-348511935520 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:58.870226929 +0000 UTC m=+17.214290380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvlzf" (UniqueName: "kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf") pod "network-check-target-7wp2w" (UID: "c706a557-b56a-4b78-9b36-348511935520") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:51.222271 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:51.222216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:51.222271 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:51.222244    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:51.222271 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:51.222258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:51.222595 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:51.222376    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:51.222595 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:51.222496    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:51.222716 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:51.222601    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:49:53.222582 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:53.222544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:53.222582 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:53.222580    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:53.223152 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:53.222664    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:53.223152 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:53.222683    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:53.223152 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:53.222768    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:49:53.223152 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:53.222850    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:55.222288 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:55.222252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:55.222735 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:55.222296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:55.222735 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:55.222308    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:55.222735 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:55.222377    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:55.222735 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:55.222475    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:55.222735 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:55.222555    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:49:57.221795 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:57.221757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:57.221795 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:57.221791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:57.222296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:57.221755    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:57.222296 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:57.221896    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:57.222296 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:57.221976    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:57.222296 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:57.222061    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:49:58.831077 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:58.831043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:58.831510 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:58.831220    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:58.831510 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:58.831289    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret podName:2e7c60fa-cb09-4408-9884-72da3cd0776c nodeName:}" failed. No retries permitted until 2026-07-30 09:50:14.831273633 +0000 UTC m=+33.175337067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret") pod "global-pull-secret-syncer-lpltn" (UID: "2e7c60fa-cb09-4408-9884-72da3cd0776c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 09:49:58.932452 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:58.932405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:58.932616 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:58.932476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:58.932616 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:58.932574    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:58.932616 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:58.932611    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 09:49:58.932832 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:58.932630    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 09:49:58.932832 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:58.932643    2581 projected.go:196] Error preparing data for projected volume kube-api-access-nvlzf for pod openshift-network-diagnostics/network-check-target-7wp2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:58.932832 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:58.932646    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs podName:f9b12b5e-bde1-4dca-8f5e-575a7f2448ef nodeName:}" failed. No retries permitted until 2026-07-30 09:50:14.932629631 +0000 UTC m=+33.276693078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs") pod "network-metrics-daemon-6c4xt" (UID: "f9b12b5e-bde1-4dca-8f5e-575a7f2448ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:49:58.932832 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:58.932709    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf podName:c706a557-b56a-4b78-9b36-348511935520 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:14.932691409 +0000 UTC m=+33.276754844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvlzf" (UniqueName: "kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf") pod "network-check-target-7wp2w" (UID: "c706a557-b56a-4b78-9b36-348511935520") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:49:59.222401 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:59.222317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:49:59.222401 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:59.222359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:49:59.222600 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:49:59.222433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:49:59.222600 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:59.222449    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:49:59.222600 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:59.222508    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:49:59.222600 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:49:59.222590    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:01.222390 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:01.222363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:01.222906 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:01.222357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:01.222906 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:01.222478    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:01.222906 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:01.222486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:01.222906 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:01.222571    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:01.222906 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:01.222673    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:03.222058 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:03.222019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:03.222536 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:03.222019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:03.222536 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:03.222146    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:03.222536 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:03.222036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:03.222536 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:03.222283    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:03.222536 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:03.222376    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:04.492619 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:04.492422    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal" event={"ID":"e7b463b0db8cbb6cbf3303819f4fbf03","Type":"ContainerStarted","Data":"c0dfc55de3324a8f02c09fbbd62fd936352227bb82940a64bd2bc36b0495ea7e"}
Jul 30 09:50:05.222176 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.221893    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:05.222281 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.221924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:05.222281 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:05.222262    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:05.222357 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:05.222317    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:05.222357 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.221924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:05.222429 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:05.222411    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:05.498501 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.498344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wxshh" event={"ID":"dd7ab166-0228-46f6-ac36-f38a1ebe365f","Type":"ContainerStarted","Data":"18813b5679e84ee7a6b97e89918f8331162d89e5ee7f8a49ebb98dcb7703e0f2"}
Jul 30 09:50:05.500227 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.500191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bv2lv" event={"ID":"55368fb6-e950-4d09-9283-6c53a4946933","Type":"ContainerStarted","Data":"c24eb86f6346e59712dc50e6cc451a9ae1f0ae68000bd22a16d9e64311b943f4"}
Jul 30 09:50:05.501805 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.501751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-68zjd" event={"ID":"c64c4728-534c-48f4-96f2-296c35c37661","Type":"ContainerStarted","Data":"7065c356600dd3e9e0f1dcd5dcde44b439f562bbcb946cbd0342e2f35d815c80"}
Jul 30 09:50:05.503559 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.503536    2581 generic.go:356] "Generic (PLEG): container finished" podID="f0c02eae-446c-47fc-924f-6a7e61b4b34a" containerID="36c5b45e89333f4e51bed8be29ec62ae68cc60c8cd50b37b224a4cd526cb3301" exitCode=0
Jul 30 09:50:05.503691 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.503613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6prkf" event={"ID":"f0c02eae-446c-47fc-924f-6a7e61b4b34a","Type":"ContainerDied","Data":"36c5b45e89333f4e51bed8be29ec62ae68cc60c8cd50b37b224a4cd526cb3301"}
Jul 30 09:50:05.505203 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.505180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8fhn2" event={"ID":"f9439732-bedf-4e4f-ada8-150cf78abe3d","Type":"ContainerStarted","Data":"fd5f025daecc99021a0899c51340a6a28f0e4087bdfc65035204ce3a4a85969f"}
Jul 30 09:50:05.506739 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.506714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7" event={"ID":"451c46bf-e01e-4d7d-9cb9-e86f7340fb41","Type":"ContainerStarted","Data":"caa39f97b980a95fde85d67a8940b60d21f09ae6a38e6d298dab409cf0317591"}
Jul 30 09:50:05.509711 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.509691    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 09:50:05.510131 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.510108    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8e669b5-1ce0-404e-abe4-033e16dff345" containerID="98c567ff43e851f9e858e8c83199308196f06aeae990b59f1c65cfc8900bb3a0" exitCode=1
Jul 30 09:50:05.510245 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.510129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"80a2cb11ae79643ddc6e628d6b4d3e887940b5d90b83d4803596f67a025df10c"}
Jul 30 09:50:05.510245 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.510222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"e7710ad0c0c28ccf2123b720d08c5f1e9c519b0ae70285519b6072f7430f9665"}
Jul 30 09:50:05.510358 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.510254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"b262a021069a1471e5cfdd4de92eb6d66ccc3c72236e5c084eb749f0a07fc7bd"}
Jul 30 09:50:05.510358 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.510281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"ae83d3c09b69a42bb8ab4eb95acfa6d4ba0f4ce64f71dee9dded20b642bd8731"}
Jul 30 09:50:05.510358 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.510324    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerDied","Data":"98c567ff43e851f9e858e8c83199308196f06aeae990b59f1c65cfc8900bb3a0"}
Jul 30 09:50:05.510500 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.510385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"3ce1c4cc3265237a611bac7c8a60ffe0c65d491ca5f7a47fd5af2da61fb09d9b"}
Jul 30 09:50:05.511670 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.511646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lwvnt" event={"ID":"d636d07b-2602-411d-a566-9c7986c613cf","Type":"ContainerStarted","Data":"d0aec11865b74562f9094a41f34e42c5095308c659de8af36672fe117fe9291a"}
Jul 30 09:50:05.513276 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.513254    2581 generic.go:356] "Generic (PLEG): container finished" podID="9188f6af6c589fb0b7f34a2297e208ce" containerID="e70841d8ab8b5e0d169641a50e1e0556649eb8664d702baba95c11cb7b1bed14" exitCode=0
Jul 30 09:50:05.513358 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.513318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal" event={"ID":"9188f6af6c589fb0b7f34a2297e208ce","Type":"ContainerDied","Data":"e70841d8ab8b5e0d169641a50e1e0556649eb8664d702baba95c11cb7b1bed14"}
Jul 30 09:50:05.514699 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.514659    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-179.ec2.internal" podStartSLOduration=22.514643265 podStartE2EDuration="22.514643265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:04.507537385 +0000 UTC m=+22.851600840" watchObservedRunningTime="2026-07-30 09:50:05.514643265 +0000 UTC m=+23.858706722"
Jul 30 09:50:05.514953 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.514929    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wxshh" podStartSLOduration=1.7080343519999999 podStartE2EDuration="22.514919834s" totalImagesPullingTime="20.806885482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:05.514487182 +0000 UTC m=+23.858550661" watchObservedRunningTime="2026-07-30 09:50:05.514919834 +0000 UTC m=+23.858983289"
Jul 30 09:50:05.528941 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.528896    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bv2lv" podStartSLOduration=1.7146098950000002 podStartE2EDuration="22.528881789s" totalImagesPullingTime="20.814271894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:05.528416592 +0000 UTC m=+23.872480048" watchObservedRunningTime="2026-07-30 09:50:05.528881789 +0000 UTC m=+23.872945244"
Jul 30 09:50:05.619284 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.619236    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-68zjd" podStartSLOduration=1.7742677900000001 podStartE2EDuration="22.619213113s" totalImagesPullingTime="20.844945323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:05.619173341 +0000 UTC m=+23.963236799" watchObservedRunningTime="2026-07-30 09:50:05.619213113 +0000 UTC m=+23.963276580"
Jul 30 09:50:05.636959 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.636906    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lwvnt" podStartSLOduration=1.809692172 podStartE2EDuration="22.636883383s" totalImagesPullingTime="20.827191211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:05.636494503 +0000 UTC m=+23.980557976" watchObservedRunningTime="2026-07-30 09:50:05.636883383 +0000 UTC m=+23.980946842"
Jul 30 09:50:05.684779 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.684744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:05.741731 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.741695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:05.840622 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:05.840591    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:06.085288 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.085252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:06.160227 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.159582    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 09:50:06.385001 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.384910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:06.518696 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.518657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7" event={"ID":"451c46bf-e01e-4d7d-9cb9-e86f7340fb41","Type":"ContainerStarted","Data":"aa6005249d405f6c9fb221f2b2fc475a755f7f079d04807dde982ad98474c18d"}
Jul 30 09:50:06.520489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.520457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbzwq" event={"ID":"f3da972f-9412-4c93-bb03-17e040ebca18","Type":"ContainerStarted","Data":"1a08cc191d32bd964fcca37d83c664fcc133647c21ca13936f82b1046e79c5e4"}
Jul 30 09:50:06.523855 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.523812    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal" event={"ID":"9188f6af6c589fb0b7f34a2297e208ce","Type":"ContainerStarted","Data":"db57575b37835addd1635247a1a8d6c0873f6f5afc035050332c7185cee400a7"}
Jul 30 09:50:06.538754 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.537055    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8fhn2" podStartSLOduration=2.8226653600000002 podStartE2EDuration="23.537034511s" totalImagesPullingTime="20.714369151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:05.653506265 +0000 UTC m=+23.997569722" watchObservedRunningTime="2026-07-30 09:50:06.537034511 +0000 UTC m=+24.881097960"
Jul 30 09:50:06.538754 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.537440    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xbzwq" podStartSLOduration=2.699991894 podStartE2EDuration="23.537428973s" totalImagesPullingTime="20.837437079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:06.535617454 +0000 UTC m=+24.879680908" watchObservedRunningTime="2026-07-30 09:50:06.537428973 +0000 UTC m=+24.881492434"
Jul 30 09:50:06.550152 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.550108    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-179.ec2.internal" podStartSLOduration=23.550095155 podStartE2EDuration="23.550095155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:06.550031193 +0000 UTC m=+24.894094654" watchObservedRunningTime="2026-07-30 09:50:06.550095155 +0000 UTC m=+24.894158610"
Jul 30 09:50:06.740703 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:06.740615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:07.108898 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.108854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:07.151673 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.151549    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T09:50:06.1595962Z","UUID":"39fc4fa2-2876-4142-96e6-15160d100ec1","Handler":null,"Name":"","Endpoint":""}
Jul 30 09:50:07.153227 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.153204    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 09:50:07.153370 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.153246    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 09:50:07.177553 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.177526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:07.221990 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.221952    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:07.221990 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.221980    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:07.222227 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.222078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:07.222227 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:07.222088    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:07.222227 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:07.222175    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:07.222422 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:07.222262    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:07.527725 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:07.527697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7" event={"ID":"451c46bf-e01e-4d7d-9cb9-e86f7340fb41","Type":"ContainerStarted","Data":"a0a2c43a1e7a43e13cccbe4e4adaad1e5a57bd90a437f591737ec14f28f54178"}
Jul 30 09:50:08.258676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:08.258462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:08.358787 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:08.358755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:08.533598 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:08.533528    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 09:50:08.534033 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:08.533947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"6bc93df479df037c5740b5413d2b23163c485531dc9c42184e572dc0e82163c5"}
Jul 30 09:50:09.221785 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.221744    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:09.221785 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.221773    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:09.221785 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.221787    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:09.222110 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:09.221896    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:09.222110 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:09.221958    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:09.222110 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:09.222024    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:09.257584 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.257534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:09.378778 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.378732    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:09.459678 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.459635    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:09.527558 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.527472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:09.629992 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.629959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:09.744811 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.744775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:09.858830 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.858795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:09.864420 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.864367    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:50:09.865435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.865281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:50:09.921158 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:09.921088    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mpzj7" podStartSLOduration=3.774908904 podStartE2EDuration="26.92106516s" totalImagesPullingTime="23.146156256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:08.550930022 +0000 UTC m=+26.894993482" watchObservedRunningTime="2026-07-30 09:50:09.92106516 +0000 UTC m=+28.265128706"
Jul 30 09:50:10.004094 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.003916    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:10.093144 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.093120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:10.162249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.162221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:10.346762 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.346682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:10.539421 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.539393    2581 generic.go:356] "Generic (PLEG): container finished" podID="f0c02eae-446c-47fc-924f-6a7e61b4b34a" containerID="04c6fecb584c839cb247996a22bb6c58760454bc609595cb248fa9a38479c531" exitCode=0
Jul 30 09:50:10.539630 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.539481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6prkf" event={"ID":"f0c02eae-446c-47fc-924f-6a7e61b4b34a","Type":"ContainerDied","Data":"04c6fecb584c839cb247996a22bb6c58760454bc609595cb248fa9a38479c531"}
Jul 30 09:50:10.543141 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.543117    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 09:50:10.543625 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.543595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"b27a910aa83d1016933a8ee306290ea04524d4e675aba75074ead55d18e6d98b"}
Jul 30 09:50:10.543746 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.543729    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:50:10.544088 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.544071    2581 scope.go:117] "RemoveContainer" containerID="98c567ff43e851f9e858e8c83199308196f06aeae990b59f1c65cfc8900bb3a0"
Jul 30 09:50:10.544246 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.544231    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-68zjd"
Jul 30 09:50:10.676133 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:10.676109    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bv2lv_55368fb6-e950-4d09-9283-6c53a4946933/dns-node-resolver/0.log"
Jul 30 09:50:11.128033 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.128000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:11.189471 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.189437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:11.223061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.222983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:11.223061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.223029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:11.223061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.223029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:11.223365 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:11.223120    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:11.223365 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:11.223243    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:11.223471 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:11.223362    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:11.551136 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.551062    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 09:50:11.551666 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.551618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" event={"ID":"e8e669b5-1ce0-404e-abe4-033e16dff345","Type":"ContainerStarted","Data":"069c9a7a3271874a394cd6d1c0c8bd55b84310d4d6a0414981cb7ef2e87f255c"}
Jul 30 09:50:11.552040 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.552020    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:50:11.552160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.552102    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:50:11.552160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.552145    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:50:11.568811 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.568785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:50:11.569023 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.569009    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:50:11.580959 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.580907    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9" podStartSLOduration=7.376016496 podStartE2EDuration="28.580889144s" totalImagesPullingTime="21.204872648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:11.579718472 +0000 UTC m=+29.923781929" watchObservedRunningTime="2026-07-30 09:50:11.580889144 +0000 UTC m=+29.924952602"
Jul 30 09:50:11.676651 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.676622    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8fhn2_f9439732-bedf-4e4f-ada8-150cf78abe3d/node-ca/0.log"
Jul 30 09:50:11.795311 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.795055    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7wp2w"]
Jul 30 09:50:11.795439 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.795389    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:11.795519 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:11.795493    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:11.796036 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.796013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpltn"]
Jul 30 09:50:11.796123 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.796101    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:11.796188 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:11.796173    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:11.797302 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.797282    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6c4xt"]
Jul 30 09:50:11.797403 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:11.797375    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:11.797531 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:11.797487    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:12.257920 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:12.257883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:12.314357 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:12.314326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:12.556409 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:12.556378    2581 generic.go:356] "Generic (PLEG): container finished" podID="f0c02eae-446c-47fc-924f-6a7e61b4b34a" containerID="0ddc77bf1f49960973c334fb1051c74ebff74a9906657a805b9b47b73abd19e2" exitCode=0
Jul 30 09:50:12.556542 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:12.556454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6prkf" event={"ID":"f0c02eae-446c-47fc-924f-6a7e61b4b34a","Type":"ContainerDied","Data":"0ddc77bf1f49960973c334fb1051c74ebff74a9906657a805b9b47b73abd19e2"}
Jul 30 09:50:13.222560 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:13.222527    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:13.222985 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:13.222527    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:13.222985 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:13.222653    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:13.222985 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:13.222527    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:13.222985 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:13.222707    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:13.222985 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:13.222780    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:13.447230 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:13.447199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:13.689762 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:13.689730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:13.846356 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:13.846323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:13.944965 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:13.944936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:14.059494 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.059466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:14.216831 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.216736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:14.300605 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.300573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:14.402504 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.402475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:14.562686 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.562653    2581 generic.go:356] "Generic (PLEG): container finished" podID="f0c02eae-446c-47fc-924f-6a7e61b4b34a" containerID="97de10f20a43eaaa95286add0d0701237c853236f60b342f99b15aea3eca9e2e" exitCode=0
Jul 30 09:50:14.562838 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.562695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6prkf" event={"ID":"f0c02eae-446c-47fc-924f-6a7e61b4b34a","Type":"ContainerDied","Data":"97de10f20a43eaaa95286add0d0701237c853236f60b342f99b15aea3eca9e2e"}
Jul 30 09:50:14.868147 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.868110    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:14.868289 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:14.868259    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 09:50:14.868347 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:14.868327    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret podName:2e7c60fa-cb09-4408-9884-72da3cd0776c nodeName:}" failed. No retries permitted until 2026-07-30 09:50:46.868311451 +0000 UTC m=+65.212374886 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret") pod "global-pull-secret-syncer-lpltn" (UID: "2e7c60fa-cb09-4408-9884-72da3cd0776c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 09:50:14.893417 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.893390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:14.968472 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.968436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:14.968668 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:14.968481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:14.968668 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:14.968582    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 09:50:14.968668 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:14.968584    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:50:14.968668 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:14.968660    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs podName:f9b12b5e-bde1-4dca-8f5e-575a7f2448ef nodeName:}" failed. No retries permitted until 2026-07-30 09:50:46.968639981 +0000 UTC m=+65.312703430 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs") pod "network-metrics-daemon-6c4xt" (UID: "f9b12b5e-bde1-4dca-8f5e-575a7f2448ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 09:50:14.968927 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:14.968594    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 09:50:14.968927 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:14.968692    2581 projected.go:196] Error preparing data for projected volume kube-api-access-nvlzf for pod openshift-network-diagnostics/network-check-target-7wp2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:50:14.968927 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:14.968735    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf podName:c706a557-b56a-4b78-9b36-348511935520 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:46.96872236 +0000 UTC m=+65.312785795 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvlzf" (UniqueName: "kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf") pod "network-check-target-7wp2w" (UID: "c706a557-b56a-4b78-9b36-348511935520") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 09:50:15.222172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:15.222087    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:15.222335 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:15.222087    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:15.222335 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:15.222210    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:15.222335 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:15.222100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:15.222335 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:15.222314    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:15.222528 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:15.222406    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:15.948525 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:15.948495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:16.002739 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:16.002708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:16.284126 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:16.284044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:16.686598 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:16.686563    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:16.874520 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:16.874487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:17.221596 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:17.221554    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:17.222197 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:17.221681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:17.222197 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:17.221687    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:17.222197 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:17.221708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:17.222197 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:17.221812    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:17.222197 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:17.221926    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:17.222695 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:17.222673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:17.302274 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:17.302237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:17.685601 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:17.685563    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:18.387763 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:18.387724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:18.491206 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:18.491174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:18.694613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:18.694583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:18.891009 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:18.890977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:19.222113 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:19.222081    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:19.222292 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:19.222171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:19.222292 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:19.222270    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:19.222292 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:19.222173    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:19.222292 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:19.222176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:19.222442 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:19.222354    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:19.285443 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:19.285400    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:19.577487 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:19.577456    2581 generic.go:356] "Generic (PLEG): container finished" podID="f0c02eae-446c-47fc-924f-6a7e61b4b34a" containerID="2f777600585337c57df830e6fdbb7d2cea212ea7c36beb36e6be95fdad25ba01" exitCode=0
Jul 30 09:50:19.577981 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:19.577513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6prkf" event={"ID":"f0c02eae-446c-47fc-924f-6a7e61b4b34a","Type":"ContainerDied","Data":"2f777600585337c57df830e6fdbb7d2cea212ea7c36beb36e6be95fdad25ba01"}
Jul 30 09:50:19.878323 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:19.878234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:19.979626 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:19.979591    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:20.246461 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:20.246385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:20.476973 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:20.476938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:20.583074 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:20.583048    2581 generic.go:356] "Generic (PLEG): container finished" podID="f0c02eae-446c-47fc-924f-6a7e61b4b34a" containerID="d519f8ddc19e49c2766dbb5d2fb1ffeae686cef7897fa21e16f7a5566a25bde7" exitCode=0
Jul 30 09:50:20.583426 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:20.583092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6prkf" event={"ID":"f0c02eae-446c-47fc-924f-6a7e61b4b34a","Type":"ContainerDied","Data":"d519f8ddc19e49c2766dbb5d2fb1ffeae686cef7897fa21e16f7a5566a25bde7"}
Jul 30 09:50:20.680071 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:20.679902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:21.064648 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.064621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:21.128826 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.128788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:21.221579 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.221546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:21.221763 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.221546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:21.221763 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:21.221668    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:21.221763 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.221552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:21.221763 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:21.221728    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:21.222015 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:21.221789    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:21.275893 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.275862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:21.588082 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.588048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6prkf" event={"ID":"f0c02eae-446c-47fc-924f-6a7e61b4b34a","Type":"ContainerStarted","Data":"b4fbb1863c2b14d91c8d4993d7b1679016d182b06572032fb901e18078cc1980"}
Jul 30 09:50:21.610050 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.609956    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6prkf" podStartSLOduration=7.363879254 podStartE2EDuration="38.609941441s" totalImagesPullingTime="31.246062187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:21.609134371 +0000 UTC m=+39.953197826" watchObservedRunningTime="2026-07-30 09:50:21.609941441 +0000 UTC m=+39.954004897"
Jul 30 09:50:21.848262 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:21.848232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:22.017564 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:22.017485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:22.478862 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:22.478813    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:22.672502 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:22.672473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:23.075637 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:23.075612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:23.221854 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:23.221803    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:23.222025 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:23.221869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:23.222025 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:23.221960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:23.222025 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:23.221976    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:23.222131 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:23.222045    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:23.222131 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:23.222122    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:23.323496 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:23.323466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:23.677708 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:23.677681    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:24.086665 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:24.086636    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:24.278703 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:24.278672    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:24.546027 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:24.545943    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:24.604321 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:24.604292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:25.221789 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:25.221755    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:25.222275 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:25.221873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:25.222275 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:25.221886    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:25.222275 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:25.221902    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:25.222275 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:25.221959    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:25.222275 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:25.222063    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:27.222518 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:27.222479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:27.222921 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:27.222479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:27.222921 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:27.222604    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:27.222921 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:27.222479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:27.222921 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:27.222672    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:27.222921 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:27.222743    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:29.222395 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:29.222359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:29.222933 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:29.222359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:29.222933 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:29.222471    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:29.222933 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:29.222359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:29.222933 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:29.222542    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:29.222933 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:29.222630    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:31.222468 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:31.222426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:31.222468 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:31.222456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:31.222900 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:31.222527    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:31.222900 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:31.222426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:31.222900 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:31.222616    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:31.222900 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:31.222677    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:32.374629 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:32.374597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:32.542834 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:32.542790    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:32.641217 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:32.641149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:33.061786 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.061761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:33.165548 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.165515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:33.222090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.222060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:33.222261 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.222157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:33.222261 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:33.222164    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wp2w" podUID="c706a557-b56a-4b78-9b36-348511935520"
Jul 30 09:50:33.222261 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.222189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:33.222433 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:33.222268    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpltn" podUID="2e7c60fa-cb09-4408-9884-72da3cd0776c"
Jul 30 09:50:33.222433 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:33.222420    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c4xt" podUID="f9b12b5e-bde1-4dca-8f5e-575a7f2448ef"
Jul 30 09:50:33.417768 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.417738    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-179.ec2.internal" event="NodeReady"
Jul 30 09:50:33.418187 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.417869    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 09:50:33.503701 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.503664    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g45fw"]
Jul 30 09:50:33.519757 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.519725    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-777xr"]
Jul 30 09:50:33.519937 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.519877    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.523767 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.523741    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 09:50:33.523911 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.523780    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw2kw\""
Jul 30 09:50:33.523911 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.523741    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 09:50:33.533675 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.533651    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g45fw"]
Jul 30 09:50:33.533801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.533697    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-777xr"]
Jul 30 09:50:33.533801 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.533777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.534635 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.534612    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sff5w"]
Jul 30 09:50:33.537504 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.537485    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 09:50:33.537777 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.537755    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 09:50:33.537904 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.537792    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 09:50:33.537904 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.537802    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 09:50:33.537904 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.537874    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vvm58\""
Jul 30 09:50:33.556237 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.556204    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sff5w"]
Jul 30 09:50:33.556345 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.556307    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sff5w"
Jul 30 09:50:33.559535 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.559516    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 09:50:33.559661 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.559566    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 09:50:33.559847 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.559831    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s28zx\""
Jul 30 09:50:33.560046 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.560032    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 09:50:33.600586 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02d76a2-3fee-4543-973b-68cf39d7d30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.600586 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bca1e841-e31d-4be7-9548-4a20562bdc69-metrics-tls\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.600838 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f02d76a2-3fee-4543-973b-68cf39d7d30d-data-volume\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.600838 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02d76a2-3fee-4543-973b-68cf39d7d30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.600838 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psmtx\" (UniqueName: \"kubernetes.io/projected/bca1e841-e31d-4be7-9548-4a20562bdc69-kube-api-access-psmtx\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.600961 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfxmw\" (UniqueName: \"kubernetes.io/projected/f02d76a2-3fee-4543-973b-68cf39d7d30d-kube-api-access-wfxmw\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.600961 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600892    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpzft\" (UniqueName: \"kubernetes.io/projected/d11925bb-9b71-4172-94e8-7ab883f3fd8a-kube-api-access-bpzft\") pod \"ingress-canary-sff5w\" (UID: \"d11925bb-9b71-4172-94e8-7ab883f3fd8a\") " pod="openshift-ingress-canary/ingress-canary-sff5w"
Jul 30 09:50:33.600961 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca1e841-e31d-4be7-9548-4a20562bdc69-tmp-dir\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.600961 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f02d76a2-3fee-4543-973b-68cf39d7d30d-crio-socket\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.601124 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.600984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bca1e841-e31d-4be7-9548-4a20562bdc69-config-volume\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.601124 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.601027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d11925bb-9b71-4172-94e8-7ab883f3fd8a-cert\") pod \"ingress-canary-sff5w\" (UID: \"d11925bb-9b71-4172-94e8-7ab883f3fd8a\") " pod="openshift-ingress-canary/ingress-canary-sff5w"
Jul 30 09:50:33.627942 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.627909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:33.701415 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca1e841-e31d-4be7-9548-4a20562bdc69-tmp-dir\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.701415 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f02d76a2-3fee-4543-973b-68cf39d7d30d-crio-socket\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.701415 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bca1e841-e31d-4be7-9548-4a20562bdc69-config-volume\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.701660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d11925bb-9b71-4172-94e8-7ab883f3fd8a-cert\") pod \"ingress-canary-sff5w\" (UID: \"d11925bb-9b71-4172-94e8-7ab883f3fd8a\") " pod="openshift-ingress-canary/ingress-canary-sff5w"
Jul 30 09:50:33.701660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02d76a2-3fee-4543-973b-68cf39d7d30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.701660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bca1e841-e31d-4be7-9548-4a20562bdc69-metrics-tls\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.701660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f02d76a2-3fee-4543-973b-68cf39d7d30d-data-volume\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.701660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02d76a2-3fee-4543-973b-68cf39d7d30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.701660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f02d76a2-3fee-4543-973b-68cf39d7d30d-crio-socket\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.701660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psmtx\" (UniqueName: \"kubernetes.io/projected/bca1e841-e31d-4be7-9548-4a20562bdc69-kube-api-access-psmtx\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.701660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfxmw\" (UniqueName: \"kubernetes.io/projected/f02d76a2-3fee-4543-973b-68cf39d7d30d-kube-api-access-wfxmw\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.702645 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpzft\" (UniqueName: \"kubernetes.io/projected/d11925bb-9b71-4172-94e8-7ab883f3fd8a-kube-api-access-bpzft\") pod \"ingress-canary-sff5w\" (UID: \"d11925bb-9b71-4172-94e8-7ab883f3fd8a\") " pod="openshift-ingress-canary/ingress-canary-sff5w"
Jul 30 09:50:33.702645 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca1e841-e31d-4be7-9548-4a20562bdc69-tmp-dir\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.702645 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.701906    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f02d76a2-3fee-4543-973b-68cf39d7d30d-data-volume\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.702645 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.702228    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02d76a2-3fee-4543-973b-68cf39d7d30d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.702645 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.702382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bca1e841-e31d-4be7-9548-4a20562bdc69-config-volume\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.705635 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.705612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02d76a2-3fee-4543-973b-68cf39d7d30d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.705730 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.705613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bca1e841-e31d-4be7-9548-4a20562bdc69-metrics-tls\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.705787 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.705769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d11925bb-9b71-4172-94e8-7ab883f3fd8a-cert\") pod \"ingress-canary-sff5w\" (UID: \"d11925bb-9b71-4172-94e8-7ab883f3fd8a\") " pod="openshift-ingress-canary/ingress-canary-sff5w"
Jul 30 09:50:33.715491 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.715471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psmtx\" (UniqueName: \"kubernetes.io/projected/bca1e841-e31d-4be7-9548-4a20562bdc69-kube-api-access-psmtx\") pod \"dns-default-g45fw\" (UID: \"bca1e841-e31d-4be7-9548-4a20562bdc69\") " pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.720117 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.720099    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfxmw\" (UniqueName: \"kubernetes.io/projected/f02d76a2-3fee-4543-973b-68cf39d7d30d-kube-api-access-wfxmw\") pod \"insights-runtime-extractor-777xr\" (UID: \"f02d76a2-3fee-4543-973b-68cf39d7d30d\") " pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.721912 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.721894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpzft\" (UniqueName: \"kubernetes.io/projected/d11925bb-9b71-4172-94e8-7ab883f3fd8a-kube-api-access-bpzft\") pod \"ingress-canary-sff5w\" (UID: \"d11925bb-9b71-4172-94e8-7ab883f3fd8a\") " pod="openshift-ingress-canary/ingress-canary-sff5w"
Jul 30 09:50:33.723929 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.723907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:33.801549 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.801517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:33.829524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.829498    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:33.842673 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.842643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-777xr"
Jul 30 09:50:33.864440 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:33.864412    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sff5w"
Jul 30 09:50:34.039997 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:34.039966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g45fw"]
Jul 30 09:50:34.043663 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:34.043638    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca1e841_e31d_4be7_9548_4a20562bdc69.slice/crio-0976bc4fc51394e7aa04391672d3cb7ea6fbbacbb5b5accdce6dfb549fb29f76 WatchSource:0}: Error finding container 0976bc4fc51394e7aa04391672d3cb7ea6fbbacbb5b5accdce6dfb549fb29f76: Status 404 returned error can't find the container with id 0976bc4fc51394e7aa04391672d3cb7ea6fbbacbb5b5accdce6dfb549fb29f76
Jul 30 09:50:34.053730 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:34.053702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sff5w"]
Jul 30 09:50:34.056469 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:34.056445    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11925bb_9b71_4172_94e8_7ab883f3fd8a.slice/crio-ac6779cce1a879b6427caeae228927914f8f4177445b9fc3d27c073448a93815 WatchSource:0}: Error finding container ac6779cce1a879b6427caeae228927914f8f4177445b9fc3d27c073448a93815: Status 404 returned error can't find the container with id ac6779cce1a879b6427caeae228927914f8f4177445b9fc3d27c073448a93815
Jul 30 09:50:34.276698 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:34.276624    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-777xr"]
Jul 30 09:50:34.279489 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:34.279465    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02d76a2_3fee_4543_973b_68cf39d7d30d.slice/crio-469fa733f4abc8077d3b2be80ba1e955e532e2b6d00cd390deceff696b28faa9 WatchSource:0}: Error finding container 469fa733f4abc8077d3b2be80ba1e955e532e2b6d00cd390deceff696b28faa9: Status 404 returned error can't find the container with id 469fa733f4abc8077d3b2be80ba1e955e532e2b6d00cd390deceff696b28faa9
Jul 30 09:50:34.618735 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:34.618691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g45fw" event={"ID":"bca1e841-e31d-4be7-9548-4a20562bdc69","Type":"ContainerStarted","Data":"0976bc4fc51394e7aa04391672d3cb7ea6fbbacbb5b5accdce6dfb549fb29f76"}
Jul 30 09:50:34.619922 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:34.619891    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sff5w" event={"ID":"d11925bb-9b71-4172-94e8-7ab883f3fd8a","Type":"ContainerStarted","Data":"ac6779cce1a879b6427caeae228927914f8f4177445b9fc3d27c073448a93815"}
Jul 30 09:50:34.621090 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:34.621066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-777xr" event={"ID":"f02d76a2-3fee-4543-973b-68cf39d7d30d","Type":"ContainerStarted","Data":"469fa733f4abc8077d3b2be80ba1e955e532e2b6d00cd390deceff696b28faa9"}
Jul 30 09:50:35.224026 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.222381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:35.224026 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.222861    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:35.224026 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.223453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:35.227686 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.225557    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 09:50:35.229020 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.228130    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fxw5q\""
Jul 30 09:50:35.229020 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.228387    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 09:50:35.229020 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.228603    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 09:50:35.229020 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.228648    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l5pnh\""
Jul 30 09:50:35.229020 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:35.228844    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 09:50:36.061189 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:36.061138    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:36.115936 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:36.115902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:36.629135 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:36.629100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g45fw" event={"ID":"bca1e841-e31d-4be7-9548-4a20562bdc69","Type":"ContainerStarted","Data":"1ed1ee12cbc13ed2bf6dd2cafc9f7b138b7bdd32227228f5b8ad50369d87ab82"}
Jul 30 09:50:36.629297 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:36.629156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g45fw" event={"ID":"bca1e841-e31d-4be7-9548-4a20562bdc69","Type":"ContainerStarted","Data":"908543c3566f1492b6403f573584e8d41ea98a49aa8b1e8eff4ba623fca71da3"}
Jul 30 09:50:36.629297 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:36.629253    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:36.647274 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:36.647220    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g45fw" podStartSLOduration=1.403781027 podStartE2EDuration="3.647201912s" totalImagesPullingTime="2.243420885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:36.646645615 +0000 UTC m=+54.990709071" watchObservedRunningTime="2026-07-30 09:50:36.647201912 +0000 UTC m=+54.991265370"
Jul 30 09:50:40.640518 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:40.640460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sff5w" event={"ID":"d11925bb-9b71-4172-94e8-7ab883f3fd8a","Type":"ContainerStarted","Data":"eb70a1ed84db0cd5d8592db6691ebf3d5d7d1e06ed9b642fa6c1ab3257941ba4"}
Jul 30 09:50:40.641962 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:40.641939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-777xr" event={"ID":"f02d76a2-3fee-4543-973b-68cf39d7d30d","Type":"ContainerStarted","Data":"323bc249de5e1069609ff7ba239f09055963990cd9c0ba41d28c6d2fbd8a300c"}
Jul 30 09:50:40.657635 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:40.657588    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sff5w" podStartSLOduration=1.592556871 podStartE2EDuration="7.657574852s" totalImagesPullingTime="6.065017981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:40.65667381 +0000 UTC m=+59.000737266" watchObservedRunningTime="2026-07-30 09:50:40.657574852 +0000 UTC m=+59.001638317"
Jul 30 09:50:43.570191 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:43.570159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtsn9"
Jul 30 09:50:43.719983 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:43.719950    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:44.085590 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.085562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:44.666100 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.666072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:44.826336 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.826304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:44.832382 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.832356    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"]
Jul 30 09:50:44.843502 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.843428    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"]
Jul 30 09:50:44.843634 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.843535    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"
Jul 30 09:50:44.845606 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.845578    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 30 09:50:44.845733 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.845586    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rw6ds\""
Jul 30 09:50:44.892441 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.892404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f0993c7e-24ba-45f2-8ac6-6972f972b198-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xp9p4\" (UID: \"f0993c7e-24ba-45f2-8ac6-6972f972b198\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"
Jul 30 09:50:44.993755 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:44.993715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f0993c7e-24ba-45f2-8ac6-6972f972b198-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xp9p4\" (UID: \"f0993c7e-24ba-45f2-8ac6-6972f972b198\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"
Jul 30 09:50:44.993974 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:44.993918    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 30 09:50:44.994046 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:50:44.994009    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0993c7e-24ba-45f2-8ac6-6972f972b198-tls-certificates podName:f0993c7e-24ba-45f2-8ac6-6972f972b198 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:45.49398897 +0000 UTC m=+63.838052441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f0993c7e-24ba-45f2-8ac6-6972f972b198-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-xp9p4" (UID: "f0993c7e-24ba-45f2-8ac6-6972f972b198") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 30 09:50:45.068074 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:45.068043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:45.497891 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:45.497857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f0993c7e-24ba-45f2-8ac6-6972f972b198-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xp9p4\" (UID: \"f0993c7e-24ba-45f2-8ac6-6972f972b198\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"
Jul 30 09:50:45.500447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:45.500422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f0993c7e-24ba-45f2-8ac6-6972f972b198-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xp9p4\" (UID: \"f0993c7e-24ba-45f2-8ac6-6972f972b198\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"
Jul 30 09:50:45.658916 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:45.658880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-777xr" event={"ID":"f02d76a2-3fee-4543-973b-68cf39d7d30d","Type":"ContainerStarted","Data":"22268f7748c7288ddeab8e2ed9b4d2e939bb75a1c5bb4625a15c69408fb925d1"}
Jul 30 09:50:45.752454 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:45.752343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"
Jul 30 09:50:45.898987 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:45.898952    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"]
Jul 30 09:50:45.902438 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:45.902408    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0993c7e_24ba_45f2_8ac6_6972f972b198.slice/crio-f2e80cd2b5dab59f7eda3bd189996c1d667712f38bff60f6f9da2f98a69f8a69 WatchSource:0}: Error finding container f2e80cd2b5dab59f7eda3bd189996c1d667712f38bff60f6f9da2f98a69f8a69: Status 404 returned error can't find the container with id f2e80cd2b5dab59f7eda3bd189996c1d667712f38bff60f6f9da2f98a69f8a69
Jul 30 09:50:46.284203 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.284170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:46.349298 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.349259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:46.633558 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.633526    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g45fw"
Jul 30 09:50:46.659733 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.659694    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-rjm76"]
Jul 30 09:50:46.661706 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.661681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-rjm76"
Jul 30 09:50:46.664211 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.664167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4" event={"ID":"f0993c7e-24ba-45f2-8ac6-6972f972b198","Type":"ContainerStarted","Data":"f2e80cd2b5dab59f7eda3bd189996c1d667712f38bff60f6f9da2f98a69f8a69"}
Jul 30 09:50:46.664533 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.664507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 09:50:46.664878 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.664792    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 09:50:46.664982 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.664902    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nghd5\""
Jul 30 09:50:46.677927 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.677897    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-rjm76"]
Jul 30 09:50:46.678586 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.678332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:46.779977 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.779938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:46.808836 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.808785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px2db\" (UniqueName: \"kubernetes.io/projected/679015b0-4770-47c3-b5aa-6c4a8f4a596d-kube-api-access-px2db\") pod \"downloads-7c97dc4555-rjm76\" (UID: \"679015b0-4770-47c3-b5aa-6c4a8f4a596d\") " pod="openshift-console/downloads-7c97dc4555-rjm76"
Jul 30 09:50:46.838107 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.838071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:46.910318 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.910223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px2db\" (UniqueName: \"kubernetes.io/projected/679015b0-4770-47c3-b5aa-6c4a8f4a596d-kube-api-access-px2db\") pod \"downloads-7c97dc4555-rjm76\" (UID: \"679015b0-4770-47c3-b5aa-6c4a8f4a596d\") " pod="openshift-console/downloads-7c97dc4555-rjm76"
Jul 30 09:50:46.910318 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.910285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:46.913253 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.913229    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 09:50:46.919061 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.919026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px2db\" (UniqueName: \"kubernetes.io/projected/679015b0-4770-47c3-b5aa-6c4a8f4a596d-kube-api-access-px2db\") pod \"downloads-7c97dc4555-rjm76\" (UID: \"679015b0-4770-47c3-b5aa-6c4a8f4a596d\") " pod="openshift-console/downloads-7c97dc4555-rjm76"
Jul 30 09:50:46.923125 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.923088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e7c60fa-cb09-4408-9884-72da3cd0776c-original-pull-secret\") pod \"global-pull-secret-syncer-lpltn\" (UID: \"2e7c60fa-cb09-4408-9884-72da3cd0776c\") " pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:46.959364 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.959312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:46.960288 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.960015    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpltn"
Jul 30 09:50:46.971726 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:46.971702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-rjm76"
Jul 30 09:50:47.010932 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.010900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:47.011114 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.010971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:47.013340 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.013310    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 09:50:47.013476 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.013387    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 09:50:47.024159 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.024132    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 09:50:47.024307 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.024236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b12b5e-bde1-4dca-8f5e-575a7f2448ef-metrics-certs\") pod \"network-metrics-daemon-6c4xt\" (UID: \"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef\") " pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:47.035087 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.035061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvlzf\" (UniqueName: \"kubernetes.io/projected/c706a557-b56a-4b78-9b36-348511935520-kube-api-access-nvlzf\") pod \"network-check-target-7wp2w\" (UID: \"c706a557-b56a-4b78-9b36-348511935520\") " pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:47.133146 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.133095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:47.244630 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.244560    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l5pnh\""
Jul 30 09:50:47.253316 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.253286    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:47.254237 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.254217    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fxw5q\""
Jul 30 09:50:47.262332 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.262312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c4xt"
Jul 30 09:50:47.328237 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.328205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:47.391985 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.391958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:47.558393 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.558355    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:47.624724 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:47.624691    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:48.357550 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.357519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:48.522353 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.522279    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpltn"]
Jul 30 09:50:48.527117 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:48.527082    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7c60fa_cb09_4408_9884_72da3cd0776c.slice/crio-d5664fef6d9367b1e6dd48ee5a9a49d9e88f0cc2847170d8e81ebdf71617e9fa WatchSource:0}: Error finding container d5664fef6d9367b1e6dd48ee5a9a49d9e88f0cc2847170d8e81ebdf71617e9fa: Status 404 returned error can't find the container with id d5664fef6d9367b1e6dd48ee5a9a49d9e88f0cc2847170d8e81ebdf71617e9fa
Jul 30 09:50:48.565891 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.565861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-rjm76"]
Jul 30 09:50:48.570037 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:48.570011    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679015b0_4770_47c3_b5aa_6c4a8f4a596d.slice/crio-7c5959806f1839b66771d3a220208edd878affacf1b45fb67b3914e665dfac68 WatchSource:0}: Error finding container 7c5959806f1839b66771d3a220208edd878affacf1b45fb67b3914e665dfac68: Status 404 returned error can't find the container with id 7c5959806f1839b66771d3a220208edd878affacf1b45fb67b3914e665dfac68
Jul 30 09:50:48.672520 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.672417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-777xr" event={"ID":"f02d76a2-3fee-4543-973b-68cf39d7d30d","Type":"ContainerStarted","Data":"a59348b111ddf235891699d9eadce21d406a98f461f5a9605c4dd1649101aed9"}
Jul 30 09:50:48.673792 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.673768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4" event={"ID":"f0993c7e-24ba-45f2-8ac6-6972f972b198","Type":"ContainerStarted","Data":"ed3d313c2de5398e6c2396ca219d082ff2691e1f154c11fd2bfdaa02b40f0631"}
Jul 30 09:50:48.673976 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.673943    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"
Jul 30 09:50:48.675036 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.675013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-rjm76" event={"ID":"679015b0-4770-47c3-b5aa-6c4a8f4a596d","Type":"ContainerStarted","Data":"7c5959806f1839b66771d3a220208edd878affacf1b45fb67b3914e665dfac68"}
Jul 30 09:50:48.676386 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.676364    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpltn" event={"ID":"2e7c60fa-cb09-4408-9884-72da3cd0776c","Type":"ContainerStarted","Data":"d5664fef6d9367b1e6dd48ee5a9a49d9e88f0cc2847170d8e81ebdf71617e9fa"}
Jul 30 09:50:48.679078 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.679062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4"
Jul 30 09:50:48.690661 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.690620    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-777xr" podStartSLOduration=1.777749435 podStartE2EDuration="15.690607385s" totalImagesPullingTime="13.91285795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:50:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:48.690106679 +0000 UTC m=+67.034170136" watchObservedRunningTime="2026-07-30 09:50:48.690607385 +0000 UTC m=+67.034670840"
Jul 30 09:50:48.707074 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.707029    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xp9p4" podStartSLOduration=2.249578521 podStartE2EDuration="4.707014688s" totalImagesPullingTime="2.457436167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:48.70601962 +0000 UTC m=+67.050083076" watchObservedRunningTime="2026-07-30 09:50:48.707014688 +0000 UTC m=+67.051078143"
Jul 30 09:50:48.738861 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.738812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:48.747323 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.747245    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7wp2w"]
Jul 30 09:50:48.747935 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.747905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6c4xt"]
Jul 30 09:50:48.750000 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:48.749978    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b12b5e_bde1_4dca_8f5e_575a7f2448ef.slice/crio-5080e8786fc51fc3c3bfdd0d24cce98cc646b36d45f98cfd56713051f622720a WatchSource:0}: Error finding container 5080e8786fc51fc3c3bfdd0d24cce98cc646b36d45f98cfd56713051f622720a: Status 404 returned error can't find the container with id 5080e8786fc51fc3c3bfdd0d24cce98cc646b36d45f98cfd56713051f622720a
Jul 30 09:50:48.750461 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:48.750436    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc706a557_b56a_4b78_9b36_348511935520.slice/crio-4bdcc2388e37e354b19e9cbd495649ee62db973bf500b4eb4b20a98c3857074d WatchSource:0}: Error finding container 4bdcc2388e37e354b19e9cbd495649ee62db973bf500b4eb4b20a98c3857074d: Status 404 returned error can't find the container with id 4bdcc2388e37e354b19e9cbd495649ee62db973bf500b4eb4b20a98c3857074d
Jul 30 09:50:48.860802 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.860771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:48.901453 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.901426    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-47rlb"]
Jul 30 09:50:48.904262 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.904243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:48.906432 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.906395    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 09:50:48.906432 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.906396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zvn6t\""
Jul 30 09:50:48.906686 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.906402    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 30 09:50:48.906686 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.906510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 30 09:50:48.906686 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.906535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 09:50:48.906852 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.906803    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 09:50:48.914799 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.914779    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-47rlb"]
Jul 30 09:50:48.930835 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.930760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:48.985342 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:48.985311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:49.024684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.024650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.024684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.024687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.024896 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.024707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.024896 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.024762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktcz9\" (UniqueName: \"kubernetes.io/projected/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-kube-api-access-ktcz9\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.125613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.125546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.125613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.125597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.125876 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.125634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcz9\" (UniqueName: \"kubernetes.io/projected/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-kube-api-access-ktcz9\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.125876 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.125705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.126743 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.126712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.129639 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.129611    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.133880 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.133275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.138049 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.138001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktcz9\" (UniqueName: \"kubernetes.io/projected/1ae5300b-c8ed-4133-8747-3d9c8aafebf2-kube-api-access-ktcz9\") pod \"prometheus-operator-84d69f794d-47rlb\" (UID: \"1ae5300b-c8ed-4133-8747-3d9c8aafebf2\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.139834 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.139701    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:49.213516 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.213202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb"
Jul 30 09:50:49.397524 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.397418    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-47rlb"]
Jul 30 09:50:49.401450 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:49.401408    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae5300b_c8ed_4133_8747_3d9c8aafebf2.slice/crio-fdaadeb5b84edfe5f6e88d8e40f283a8354ef1906733cd79ce69564b90a49566 WatchSource:0}: Error finding container fdaadeb5b84edfe5f6e88d8e40f283a8354ef1906733cd79ce69564b90a49566: Status 404 returned error can't find the container with id fdaadeb5b84edfe5f6e88d8e40f283a8354ef1906733cd79ce69564b90a49566
Jul 30 09:50:49.682525 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.682455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb" event={"ID":"1ae5300b-c8ed-4133-8747-3d9c8aafebf2","Type":"ContainerStarted","Data":"fdaadeb5b84edfe5f6e88d8e40f283a8354ef1906733cd79ce69564b90a49566"}
Jul 30 09:50:49.684297 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.684260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6c4xt" event={"ID":"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef","Type":"ContainerStarted","Data":"5080e8786fc51fc3c3bfdd0d24cce98cc646b36d45f98cfd56713051f622720a"}
Jul 30 09:50:49.686927 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.686286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7wp2w" event={"ID":"c706a557-b56a-4b78-9b36-348511935520","Type":"ContainerStarted","Data":"4bdcc2388e37e354b19e9cbd495649ee62db973bf500b4eb4b20a98c3857074d"}
Jul 30 09:50:49.752428 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.752391    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:49.809454 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:49.809415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:50.694638 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:50.694599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6c4xt" event={"ID":"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef","Type":"ContainerStarted","Data":"ebe1de308cd73d32398e214c690e67f63c6bb606a6da1ed59ac92d39e2fb5810"}
Jul 30 09:50:50.695220 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:50.694661    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6c4xt" event={"ID":"f9b12b5e-bde1-4dca-8f5e-575a7f2448ef","Type":"ContainerStarted","Data":"22637aaccc3132d78d63ed3a5c80473aa46bee839cca9e16271c873ef85b7576"}
Jul 30 09:50:50.710421 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:50.710363    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6c4xt" podStartSLOduration=66.330135148 podStartE2EDuration="1m7.710316729s" totalImagesPullingTime="1.380181581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:50.70991045 +0000 UTC m=+69.053973906" watchObservedRunningTime="2026-07-30 09:50:50.710316729 +0000 UTC m=+69.054380186"
Jul 30 09:50:50.840271 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:50.840204    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:50.939960 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:50.939925    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:52.620637 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:52.620590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:52.681295 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:52.681258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:53.395950 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:53.395912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:53.461785 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:53.461751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:54.710943 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:54.710722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb" event={"ID":"1ae5300b-c8ed-4133-8747-3d9c8aafebf2","Type":"ContainerStarted","Data":"b62fa63b1ed1c392d1dccc3d270fd37ef458568d75d5d7f7bc30685194e3ad9d"}
Jul 30 09:50:54.713214 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:54.713009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7wp2w" event={"ID":"c706a557-b56a-4b78-9b36-348511935520","Type":"ContainerStarted","Data":"ba074c6361f502b665e942711c6edbbaba55c897747d5b62c5fd2dfb999f9eb5"}
Jul 30 09:50:54.713214 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:54.713112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:50:54.730316 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:54.730248    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7wp2w" podStartSLOduration=65.855788639 podStartE2EDuration="1m11.730226293s" totalImagesPullingTime="5.874437654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:54.730174873 +0000 UTC m=+73.074238330" watchObservedRunningTime="2026-07-30 09:50:54.730226293 +0000 UTC m=+73.074289755"
Jul 30 09:50:54.938415 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:54.938329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:55.355720 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.355687    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:55.413670 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.413629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:55.486920 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.486880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:55.542902 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.542868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:55.672458 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.672369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:55.718545 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.718504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpltn" event={"ID":"2e7c60fa-cb09-4408-9884-72da3cd0776c","Type":"ContainerStarted","Data":"97d0c3812217cfe05ca86c6da9120fdba9040331586311b65eecbe626d9208aa"}
Jul 30 09:50:55.720811 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.720772    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb" event={"ID":"1ae5300b-c8ed-4133-8747-3d9c8aafebf2","Type":"ContainerStarted","Data":"a2c5250f3b453cee4f5dd08cc921e6f77629e137c0c9b702b9bcd72877c4de96"}
Jul 30 09:50:55.732863 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.732783    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lpltn" podStartSLOduration=66.626811763 podStartE2EDuration="1m12.73276226s" totalImagesPullingTime="6.105950497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:55.732473717 +0000 UTC m=+74.076537172" watchObservedRunningTime="2026-07-30 09:50:55.73276226 +0000 UTC m=+74.076825697"
Jul 30 09:50:55.739013 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.738965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:55.753460 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:55.753376    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-47rlb" podStartSLOduration=2.54228253 podStartE2EDuration="7.753357063s" totalImagesPullingTime="5.211074533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:55.751314883 +0000 UTC m=+74.095378340" watchObservedRunningTime="2026-07-30 09:50:55.753357063 +0000 UTC m=+74.097420520"
Jul 30 09:50:56.752846 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.752799    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d4fd6f7-xhmqm"]
Jul 30 09:50:56.755028 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.755005    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.756987 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.756961    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 09:50:56.757101 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.756984    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 09:50:56.757101 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.757050    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 09:50:56.757570 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.757542    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 09:50:56.757687 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.757551    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 09:50:56.757687 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.757656    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4jqs8\""
Jul 30 09:50:56.767966 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.767919    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4fd6f7-xhmqm"]
Jul 30 09:50:56.888211 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.888172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-service-ca\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.888388 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.888231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-oauth-config\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.888388 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.888260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-config\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.888485 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.888378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d7p9\" (UniqueName: \"kubernetes.io/projected/efccfac0-2670-471e-8ff3-d9b7afe86d45-kube-api-access-2d7p9\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.888485 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.888438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-serving-cert\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.888485 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.888465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-oauth-serving-cert\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.989545 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.989508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-service-ca\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.989744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.989568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-oauth-config\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.989744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.989590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-config\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.989744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.989623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d7p9\" (UniqueName: \"kubernetes.io/projected/efccfac0-2670-471e-8ff3-d9b7afe86d45-kube-api-access-2d7p9\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.989744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.989653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-serving-cert\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.989744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.989672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-oauth-serving-cert\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.990378 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.990348    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-service-ca\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.990493 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.990441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-config\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.990552 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.990488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-oauth-serving-cert\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.992435 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.992412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-oauth-config\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.992627 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.992610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-serving-cert\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:56.997336 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:56.997304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:57.004528 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.004473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d7p9\" (UniqueName: \"kubernetes.io/projected/efccfac0-2670-471e-8ff3-d9b7afe86d45-kube-api-access-2d7p9\") pod \"console-6d4fd6f7-xhmqm\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") " pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:57.065674 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.065637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:50:57.245001 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.244969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4fd6f7-xhmqm"]
Jul 30 09:50:57.248579 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:57.248550    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefccfac0_2670_471e_8ff3_d9b7afe86d45.slice/crio-2269e28de853878e367d647fa48cf29fe164ea072838106738c68163b575bf19 WatchSource:0}: Error finding container 2269e28de853878e367d647fa48cf29fe164ea072838106738c68163b575bf19: Status 404 returned error can't find the container with id 2269e28de853878e367d647fa48cf29fe164ea072838106738c68163b575bf19
Jul 30 09:50:57.282128 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.282027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:57.355956 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.355922    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ss4c2"]
Jul 30 09:50:57.359211 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.359187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.363046 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.362772    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 09:50:57.363046 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.362780    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 09:50:57.363046 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.362846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 09:50:57.363046 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.362888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jfvzg\""
Jul 30 09:50:57.366220 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.366187    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"]
Jul 30 09:50:57.368847 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.368806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.371407 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.371383    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fnd8n\""
Jul 30 09:50:57.371486 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.371443    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 30 09:50:57.371731 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.371712    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 30 09:50:57.371837 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.371745    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 30 09:50:57.384395 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.384371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"]
Jul 30 09:50:57.414931 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.414899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:57.493808 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.493770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q924\" (UniqueName: \"kubernetes.io/projected/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-api-access-4q924\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.494018 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.493833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.494018 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.493890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.494018 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.493914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.494018 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.493953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b847446-5e4d-46dd-a09f-21c2a63b4eae-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.494215 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-root\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.494215 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.494215 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-sys\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.494215 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b847446-5e4d-46dd-a09f-21c2a63b4eae-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.494215 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.494215 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-textfile\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.494392 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-tls\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.494392 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-wtmp\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.494392 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpddj\" (UniqueName: \"kubernetes.io/projected/1ee094a2-2252-49ce-b61f-fd8945f8ba21-kube-api-access-lpddj\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.494392 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.494314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ee094a2-2252-49ce-b61f-fd8945f8ba21-metrics-client-ca\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.595706 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.595917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.595917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.595917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b847446-5e4d-46dd-a09f-21c2a63b4eae-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.595917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-root\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.595917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.595917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-sys\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.595917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b847446-5e4d-46dd-a09f-21c2a63b4eae-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-root\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.595980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-textfile\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-tls\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-sys\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-wtmp\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpddj\" (UniqueName: \"kubernetes.io/projected/1ee094a2-2252-49ce-b61f-fd8945f8ba21-kube-api-access-lpddj\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ee094a2-2252-49ce-b61f-fd8945f8ba21-metrics-client-ca\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q924\" (UniqueName: \"kubernetes.io/projected/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-api-access-4q924\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.596885 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-textfile\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.596885 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-wtmp\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.597023 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.596980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.597217 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.597195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ee094a2-2252-49ce-b61f-fd8945f8ba21-metrics-client-ca\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.597831 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.597797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.598636 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.598332    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b847446-5e4d-46dd-a09f-21c2a63b4eae-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.598636 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.598602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b847446-5e4d-46dd-a09f-21c2a63b4eae-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.599126 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.599092    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.599249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.599100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-tls\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.599314 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.599283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.600775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.600757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ee094a2-2252-49ce-b61f-fd8945f8ba21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.605357 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.605333    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpddj\" (UniqueName: \"kubernetes.io/projected/1ee094a2-2252-49ce-b61f-fd8945f8ba21-kube-api-access-lpddj\") pod \"node-exporter-ss4c2\" (UID: \"1ee094a2-2252-49ce-b61f-fd8945f8ba21\") " pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.605456 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.605361    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q924\" (UniqueName: \"kubernetes.io/projected/3b847446-5e4d-46dd-a09f-21c2a63b4eae-kube-api-access-4q924\") pod \"kube-state-metrics-56d9f944b4-mb7bj\" (UID: \"3b847446-5e4d-46dd-a09f-21c2a63b4eae\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.670225 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.670190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ss4c2"
Jul 30 09:50:57.679375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.679348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"
Jul 30 09:50:57.730191 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.730153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4fd6f7-xhmqm" event={"ID":"efccfac0-2670-471e-8ff3-d9b7afe86d45","Type":"ContainerStarted","Data":"2269e28de853878e367d647fa48cf29fe164ea072838106738c68163b575bf19"}
Jul 30 09:50:57.731530 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.731481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss4c2" event={"ID":"1ee094a2-2252-49ce-b61f-fd8945f8ba21","Type":"ContainerStarted","Data":"4e85da8102c6e95c77ff4717825dd4d826cd0bdffd9d76ff8c0bde58105f017e"}
Jul 30 09:50:57.825585 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:57.825547    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj"]
Jul 30 09:50:57.828162 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:57.828132    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b847446_5e4d_46dd_a09f_21c2a63b4eae.slice/crio-990add2297def851edb62cd2773ed3a9cf0bbd9df3755ff4445533e4a0334c4e WatchSource:0}: Error finding container 990add2297def851edb62cd2773ed3a9cf0bbd9df3755ff4445533e4a0334c4e: Status 404 returned error can't find the container with id 990add2297def851edb62cd2773ed3a9cf0bbd9df3755ff4445533e4a0334c4e
Jul 30 09:50:58.066951 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.066920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:58.352208 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.352117    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:50:58.355238 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.355211    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.359924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.359984    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.360162    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.360169    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.360311    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.360361    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9m294\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.359924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.360558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.360586    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 09:50:58.360775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.360686    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 09:50:58.376661 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.376629    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:50:58.503213 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-config-out\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503402 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503402 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503402 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn25j\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-kube-api-access-pn25j\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503402 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503629 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503629 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503629 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503629 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-web-config\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503629 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503629 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503944 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.503944 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.503696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604322 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604322 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604535 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn25j\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-kube-api-access-pn25j\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604535 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604535 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604535 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604535 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604535 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-web-config\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604535 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604879 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604879 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604879 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.604879 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.604644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-config-out\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.605904 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.605875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.607195 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.606387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.607272 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.607210    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.610516 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.610467    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.614559 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.612964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-web-config\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.614559 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.613460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.614559 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.613895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.614559 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.614139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-config-out\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.614559 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.614532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.615316 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.614999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.615413 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.615367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.616972 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.616792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.627966 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.627908    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn25j\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-kube-api-access-pn25j\") pod \"alertmanager-main-0\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.671581 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.671319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:50:58.743693 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.743657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj" event={"ID":"3b847446-5e4d-46dd-a09f-21c2a63b4eae","Type":"ContainerStarted","Data":"990add2297def851edb62cd2773ed3a9cf0bbd9df3755ff4445533e4a0334c4e"}
Jul 30 09:50:58.769690 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.769579    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:58.871153 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:58.871052    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:50:59.052072 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:59.052028    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:50:59.056509 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:50:59.056453    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5926320_a029_411f_86d9_8d45cae4707f.slice/crio-7072dac7ce72356b842b746435faf91cf65d4da88aec9adf85b8d75bb4bdcb3c WatchSource:0}: Error finding container 7072dac7ce72356b842b746435faf91cf65d4da88aec9adf85b8d75bb4bdcb3c: Status 404 returned error can't find the container with id 7072dac7ce72356b842b746435faf91cf65d4da88aec9adf85b8d75bb4bdcb3c
Jul 30 09:50:59.750554 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:59.750479    2581 generic.go:356] "Generic (PLEG): container finished" podID="1ee094a2-2252-49ce-b61f-fd8945f8ba21" containerID="a6e2c1ac77f25e817be10c068901831fc77d77ada26e7c25e0f946a0d61d65f8" exitCode=0
Jul 30 09:50:59.750733 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:59.750599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss4c2" event={"ID":"1ee094a2-2252-49ce-b61f-fd8945f8ba21","Type":"ContainerDied","Data":"a6e2c1ac77f25e817be10c068901831fc77d77ada26e7c25e0f946a0d61d65f8"}
Jul 30 09:50:59.752309 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:50:59.752277    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerStarted","Data":"7072dac7ce72356b842b746435faf91cf65d4da88aec9adf85b8d75bb4bdcb3c"}
Jul 30 09:51:00.215490 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:00.215451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:00.309780 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:00.309738    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:00.477419 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:00.477338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:00.576616 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:00.576572    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:01.772689 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:01.772653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:02.408338 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:02.408302    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:02.478956 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:02.478925    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:03.527057 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.527020    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:51:03.604043 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.604011    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:51:03.604224 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.604183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.609751 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.609573    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.611918    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.611929    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.612082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.612122    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.612241    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.612243    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.612352    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.612467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 09:51:03.612741 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.612627    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7sflpc00e3jv0\""
Jul 30 09:51:03.613296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.613000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 09:51:03.613296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.613202    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 09:51:03.613418 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.613402    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 09:51:03.613484 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.613442    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hpm6m\""
Jul 30 09:51:03.613754 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.613636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 09:51:03.615952 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.615914    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 09:51:03.631571 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.631531    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 09:51:03.750334 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750334 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750334 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.750613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr6rf\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-kube-api-access-qr6rf\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.751029 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.750983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.851566 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.851744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr6rf\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-kube-api-access-qr6rf\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.851744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.851744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.851744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.851744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.851990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.852019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.852055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.852077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.852113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.852142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852519 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.852377    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.852831 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.852779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.853053 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.853029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.855736 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.855710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.856234 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.856210    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.857100 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.856756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.857100 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.857006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.858089 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.857644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.859761 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.858784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.859761 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.859320    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.861701 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.860994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.861701 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.861374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.861883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.861777    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.862367 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.862310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.862665 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.862524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.862665 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.862640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr6rf\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-kube-api-access-qr6rf\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.862836 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.862780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.863263 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.863244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.864450 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.864428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.865084 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.865063    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.917628 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.917575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:03.951786 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:03.951743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:04.166834 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:04.166743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:04.253492 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:04.253413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:04.873126 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:04.873079    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:04.982097 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:04.982062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:06.136926 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:06.136888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:06.261877 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:06.261840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:08.709687 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:08.709650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:51:08.789634 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:08.789593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss4c2" event={"ID":"1ee094a2-2252-49ce-b61f-fd8945f8ba21","Type":"ContainerStarted","Data":"d779d605c4491d78e1034564f9e86686be7e1c7cc6e6942b13a71fc91d31e00f"}
Jul 30 09:51:08.893632 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:51:08.893587    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1c1c7b_bddf_43dc_8bdb_6b3af08bf1ed.slice/crio-0233d5f7f3f9b1b661005427404f974f23449fce6ac547ccc18c7bd3a3910d77 WatchSource:0}: Error finding container 0233d5f7f3f9b1b661005427404f974f23449fce6ac547ccc18c7bd3a3910d77: Status 404 returned error can't find the container with id 0233d5f7f3f9b1b661005427404f974f23449fce6ac547ccc18c7bd3a3910d77
Jul 30 09:51:09.013114 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.013065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:09.192687 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.192656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:09.796004 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.795917    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-rjm76" event={"ID":"679015b0-4770-47c3-b5aa-6c4a8f4a596d","Type":"ContainerStarted","Data":"1d1334e036b552d5cf943af426a965b9175b48791dd82ed7cac104e5de79fbc4"}
Jul 30 09:51:09.796502 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.796096    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-rjm76"
Jul 30 09:51:09.798885 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.798854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss4c2" event={"ID":"1ee094a2-2252-49ce-b61f-fd8945f8ba21","Type":"ContainerStarted","Data":"f829aa15d3fd5643635729448884d20abd48f0a4655a2d9ee0f0499ea68b56cd"}
Jul 30 09:51:09.800920 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.800886    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerID="fe4dd0208ca9d15ea87ff0eb34f002280d862345c1df61a2ce8e64f9a28bc1e9" exitCode=0
Jul 30 09:51:09.801062 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.800931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerDied","Data":"fe4dd0208ca9d15ea87ff0eb34f002280d862345c1df61a2ce8e64f9a28bc1e9"}
Jul 30 09:51:09.801062 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.801017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerStarted","Data":"0233d5f7f3f9b1b661005427404f974f23449fce6ac547ccc18c7bd3a3910d77"}
Jul 30 09:51:09.802803 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.802779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4fd6f7-xhmqm" event={"ID":"efccfac0-2670-471e-8ff3-d9b7afe86d45","Type":"ContainerStarted","Data":"df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7"}
Jul 30 09:51:09.806111 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.806083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj" event={"ID":"3b847446-5e4d-46dd-a09f-21c2a63b4eae","Type":"ContainerStarted","Data":"7e986f0bece89b66760aa20e74499a7e76356e71bd752ca7e231de812115c5bc"}
Jul 30 09:51:09.806213 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.806143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj" event={"ID":"3b847446-5e4d-46dd-a09f-21c2a63b4eae","Type":"ContainerStarted","Data":"10fb99885992e7e8a851aaac1b35f945e8c092b580f1b1fd9172bf4df98c5513"}
Jul 30 09:51:09.806213 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.806184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj" event={"ID":"3b847446-5e4d-46dd-a09f-21c2a63b4eae","Type":"ContainerStarted","Data":"2069c6d4b58f3e053926068eb2a00438b2e021ea36b82cf9f72e07177e97cd2b"}
Jul 30 09:51:09.807922 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.807889    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5926320-a029-411f-86d9-8d45cae4707f" containerID="e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd" exitCode=0
Jul 30 09:51:09.808023 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.807928    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerDied","Data":"e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd"}
Jul 30 09:51:09.808093 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.808060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-rjm76"
Jul 30 09:51:09.815593 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.815551    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-rjm76" podStartSLOduration=3.172452093 podStartE2EDuration="23.815536206s" totalImagesPullingTime="20.643084113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:09.813416215 +0000 UTC m=+88.157479693" watchObservedRunningTime="2026-07-30 09:51:09.815536206 +0000 UTC m=+88.159599663"
Jul 30 09:51:09.876774 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.876716    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d4fd6f7-xhmqm" podStartSLOduration=2.576083135 podStartE2EDuration="13.87669331s" totalImagesPullingTime="11.300610175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:09.84250597 +0000 UTC m=+88.186569427" watchObservedRunningTime="2026-07-30 09:51:09.87669331 +0000 UTC m=+88.220756768"
Jul 30 09:51:09.876976 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.876878    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ss4c2" podStartSLOduration=11.605694644 podStartE2EDuration="12.876864959s" totalImagesPullingTime="1.188819402s" totalInitContainerRuntime="82.350913ms" isStatefulPod=true podCreationTimestamp="2026-07-30 09:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:09.874662043 +0000 UTC m=+88.218725493" watchObservedRunningTime="2026-07-30 09:51:09.876864959 +0000 UTC m=+88.220928407"
Jul 30 09:51:09.908765 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:09.908702    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mb7bj" podStartSLOduration=2.196820731 podStartE2EDuration="12.908682273s" totalImagesPullingTime="10.711861542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:09.907023688 +0000 UTC m=+88.251087147" watchObservedRunningTime="2026-07-30 09:51:09.908682273 +0000 UTC m=+88.252745729"
Jul 30 09:51:11.047588 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:11.046749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:11.147318 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:11.147256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:11.248965 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:11.248932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:11.346314 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:11.346044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:12.832483 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:12.832322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerStarted","Data":"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da"}
Jul 30 09:51:13.163764 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:13.163684    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:13.264172 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:13.264118    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:13.842522 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:13.842484    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerStarted","Data":"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9"}
Jul 30 09:51:13.843032 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:13.842568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerStarted","Data":"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea"}
Jul 30 09:51:14.118312 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:14.118205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:14.851901 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:14.851863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerStarted","Data":"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30"}
Jul 30 09:51:14.852310 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:14.851936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerStarted","Data":"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4"}
Jul 30 09:51:15.859319 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:15.859285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerStarted","Data":"455091287a047b7230936ed6cee7d4cf5210ba06b10b86ccfd709b142ab82e84"}
Jul 30 09:51:15.859927 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:15.859354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerStarted","Data":"29dec1a7593c629a557920f7dfaaf953e3d9f282b71580d21bf6dd5b0f6c848c"}
Jul 30 09:51:16.462259 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:16.462152    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4fd6f7-xhmqm"]
Jul 30 09:51:16.564185 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:16.564143    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:16.632452 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:16.632414    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:16.868773 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:16.868737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerStarted","Data":"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a"}
Jul 30 09:51:16.913280 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:16.913207    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.635839305 podStartE2EDuration="18.913182896s" totalImagesPullingTime="14.243946252s" totalInitContainerRuntime="33.397339ms" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:16.908932291 +0000 UTC m=+95.252995749" watchObservedRunningTime="2026-07-30 09:51:16.913182896 +0000 UTC m=+95.257246355"
Jul 30 09:51:17.066356 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:17.066317    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:51:17.416221 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:17.416182    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:17.486473 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:17.486436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:18.881145 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:18.881116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerStarted","Data":"3a03d92c2ce51d3ede2cca7713b506c29f397e25b53ad874f17d81008133943e"}
Jul 30 09:51:18.881476 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:18.881193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerStarted","Data":"3f050d95d05ccf55448b23eb7af60c658e6057a8a3115c11764fc1dc7a141404"}
Jul 30 09:51:19.892104 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:19.892069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerStarted","Data":"971e367ffe6c848aaff3e5da4a04af9a9350adfda6a76c4641f0297429ddde10"}
Jul 30 09:51:19.892484 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:19.892159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerStarted","Data":"d6d7ab55dfe7647d3463640d05af04525257b338a135da7467ee2f4e657d8d0e"}
Jul 30 09:51:19.923292 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:19.923237    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.9020592050000005 podStartE2EDuration="16.923218519s" totalImagesPullingTime="9.006190261s" totalInitContainerRuntime="14.969053ms" isStatefulPod=false podCreationTimestamp="2026-07-30 09:51:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:19.920799567 +0000 UTC m=+98.264863062" watchObservedRunningTime="2026-07-30 09:51:19.923218519 +0000 UTC m=+98.267281974"
Jul 30 09:51:20.596030 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:20.595993    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:20.696995 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:20.696958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:21.277691 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:21.277656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:21.372220 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:21.372190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:23.918007 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:23.917970    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:51:25.724006 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:25.723971    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7wp2w"
Jul 30 09:51:36.396560 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:36.396522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:36.630469 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:36.630436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:40.249806 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:40.249768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:40.311923 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:40.311886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:40.370229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:40.370195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:41.493864 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.493803    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d4fd6f7-xhmqm" podUID="efccfac0-2670-471e-8ff3-d9b7afe86d45" containerName="console" containerID="cri-o://df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7" gracePeriod=15
Jul 30 09:51:41.756025 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.755951    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:51:41.902096 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-oauth-serving-cert\") pod \"efccfac0-2670-471e-8ff3-d9b7afe86d45\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") "
Jul 30 09:51:41.902096 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902100    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-config\") pod \"efccfac0-2670-471e-8ff3-d9b7afe86d45\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") "
Jul 30 09:51:41.902423 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d7p9\" (UniqueName: \"kubernetes.io/projected/efccfac0-2670-471e-8ff3-d9b7afe86d45-kube-api-access-2d7p9\") pod \"efccfac0-2670-471e-8ff3-d9b7afe86d45\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") "
Jul 30 09:51:41.902423 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902183    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-service-ca\") pod \"efccfac0-2670-471e-8ff3-d9b7afe86d45\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") "
Jul 30 09:51:41.902423 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902217    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-oauth-config\") pod \"efccfac0-2670-471e-8ff3-d9b7afe86d45\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") "
Jul 30 09:51:41.902423 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902241    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-serving-cert\") pod \"efccfac0-2670-471e-8ff3-d9b7afe86d45\" (UID: \"efccfac0-2670-471e-8ff3-d9b7afe86d45\") "
Jul 30 09:51:41.902626 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902600    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "efccfac0-2670-471e-8ff3-d9b7afe86d45" (UID: "efccfac0-2670-471e-8ff3-d9b7afe86d45"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:51:41.902735 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902714    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-config" (OuterVolumeSpecName: "console-config") pod "efccfac0-2670-471e-8ff3-d9b7afe86d45" (UID: "efccfac0-2670-471e-8ff3-d9b7afe86d45"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:51:41.902842 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.902728    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-service-ca" (OuterVolumeSpecName: "service-ca") pod "efccfac0-2670-471e-8ff3-d9b7afe86d45" (UID: "efccfac0-2670-471e-8ff3-d9b7afe86d45"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:51:41.904523 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.904497    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "efccfac0-2670-471e-8ff3-d9b7afe86d45" (UID: "efccfac0-2670-471e-8ff3-d9b7afe86d45"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:51:41.904610 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.904556    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efccfac0-2670-471e-8ff3-d9b7afe86d45-kube-api-access-2d7p9" (OuterVolumeSpecName: "kube-api-access-2d7p9") pod "efccfac0-2670-471e-8ff3-d9b7afe86d45" (UID: "efccfac0-2670-471e-8ff3-d9b7afe86d45"). InnerVolumeSpecName "kube-api-access-2d7p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:51:41.904610 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.904581    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "efccfac0-2670-471e-8ff3-d9b7afe86d45" (UID: "efccfac0-2670-471e-8ff3-d9b7afe86d45"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:51:41.975262 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.975230    2581 generic.go:356] "Generic (PLEG): container finished" podID="efccfac0-2670-471e-8ff3-d9b7afe86d45" containerID="df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7" exitCode=0
Jul 30 09:51:41.975454 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.975285    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4fd6f7-xhmqm"
Jul 30 09:51:41.975454 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.975306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4fd6f7-xhmqm" event={"ID":"efccfac0-2670-471e-8ff3-d9b7afe86d45","Type":"ContainerDied","Data":"df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7"}
Jul 30 09:51:41.975454 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.975356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4fd6f7-xhmqm" event={"ID":"efccfac0-2670-471e-8ff3-d9b7afe86d45","Type":"ContainerDied","Data":"2269e28de853878e367d647fa48cf29fe164ea072838106738c68163b575bf19"}
Jul 30 09:51:41.975454 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.975382    2581 scope.go:117] "RemoveContainer" containerID="df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7"
Jul 30 09:51:41.984031 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.984011    2581 scope.go:117] "RemoveContainer" containerID="df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7"
Jul 30 09:51:41.984279 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:51:41.984257    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7\": container with ID starting with df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7 not found: ID does not exist" containerID="df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7"
Jul 30 09:51:41.984350 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.984287    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7"} err="failed to get container status \"df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7\": rpc error: code = NotFound desc = could not find container \"df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7\": container with ID starting with df301baa685e58bce3391e340bbd595b04e432693039323fe653e0fd6caca0b7 not found: ID does not exist"
Jul 30 09:51:41.996717 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:41.996695    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4fd6f7-xhmqm"]
Jul 30 09:51:42.000391 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:42.000370    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d4fd6f7-xhmqm"]
Jul 30 09:51:42.003487 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:42.003469    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-oauth-serving-cert\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:51:42.003572 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:42.003488    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-config\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:51:42.003572 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:42.003502    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d7p9\" (UniqueName: \"kubernetes.io/projected/efccfac0-2670-471e-8ff3-d9b7afe86d45-kube-api-access-2d7p9\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:51:42.003572 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:42.003515    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efccfac0-2670-471e-8ff3-d9b7afe86d45-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:51:42.003572 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:42.003528    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-oauth-config\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:51:42.003572 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:42.003543    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efccfac0-2670-471e-8ff3-d9b7afe86d45-console-serving-cert\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:51:42.226799 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:42.226765    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efccfac0-2670-471e-8ff3-d9b7afe86d45" path="/var/lib/kubelet/pods/efccfac0-2670-471e-8ff3-d9b7afe86d45/volumes"
Jul 30 09:51:47.252712 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:47.252671    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:51:47.382882 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:51:47.382852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:52:03.918358 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:03.918312    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:03.938449 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:03.938418    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:04.070783 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:04.070758    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:04.736309 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:04.736277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:52:16.483109 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:16.483077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:52:16.613717 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:16.613662    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:52:17.544447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:17.544411    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:52:17.544885 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:17.544742    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="alertmanager" containerID="cri-o://1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da" gracePeriod=120
Jul 30 09:52:17.544885 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:17.544834    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy-metric" containerID="cri-o://cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30" gracePeriod=120
Jul 30 09:52:17.545030 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:17.544878    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="config-reloader" containerID="cri-o://1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea" gracePeriod=120
Jul 30 09:52:17.545030 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:17.544902    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy" containerID="cri-o://14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4" gracePeriod=120
Jul 30 09:52:17.545030 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:17.544850    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy-web" containerID="cri-o://a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9" gracePeriod=120
Jul 30 09:52:17.545030 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:17.545022    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="prom-label-proxy" containerID="cri-o://da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a" gracePeriod=120
Jul 30 09:52:18.109727 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.109695    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5926320-a029-411f-86d9-8d45cae4707f" containerID="da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a" exitCode=0
Jul 30 09:52:18.109727 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.109721    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5926320-a029-411f-86d9-8d45cae4707f" containerID="14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4" exitCode=0
Jul 30 09:52:18.109727 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.109728    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5926320-a029-411f-86d9-8d45cae4707f" containerID="1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea" exitCode=0
Jul 30 09:52:18.109727 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.109733    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5926320-a029-411f-86d9-8d45cae4707f" containerID="1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da" exitCode=0
Jul 30 09:52:18.110022 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.109768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerDied","Data":"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a"}
Jul 30 09:52:18.110022 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.109852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerDied","Data":"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4"}
Jul 30 09:52:18.110022 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.109882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerDied","Data":"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea"}
Jul 30 09:52:18.110022 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.109908    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerDied","Data":"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da"}
Jul 30 09:52:18.793368 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.793340    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:18.896925 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.896810    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-tls-assets\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.896925 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.896879    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-main-tls\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.896925 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.896903    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-main-db\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.896925 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.896923    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.896945    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-config-volume\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.896961    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-metrics-client-ca\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.896983    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn25j\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-kube-api-access-pn25j\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897010    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-web-config\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897038    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-config-out\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-web\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897114    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-cluster-tls-config\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897166    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897249 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897199    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-trusted-ca-bundle\") pod \"a5926320-a029-411f-86d9-8d45cae4707f\" (UID: \"a5926320-a029-411f-86d9-8d45cae4707f\") "
Jul 30 09:52:18.897660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 09:52:18.897660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897441    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:18.897660 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897564    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-main-db\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.897867 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.897838    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:18.899762 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.899727    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-config-volume" (OuterVolumeSpecName: "config-volume") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:18.899919 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.899811    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-kube-api-access-pn25j" (OuterVolumeSpecName: "kube-api-access-pn25j") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "kube-api-access-pn25j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:52:18.899919 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.899850    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:52:18.900237 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.900193    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:18.900437 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.900407    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:18.900543 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.900433    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:18.900643 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.900617    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:18.901592 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.901564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-config-out" (OuterVolumeSpecName: "config-out") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 09:52:18.903975 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.903772    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:18.911268 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.911242    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-web-config" (OuterVolumeSpecName: "web-config") pod "a5926320-a029-411f-86d9-8d45cae4707f" (UID: "a5926320-a029-411f-86d9-8d45cae4707f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:18.998924 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998887    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-tls-assets\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.998924 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998918    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-main-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.998924 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998928    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998937    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998947    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-metrics-client-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998963    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn25j\" (UniqueName: \"kubernetes.io/projected/a5926320-a029-411f-86d9-8d45cae4707f-kube-api-access-pn25j\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998973    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-web-config\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998981    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5926320-a029-411f-86d9-8d45cae4707f-config-out\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998990    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.998998    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-cluster-tls-config\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.999007    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5926320-a029-411f-86d9-8d45cae4707f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:18.999156 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:18.999015    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5926320-a029-411f-86d9-8d45cae4707f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:19.116228 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.116194    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5926320-a029-411f-86d9-8d45cae4707f" containerID="cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30" exitCode=0
Jul 30 09:52:19.116228 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.116217    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5926320-a029-411f-86d9-8d45cae4707f" containerID="a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9" exitCode=0
Jul 30 09:52:19.116434 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.116255    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerDied","Data":"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30"}
Jul 30 09:52:19.116434 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.116269    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.116434 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.116315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerDied","Data":"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9"}
Jul 30 09:52:19.116434 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.116349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5926320-a029-411f-86d9-8d45cae4707f","Type":"ContainerDied","Data":"7072dac7ce72356b842b746435faf91cf65d4da88aec9adf85b8d75bb4bdcb3c"}
Jul 30 09:52:19.116434 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.116384    2581 scope.go:117] "RemoveContainer" containerID="da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a"
Jul 30 09:52:19.124804 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.124782    2581 scope.go:117] "RemoveContainer" containerID="cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30"
Jul 30 09:52:19.132010 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.131993    2581 scope.go:117] "RemoveContainer" containerID="14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4"
Jul 30 09:52:19.139367 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.139344    2581 scope.go:117] "RemoveContainer" containerID="a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9"
Jul 30 09:52:19.140723 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.140703    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:52:19.145126 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.145103    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:52:19.147396 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.147381    2581 scope.go:117] "RemoveContainer" containerID="1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea"
Jul 30 09:52:19.154714 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.154695    2581 scope.go:117] "RemoveContainer" containerID="1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da"
Jul 30 09:52:19.161837 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.161792    2581 scope.go:117] "RemoveContainer" containerID="e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd"
Jul 30 09:52:19.169436 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.169417    2581 scope.go:117] "RemoveContainer" containerID="da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a"
Jul 30 09:52:19.169728 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:52:19.169707    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a\": container with ID starting with da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a not found: ID does not exist" containerID="da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a"
Jul 30 09:52:19.169786 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.169737    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a"} err="failed to get container status \"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a\": rpc error: code = NotFound desc = could not find container \"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a\": container with ID starting with da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a not found: ID does not exist"
Jul 30 09:52:19.169786 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.169758    2581 scope.go:117] "RemoveContainer" containerID="cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30"
Jul 30 09:52:19.170056 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:52:19.170036    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30\": container with ID starting with cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30 not found: ID does not exist" containerID="cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30"
Jul 30 09:52:19.170109 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.170062    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30"} err="failed to get container status \"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30\": rpc error: code = NotFound desc = could not find container \"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30\": container with ID starting with cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30 not found: ID does not exist"
Jul 30 09:52:19.170109 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.170078    2581 scope.go:117] "RemoveContainer" containerID="14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4"
Jul 30 09:52:19.170504 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:52:19.170478    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4\": container with ID starting with 14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4 not found: ID does not exist" containerID="14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4"
Jul 30 09:52:19.170617 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.170512    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4"} err="failed to get container status \"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4\": rpc error: code = NotFound desc = could not find container \"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4\": container with ID starting with 14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4 not found: ID does not exist"
Jul 30 09:52:19.170617 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.170533    2581 scope.go:117] "RemoveContainer" containerID="a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9"
Jul 30 09:52:19.171355 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:52:19.171326    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9\": container with ID starting with a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9 not found: ID does not exist" containerID="a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9"
Jul 30 09:52:19.171483 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.171361    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9"} err="failed to get container status \"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9\": rpc error: code = NotFound desc = could not find container \"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9\": container with ID starting with a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9 not found: ID does not exist"
Jul 30 09:52:19.171483 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.171381    2581 scope.go:117] "RemoveContainer" containerID="1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea"
Jul 30 09:52:19.171928 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:52:19.171909    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea\": container with ID starting with 1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea not found: ID does not exist" containerID="1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea"
Jul 30 09:52:19.171990 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.171933    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea"} err="failed to get container status \"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea\": rpc error: code = NotFound desc = could not find container \"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea\": container with ID starting with 1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea not found: ID does not exist"
Jul 30 09:52:19.171990 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.171949    2581 scope.go:117] "RemoveContainer" containerID="1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da"
Jul 30 09:52:19.172186 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:52:19.172171    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da\": container with ID starting with 1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da not found: ID does not exist" containerID="1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da"
Jul 30 09:52:19.172230 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172189    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da"} err="failed to get container status \"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da\": rpc error: code = NotFound desc = could not find container \"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da\": container with ID starting with 1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da not found: ID does not exist"
Jul 30 09:52:19.172230 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172201    2581 scope.go:117] "RemoveContainer" containerID="e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd"
Jul 30 09:52:19.172444 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:52:19.172422    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd\": container with ID starting with e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd not found: ID does not exist" containerID="e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd"
Jul 30 09:52:19.172517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172453    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd"} err="failed to get container status \"e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd\": rpc error: code = NotFound desc = could not find container \"e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd\": container with ID starting with e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd not found: ID does not exist"
Jul 30 09:52:19.172517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172466    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:52:19.172517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172474    2581 scope.go:117] "RemoveContainer" containerID="da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a"
Jul 30 09:52:19.172728 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172716    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efccfac0-2670-471e-8ff3-d9b7afe86d45" containerName="console"
Jul 30 09:52:19.172728 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172718    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a"} err="failed to get container status \"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a\": rpc error: code = NotFound desc = could not find container \"da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a\": container with ID starting with da013133ad083dd4ccc10ad57a492e85da4a90854ad030dea2a2d4484a5cb57a not found: ID does not exist"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172730    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efccfac0-2670-471e-8ff3-d9b7afe86d45" containerName="console"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172734    2581 scope.go:117] "RemoveContainer" containerID="cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172743    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="init-config-reloader"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172750    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="init-config-reloader"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172758    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy-web"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172763    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy-web"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172771    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172777    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172787    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="config-reloader"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172795    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="config-reloader"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172806    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy-metric"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172812    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy-metric"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172839    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="prom-label-proxy"
Jul 30 09:52:19.172843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172848    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="prom-label-proxy"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172858    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="alertmanager"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172867    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="alertmanager"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172914    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="config-reloader"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172923    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy-web"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172932    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="prom-label-proxy"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172941    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172947    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efccfac0-2670-471e-8ff3-d9b7afe86d45" containerName="console"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172952    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="kube-rbac-proxy-metric"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172958    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5926320-a029-411f-86d9-8d45cae4707f" containerName="alertmanager"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.172980    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30"} err="failed to get container status \"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30\": rpc error: code = NotFound desc = could not find container \"cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30\": container with ID starting with cee927758f4aaeb89fa7153e2839adc586ecff214a010ce63171e09fa3092d30 not found: ID does not exist"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173000    2581 scope.go:117] "RemoveContainer" containerID="14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173182    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4"} err="failed to get container status \"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4\": rpc error: code = NotFound desc = could not find container \"14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4\": container with ID starting with 14208e4b0369040bfdfca288dc11af6ded874bbb38d8dd33429fdf476b7ff4f4 not found: ID does not exist"
Jul 30 09:52:19.173375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173195    2581 scope.go:117] "RemoveContainer" containerID="a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9"
Jul 30 09:52:19.173857 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173391    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9"} err="failed to get container status \"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9\": rpc error: code = NotFound desc = could not find container \"a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9\": container with ID starting with a6ff27da54b65234195d3fdb7e57aa257fa0f08bb9d9dc253ec1ca9f1cf840d9 not found: ID does not exist"
Jul 30 09:52:19.173857 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173406    2581 scope.go:117] "RemoveContainer" containerID="1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea"
Jul 30 09:52:19.173857 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173605    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea"} err="failed to get container status \"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea\": rpc error: code = NotFound desc = could not find container \"1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea\": container with ID starting with 1ed74315032eb35b8b950ca1e673f7a2c69e9d83258bac5591d9fcfceb21fbea not found: ID does not exist"
Jul 30 09:52:19.173857 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173621    2581 scope.go:117] "RemoveContainer" containerID="1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da"
Jul 30 09:52:19.174074 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173855    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da"} err="failed to get container status \"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da\": rpc error: code = NotFound desc = could not find container \"1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da\": container with ID starting with 1c7f070b04255db2f36219a21823697f58197a1a198a3785bd5ff8db52ea99da not found: ID does not exist"
Jul 30 09:52:19.174074 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.173879    2581 scope.go:117] "RemoveContainer" containerID="e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd"
Jul 30 09:52:19.174150 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.174110    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd"} err="failed to get container status \"e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd\": rpc error: code = NotFound desc = could not find container \"e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd\": container with ID starting with e883c9858afe9cc839052cc8358be53dca169f27fddd13899352aa7ba93a2cbd not found: ID does not exist"
Jul 30 09:52:19.176432 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.176417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.178719 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.178692    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 09:52:19.178852 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.178834    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 09:52:19.179160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.179012    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 09:52:19.179160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.179025    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 09:52:19.179160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.179035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 09:52:19.179160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.179012    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9m294\""
Jul 30 09:52:19.179160 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.179116    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 09:52:19.179422 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.179296    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 09:52:19.179422 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.179353    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 09:52:19.185455 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.185432    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 09:52:19.192994 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.192971    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:52:19.301131 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-826vx\" (UniqueName: \"kubernetes.io/projected/975db069-8a4f-40ee-b749-877667c38633-kube-api-access-826vx\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301131 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/975db069-8a4f-40ee-b749-877667c38633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975db069-8a4f-40ee-b749-877667c38633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/975db069-8a4f-40ee-b749-877667c38633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301504 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-web-config\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301553 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301553 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/975db069-8a4f-40ee-b749-877667c38633-config-out\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301626 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-config-volume\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301626 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301716 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301762 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301797 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975db069-8a4f-40ee-b749-877667c38633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.301881 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.301866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403259 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403259 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-826vx\" (UniqueName: \"kubernetes.io/projected/975db069-8a4f-40ee-b749-877667c38633-kube-api-access-826vx\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403259 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/975db069-8a4f-40ee-b749-877667c38633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403483 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975db069-8a4f-40ee-b749-877667c38633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403483 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/975db069-8a4f-40ee-b749-877667c38633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403483 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-web-config\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403483 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/975db069-8a4f-40ee-b749-877667c38633-config-out\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-config-volume\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.403676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975db069-8a4f-40ee-b749-877667c38633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.404001 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.403841    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/975db069-8a4f-40ee-b749-877667c38633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.404436 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.404406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975db069-8a4f-40ee-b749-877667c38633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.404539 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.404416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975db069-8a4f-40ee-b749-877667c38633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.406340 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.406220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/975db069-8a4f-40ee-b749-877667c38633-config-out\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.406340 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.406243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/975db069-8a4f-40ee-b749-877667c38633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.406506 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.406378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.406735 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.406704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-web-config\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.406872 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.406773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.406940 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.406905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.406940 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.406922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-config-volume\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.407108 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.407087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.408191 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.408175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/975db069-8a4f-40ee-b749-877667c38633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.410744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.410723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-826vx\" (UniqueName: \"kubernetes.io/projected/975db069-8a4f-40ee-b749-877667c38633-kube-api-access-826vx\") pod \"alertmanager-main-0\" (UID: \"975db069-8a4f-40ee-b749-877667c38633\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.487052 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.487008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 09:52:19.624729 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:52:19.624477    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975db069_8a4f_40ee_b749_877667c38633.slice/crio-6608bdf3eba1266a0d9ebf4133f2e14069685e9e8afbeeacd64c88e1b2515a82 WatchSource:0}: Error finding container 6608bdf3eba1266a0d9ebf4133f2e14069685e9e8afbeeacd64c88e1b2515a82: Status 404 returned error can't find the container with id 6608bdf3eba1266a0d9ebf4133f2e14069685e9e8afbeeacd64c88e1b2515a82
Jul 30 09:52:19.626117 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:19.626088    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 09:52:20.121568 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:20.121531    2581 generic.go:356] "Generic (PLEG): container finished" podID="975db069-8a4f-40ee-b749-877667c38633" containerID="7de84f05503fc65c01afaadb285939efeb327be7319a0a044d2cb20d1f6cc5db" exitCode=0
Jul 30 09:52:20.121988 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:20.121619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"975db069-8a4f-40ee-b749-877667c38633","Type":"ContainerDied","Data":"7de84f05503fc65c01afaadb285939efeb327be7319a0a044d2cb20d1f6cc5db"}
Jul 30 09:52:20.121988 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:20.121695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"975db069-8a4f-40ee-b749-877667c38633","Type":"ContainerStarted","Data":"6608bdf3eba1266a0d9ebf4133f2e14069685e9e8afbeeacd64c88e1b2515a82"}
Jul 30 09:52:20.226839 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:20.226691    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5926320-a029-411f-86d9-8d45cae4707f" path="/var/lib/kubelet/pods/a5926320-a029-411f-86d9-8d45cae4707f/volumes"
Jul 30 09:52:21.129258 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.129224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"975db069-8a4f-40ee-b749-877667c38633","Type":"ContainerStarted","Data":"a749211e9e9912762b92bc66e809517e229f0aa9efefb1c21dfd5871033a0c04"}
Jul 30 09:52:21.129642 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.129294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"975db069-8a4f-40ee-b749-877667c38633","Type":"ContainerStarted","Data":"4cf5e57e9096a9610141d4c302f1828c2ead418688d48fe0c83cbfbde635369c"}
Jul 30 09:52:21.129642 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.129322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"975db069-8a4f-40ee-b749-877667c38633","Type":"ContainerStarted","Data":"eb3724bc73caf17a8a57411800c2413dc1359de63e9d88732cd8e350175b780c"}
Jul 30 09:52:21.129642 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.129351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"975db069-8a4f-40ee-b749-877667c38633","Type":"ContainerStarted","Data":"4be8827a11d24c9eaa1caf350efc9106575b636aff8c22960c643a0aaacdf82e"}
Jul 30 09:52:21.129642 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.129379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"975db069-8a4f-40ee-b749-877667c38633","Type":"ContainerStarted","Data":"07d2a9496e87100b10da93458ed5163c1d083a061c19491ca9208be734d37276"}
Jul 30 09:52:21.129642 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.129404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"975db069-8a4f-40ee-b749-877667c38633","Type":"ContainerStarted","Data":"332c0b8e1e6a2826e89c92b5af315a6351eae76a12cd1bb75178442c75e42dbc"}
Jul 30 09:52:21.155411 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.155352    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.14081646 podStartE2EDuration="2.155333681s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.517221ms" isStatefulPod=false podCreationTimestamp="2026-07-30 09:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:52:21.155093086 +0000 UTC m=+159.499156539" watchObservedRunningTime="2026-07-30 09:52:21.155333681 +0000 UTC m=+159.499397138"
Jul 30 09:52:21.890602 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.890561    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:52:21.890993 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.890946    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="prometheus" containerID="cri-o://29dec1a7593c629a557920f7dfaaf953e3d9f282b71580d21bf6dd5b0f6c848c" gracePeriod=600
Jul 30 09:52:21.891106 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.890981    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="config-reloader" containerID="cri-o://455091287a047b7230936ed6cee7d4cf5210ba06b10b86ccfd709b142ab82e84" gracePeriod=600
Jul 30 09:52:21.891106 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.891012    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy" containerID="cri-o://d6d7ab55dfe7647d3463640d05af04525257b338a135da7467ee2f4e657d8d0e" gracePeriod=600
Jul 30 09:52:21.891210 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.891098    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy-thanos" containerID="cri-o://971e367ffe6c848aaff3e5da4a04af9a9350adfda6a76c4641f0297429ddde10" gracePeriod=600
Jul 30 09:52:21.891210 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.890988    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy-web" containerID="cri-o://3a03d92c2ce51d3ede2cca7713b506c29f397e25b53ad874f17d81008133943e" gracePeriod=600
Jul 30 09:52:21.891210 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:21.890987    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="thanos-sidecar" containerID="cri-o://3f050d95d05ccf55448b23eb7af60c658e6057a8a3115c11764fc1dc7a141404" gracePeriod=600
Jul 30 09:52:22.137843 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.137790    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerID="971e367ffe6c848aaff3e5da4a04af9a9350adfda6a76c4641f0297429ddde10" exitCode=0
Jul 30 09:52:22.138229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138003    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerID="d6d7ab55dfe7647d3463640d05af04525257b338a135da7467ee2f4e657d8d0e" exitCode=0
Jul 30 09:52:22.138229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138019    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerID="3a03d92c2ce51d3ede2cca7713b506c29f397e25b53ad874f17d81008133943e" exitCode=0
Jul 30 09:52:22.138229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138030    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerID="3f050d95d05ccf55448b23eb7af60c658e6057a8a3115c11764fc1dc7a141404" exitCode=0
Jul 30 09:52:22.138229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138041    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerID="455091287a047b7230936ed6cee7d4cf5210ba06b10b86ccfd709b142ab82e84" exitCode=0
Jul 30 09:52:22.138229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138050    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerID="29dec1a7593c629a557920f7dfaaf953e3d9f282b71580d21bf6dd5b0f6c848c" exitCode=0
Jul 30 09:52:22.138229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.137850    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerDied","Data":"971e367ffe6c848aaff3e5da4a04af9a9350adfda6a76c4641f0297429ddde10"}
Jul 30 09:52:22.138229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerDied","Data":"d6d7ab55dfe7647d3463640d05af04525257b338a135da7467ee2f4e657d8d0e"}
Jul 30 09:52:22.138229 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerDied","Data":"3a03d92c2ce51d3ede2cca7713b506c29f397e25b53ad874f17d81008133943e"}
Jul 30 09:52:22.138484 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerDied","Data":"3f050d95d05ccf55448b23eb7af60c658e6057a8a3115c11764fc1dc7a141404"}
Jul 30 09:52:22.138484 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138277    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerDied","Data":"455091287a047b7230936ed6cee7d4cf5210ba06b10b86ccfd709b142ab82e84"}
Jul 30 09:52:22.138484 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerDied","Data":"29dec1a7593c629a557920f7dfaaf953e3d9f282b71580d21bf6dd5b0f6c848c"}
Jul 30 09:52:22.138484 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed","Type":"ContainerDied","Data":"0233d5f7f3f9b1b661005427404f974f23449fce6ac547ccc18c7bd3a3910d77"}
Jul 30 09:52:22.138484 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.138396    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0233d5f7f3f9b1b661005427404f974f23449fce6ac547ccc18c7bd3a3910d77"
Jul 30 09:52:22.141079 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.141025    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:22.227635 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.227608    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.227836 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.227645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.227836 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.227667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-metrics-client-certs\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.227836 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.227697    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-2\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228022 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.227913    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-kubelet-serving-ca-bundle\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228022 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.227965    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-kube-rbac-proxy\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228022 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.227988    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:22.228022 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228007    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-db\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228219 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228041    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-tls-assets\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228219 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228067    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config-out\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228219 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-serving-certs-ca-bundle\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228219 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228136    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-tls\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228219 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228163    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-1\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228219 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228193    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr6rf\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-kube-api-access-qr6rf\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228224    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-metrics-client-ca\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228272    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-0\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228285    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:22.228507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228300    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-grpc-tls\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228324    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-trusted-ca-bundle\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228362    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-web-config\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228401    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-thanos-prometheus-http-client-file\") pod \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\" (UID: \"4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed\") "
Jul 30 09:52:22.228917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228506    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:22.228917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228778    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.228917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228796    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.228917 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.228810    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.229183 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.229091    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 09:52:22.230343 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.230312    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.230470 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.230341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.230929 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.230876    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:52:22.231086 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.231056    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:22.231350 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.231324    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:22.232130 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.231697    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:22.232130 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.231973    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.232297 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.232260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-kube-api-access-qr6rf" (OuterVolumeSpecName: "kube-api-access-qr6rf") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "kube-api-access-qr6rf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:52:22.232847 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.232783    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.233511 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.233148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.233511 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.233470    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config-out" (OuterVolumeSpecName: "config-out") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 09:52:22.233657 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.233540    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:52:22.233873 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.233853    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.234078 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.234055    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config" (OuterVolumeSpecName: "config") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.234610 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.234574    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.246318 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.246267    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-web-config" (OuterVolumeSpecName: "web-config") pod "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" (UID: "4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:52:22.329488 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329446    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329488 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329479    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329488 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329492    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr6rf\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-kube-api-access-qr6rf\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329505    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-configmap-metrics-client-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329517    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329529    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329541    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-grpc-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329551    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329563    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-web-config\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329574    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329589    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329602    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329614    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-metrics-client-certs\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329626    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-secret-kube-rbac-proxy\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329638    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-prometheus-k8s-db\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329649    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-tls-assets\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:22.329753 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:22.329660    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed-config-out\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:52:23.141951 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.141921    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.164265 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.164186    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:52:23.170033 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.170010    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:52:23.199065 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199029    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:52:23.199304 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199292    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="init-config-reloader"
Jul 30 09:52:23.199347 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199306    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="init-config-reloader"
Jul 30 09:52:23.199347 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199315    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="config-reloader"
Jul 30 09:52:23.199347 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199321    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="config-reloader"
Jul 30 09:52:23.199347 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199335    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="prometheus"
Jul 30 09:52:23.199347 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199342    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="prometheus"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199351    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199356    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199363    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy-thanos"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199369    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy-thanos"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199376    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="thanos-sidecar"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199382    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="thanos-sidecar"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199387    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy-web"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199393    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy-web"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199432    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="prometheus"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199439    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="config-reloader"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199446    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="thanos-sidecar"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199450    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy-web"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199455    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy"
Jul 30 09:52:23.199489 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.199461    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" containerName="kube-rbac-proxy-thanos"
Jul 30 09:52:23.206353 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.206313    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.209077 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.208935    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 09:52:23.209077 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209001    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hpm6m\""
Jul 30 09:52:23.209077 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209071    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7sflpc00e3jv0\""
Jul 30 09:52:23.209337 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209136    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 09:52:23.209337 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209070    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 09:52:23.209337 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209051    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 09:52:23.209337 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209287    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 09:52:23.209337 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209311    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 09:52:23.209548 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209487    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 09:52:23.209548 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.209501    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 09:52:23.211732 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.211709    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 09:52:23.211863 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.211764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 09:52:23.211863 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.211778    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 09:52:23.211863 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.211838    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 09:52:23.212049 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.211916    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 09:52:23.214685 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.214663    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 09:52:23.218040 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.218019    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 09:52:23.224250 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.224227    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:52:23.338375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338622 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338622 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338622 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338622 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338622 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9h9\" (UniqueName: \"kubernetes.io/projected/cae18be4-3dbf-47c4-83c8-97293feec5ae-kube-api-access-7j9h9\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338622 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae18be4-3dbf-47c4-83c8-97293feec5ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.338883 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.339166 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338892    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.339166 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-config\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.339166 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.339166 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.338984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae18be4-3dbf-47c4-83c8-97293feec5ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440077 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.439969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440077 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440303 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440368 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440368 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440478 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-config\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440478 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440478 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae18be4-3dbf-47c4-83c8-97293feec5ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440478 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440679 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440679 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440679 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440679 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440679 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440679 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9h9\" (UniqueName: \"kubernetes.io/projected/cae18be4-3dbf-47c4-83c8-97293feec5ae-kube-api-access-7j9h9\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.440679 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.441051 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.441051 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.441051 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.441051 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.440777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae18be4-3dbf-47c4-83c8-97293feec5ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.441253 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.441089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.441253 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.441113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.441919 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.441894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.443508 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.443191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.443508 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.443201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.443508 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.443286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.443724 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.443698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.443788 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.443767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae18be4-3dbf-47c4-83c8-97293feec5ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.445079 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.444210    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-config\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.445079 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.444366    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.445079 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.444474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.445079 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.444897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.445079 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.445004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.445672 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.445643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae18be4-3dbf-47c4-83c8-97293feec5ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.445904 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.445873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.446103 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.446086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.446103 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.446100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.446227 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.446173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae18be4-3dbf-47c4-83c8-97293feec5ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.446514 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.446488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae18be4-3dbf-47c4-83c8-97293feec5ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.452832 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.452796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9h9\" (UniqueName: \"kubernetes.io/projected/cae18be4-3dbf-47c4-83c8-97293feec5ae-kube-api-access-7j9h9\") pod \"prometheus-k8s-0\" (UID: \"cae18be4-3dbf-47c4-83c8-97293feec5ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.518375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.518339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:23.654479 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:23.654449    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 09:52:23.657259 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:52:23.657232    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae18be4_3dbf_47c4_83c8_97293feec5ae.slice/crio-e46ad8c81144ffd8451d18fbf89104a9531010d41a4d351d2cb59677ff4c1490 WatchSource:0}: Error finding container e46ad8c81144ffd8451d18fbf89104a9531010d41a4d351d2cb59677ff4c1490: Status 404 returned error can't find the container with id e46ad8c81144ffd8451d18fbf89104a9531010d41a4d351d2cb59677ff4c1490
Jul 30 09:52:24.147649 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:24.147612    2581 generic.go:356] "Generic (PLEG): container finished" podID="cae18be4-3dbf-47c4-83c8-97293feec5ae" containerID="a359410d786fc7af89e774a8fe27671792b65cf3be76cfdecc6a773a7b6616c7" exitCode=0
Jul 30 09:52:24.148036 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:24.147690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae18be4-3dbf-47c4-83c8-97293feec5ae","Type":"ContainerDied","Data":"a359410d786fc7af89e774a8fe27671792b65cf3be76cfdecc6a773a7b6616c7"}
Jul 30 09:52:24.148036 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:24.147757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae18be4-3dbf-47c4-83c8-97293feec5ae","Type":"ContainerStarted","Data":"e46ad8c81144ffd8451d18fbf89104a9531010d41a4d351d2cb59677ff4c1490"}
Jul 30 09:52:24.226563 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:24.226540    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed" path="/var/lib/kubelet/pods/4b1c1c7b-bddf-43dc-8bdb-6b3af08bf1ed/volumes"
Jul 30 09:52:25.156137 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:25.156100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae18be4-3dbf-47c4-83c8-97293feec5ae","Type":"ContainerStarted","Data":"4c6e31a8b2743f65c4bf0933486fe30f5ed6b9b25cd4384796aa60b4e2f48055"}
Jul 30 09:52:25.156513 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:25.156192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae18be4-3dbf-47c4-83c8-97293feec5ae","Type":"ContainerStarted","Data":"377c9292bebe2c181d6d24abbad44b13914774afc5147e9ba056651dc4a247df"}
Jul 30 09:52:25.156513 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:25.156220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae18be4-3dbf-47c4-83c8-97293feec5ae","Type":"ContainerStarted","Data":"f25c8a38f9652baafb5f615b7c9dd2f771b98750fbe2155c29adf29bf8c7ce7e"}
Jul 30 09:52:25.156513 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:25.156243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae18be4-3dbf-47c4-83c8-97293feec5ae","Type":"ContainerStarted","Data":"5fec0e14cc2d2700215bb3be2915d62f5982c56b3aa854341c65211e04072822"}
Jul 30 09:52:25.156513 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:25.156266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae18be4-3dbf-47c4-83c8-97293feec5ae","Type":"ContainerStarted","Data":"31544754360d9c70e51075a0ad360325778c8bc79cb12792170a39f5b639ffd4"}
Jul 30 09:52:25.156513 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:25.156289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae18be4-3dbf-47c4-83c8-97293feec5ae","Type":"ContainerStarted","Data":"84f66375287e1f54f344926749df240b7c356c6c88bf897e83518a3c1a4fedcf"}
Jul 30 09:52:25.190050 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:25.189857    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.170568818 podStartE2EDuration="2.189809802s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.240984ms" isStatefulPod=false podCreationTimestamp="2026-07-30 09:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:52:25.188604087 +0000 UTC m=+163.532667543" watchObservedRunningTime="2026-07-30 09:52:25.189809802 +0000 UTC m=+163.533873261"
Jul 30 09:52:26.485878 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:26.485846    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:52:26.542573 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:26.542542    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:52:28.519040 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:28.518994    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:52:38.412175 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:38.412100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:52:38.512402 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:52:38.512370    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:23.519391 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:23.519354    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:53:23.534865 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:23.534841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:53:24.395604 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:24.395577    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 09:53:24.630295 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:24.630249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:24.688872 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:24.688765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:31.697839 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:31.697784    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:31.759842 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:31.759779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:43.699108 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:43.699076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:43.757012 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:43.756976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:46.896901 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:46.896843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:46.949119 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:46.949087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:47.092587 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:47.092550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:47.176997 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:47.176917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:47.666933 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:47.666882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:47.723235 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:47.723199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:51.077073 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:51.077040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:51.177761 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:51.177733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:58.150277 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:58.150243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:58.205023 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:58.204999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:53:58.263404 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:53:58.263373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:54:10.982447 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:54:10.982363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:54:11.034980 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:54:11.034945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:54:42.101898 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:54:42.101865    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 09:54:42.106619 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:54:42.106600    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 09:54:42.106775 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:54:42.106645    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 09:54:52.930031 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:54:52.929978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:54:54.971810 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:54:54.971776    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:14.947308 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:14.947269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:16.289656 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:16.289614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:16.958608 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:16.958570    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:18.752020 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:18.751989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:18.855329 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:18.855296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:20.500300 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:20.500271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:20.602901 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:20.602861    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:20.845621 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:20.845594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:20.968692 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:20.968659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:22.462019 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:22.461979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:22.828008 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:22.827972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:25.552393 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:25.552357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:25.651969 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:25.651927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:27.946217 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:27.946188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:28.043743 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:28.043713    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:31.235234 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:31.235198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:34.011921 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:34.011841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:34.098684 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:34.098645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:35.381562 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.381527    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"]
Jul 30 09:55:35.384231 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.384213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"
Jul 30 09:55:35.386176 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.386151    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 09:55:35.386667 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.386644    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 09:55:35.386780 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.386647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xq9nt\""
Jul 30 09:55:35.393373 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.393349    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"]
Jul 30 09:55:35.472233 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.472189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4cb7d0-888e-4cb8-988b-d2e2e14df29f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n2fz2\" (UID: \"6b4cb7d0-888e-4cb8-988b-d2e2e14df29f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"
Jul 30 09:55:35.472233 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.472231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92gv\" (UniqueName: \"kubernetes.io/projected/6b4cb7d0-888e-4cb8-988b-d2e2e14df29f-kube-api-access-n92gv\") pod \"openshift-lws-operator-fd8ccff4c-n2fz2\" (UID: \"6b4cb7d0-888e-4cb8-988b-d2e2e14df29f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"
Jul 30 09:55:35.573378 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.573325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4cb7d0-888e-4cb8-988b-d2e2e14df29f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n2fz2\" (UID: \"6b4cb7d0-888e-4cb8-988b-d2e2e14df29f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"
Jul 30 09:55:35.573563 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.573402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92gv\" (UniqueName: \"kubernetes.io/projected/6b4cb7d0-888e-4cb8-988b-d2e2e14df29f-kube-api-access-n92gv\") pod \"openshift-lws-operator-fd8ccff4c-n2fz2\" (UID: \"6b4cb7d0-888e-4cb8-988b-d2e2e14df29f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"
Jul 30 09:55:35.577454 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.574394    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4cb7d0-888e-4cb8-988b-d2e2e14df29f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n2fz2\" (UID: \"6b4cb7d0-888e-4cb8-988b-d2e2e14df29f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"
Jul 30 09:55:35.581000 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.580967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92gv\" (UniqueName: \"kubernetes.io/projected/6b4cb7d0-888e-4cb8-988b-d2e2e14df29f-kube-api-access-n92gv\") pod \"openshift-lws-operator-fd8ccff4c-n2fz2\" (UID: \"6b4cb7d0-888e-4cb8-988b-d2e2e14df29f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"
Jul 30 09:55:35.705001 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.704908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"
Jul 30 09:55:35.829240 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.829208    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2"]
Jul 30 09:55:35.831752 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:55:35.831720    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b4cb7d0_888e_4cb8_988b_d2e2e14df29f.slice/crio-86a026dc32ac86c456b4beb074442ba9298241fb033e8ac9008ee7831131dc99 WatchSource:0}: Error finding container 86a026dc32ac86c456b4beb074442ba9298241fb033e8ac9008ee7831131dc99: Status 404 returned error can't find the container with id 86a026dc32ac86c456b4beb074442ba9298241fb033e8ac9008ee7831131dc99
Jul 30 09:55:35.833222 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.833203    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 09:55:35.878428 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:35.878387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2" event={"ID":"6b4cb7d0-888e-4cb8-988b-d2e2e14df29f","Type":"ContainerStarted","Data":"86a026dc32ac86c456b4beb074442ba9298241fb033e8ac9008ee7831131dc99"}
Jul 30 09:55:38.894097 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:38.894060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2" event={"ID":"6b4cb7d0-888e-4cb8-988b-d2e2e14df29f","Type":"ContainerStarted","Data":"13c5b83250b590158be8a89075fea7b6adfa42315fefd82d9879fac2e6315809"}
Jul 30 09:55:38.925841 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:38.925762    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n2fz2" podStartSLOduration=1.56885696 podStartE2EDuration="3.925744589s" totalImagesPullingTime="2.356887629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:55:38.9255461 +0000 UTC m=+357.269609556" watchObservedRunningTime="2026-07-30 09:55:38.925744589 +0000 UTC m=+357.269808045"
Jul 30 09:55:39.715069 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:39.715036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:39.817191 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:39.817160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:41.744482 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:41.744449    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:57.604459 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:57.604425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:58.169001 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.168960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:58.364670 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.364639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:58.529481 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.529397    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"]
Jul 30 09:55:58.536141 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.536117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.540538 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.540514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 09:55:58.540672 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.540519    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 09:55:58.540730 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.540691    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 09:55:58.540865 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.540838    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nzz9n\""
Jul 30 09:55:58.542206 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.542180    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 09:55:58.555809 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.555781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"]
Jul 30 09:55:58.673475 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.673437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32624ede-ce31-48ec-a2fa-c22093f4ea55-manifests\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.674044 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.674021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32624ede-ce31-48ec-a2fa-c22093f4ea55-tmp\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.674216 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.674200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32624ede-ce31-48ec-a2fa-c22093f4ea55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.674345 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.674332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32624ede-ce31-48ec-a2fa-c22093f4ea55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.674499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.674484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jrv\" (UniqueName: \"kubernetes.io/projected/32624ede-ce31-48ec-a2fa-c22093f4ea55-kube-api-access-p2jrv\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.682459 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.682329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:58.775127 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.775088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32624ede-ce31-48ec-a2fa-c22093f4ea55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.775338 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.775141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jrv\" (UniqueName: \"kubernetes.io/projected/32624ede-ce31-48ec-a2fa-c22093f4ea55-kube-api-access-p2jrv\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.775338 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.775187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32624ede-ce31-48ec-a2fa-c22093f4ea55-manifests\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.775338 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.775210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32624ede-ce31-48ec-a2fa-c22093f4ea55-tmp\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.775338 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.775256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32624ede-ce31-48ec-a2fa-c22093f4ea55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.775621 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.775587    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32624ede-ce31-48ec-a2fa-c22093f4ea55-manifests\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.777485 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.777456    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32624ede-ce31-48ec-a2fa-c22093f4ea55-tmp\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.777735 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.777717    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32624ede-ce31-48ec-a2fa-c22093f4ea55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.777811 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.777792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32624ede-ce31-48ec-a2fa-c22093f4ea55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.778681 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.778660    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:58.782517 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.782468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jrv\" (UniqueName: \"kubernetes.io/projected/32624ede-ce31-48ec-a2fa-c22093f4ea55-kube-api-access-p2jrv\") pod \"opendatahub-operator-controller-manager-5d74749788-ks8kn\" (UID: \"32624ede-ce31-48ec-a2fa-c22093f4ea55\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.846455 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.846414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:55:58.908081 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.908050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:58.984981 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.984952    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"]
Jul 30 09:55:58.988256 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:55:58.988222    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32624ede_ce31_48ec_a2fa_c22093f4ea55.slice/crio-a244de5e9c997287864d59254f482ac7fd36e54bc6b74de197c04e54b9429123 WatchSource:0}: Error finding container a244de5e9c997287864d59254f482ac7fd36e54bc6b74de197c04e54b9429123: Status 404 returned error can't find the container with id a244de5e9c997287864d59254f482ac7fd36e54bc6b74de197c04e54b9429123
Jul 30 09:55:58.988613 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:58.988590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:59.045391 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:59.045310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:59.146792 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:59.146761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:55:59.980614 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:55:59.980566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn" event={"ID":"32624ede-ce31-48ec-a2fa-c22093f4ea55","Type":"ContainerStarted","Data":"a244de5e9c997287864d59254f482ac7fd36e54bc6b74de197c04e54b9429123"}
Jul 30 09:56:02.994750 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:02.994714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn" event={"ID":"32624ede-ce31-48ec-a2fa-c22093f4ea55","Type":"ContainerStarted","Data":"841fdb5f64749d689ee1072d2d5b3f62e9436b6d8d17f228e7796451e049977e"}
Jul 30 09:56:04.000262 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:04.000223    2581 generic.go:356] "Generic (PLEG): container finished" podID="32624ede-ce31-48ec-a2fa-c22093f4ea55" containerID="841fdb5f64749d689ee1072d2d5b3f62e9436b6d8d17f228e7796451e049977e" exitCode=0
Jul 30 09:56:04.000664 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:04.000303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn" event={"ID":"32624ede-ce31-48ec-a2fa-c22093f4ea55","Type":"ContainerDied","Data":"841fdb5f64749d689ee1072d2d5b3f62e9436b6d8d17f228e7796451e049977e"}
Jul 30 09:56:05.006319 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:05.006285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn" event={"ID":"32624ede-ce31-48ec-a2fa-c22093f4ea55","Type":"ContainerStarted","Data":"0aa480412132f9970ee20e9e2239bb88427d911bea26d1bb1692faf896ffcaeb"}
Jul 30 09:56:05.006791 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:05.006358    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:56:05.026328 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:05.026275    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn" podStartSLOduration=2.6139136020000002 podStartE2EDuration="7.026259492s" totalImagesPullingTime="3.368910942s" totalInitContainerRuntime="1.043434948s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:55:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:05.025031073 +0000 UTC m=+383.369094582" watchObservedRunningTime="2026-07-30 09:56:05.026259492 +0000 UTC m=+383.370322947"
Jul 30 09:56:11.434892 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:11.434859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:11.534499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:11.534465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:13.826538 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:13.826501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:14.076348 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:14.076315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:16.013392 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:16.013366    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ks8kn"
Jul 30 09:56:19.386961 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:19.386926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:19.520152 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:19.520115    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:20.025590 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.025523    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:20.089302 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.089266    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"]
Jul 30 09:56:20.101293 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.101267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.104273 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.104236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"]
Jul 30 09:56:20.106167 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.106142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-87nl9\""
Jul 30 09:56:20.106299 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.106178    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 09:56:20.106439 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.106422    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 09:56:20.106502 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.106436    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 09:56:20.106764 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.106746    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 09:56:20.159665 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.159629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv6th\" (UniqueName: \"kubernetes.io/projected/3aae51f5-a86d-4610-8c6f-bccc340545ce-kube-api-access-bv6th\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.159809 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.159673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aae51f5-a86d-4610-8c6f-bccc340545ce-tmp\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.159809 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.159699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aae51f5-a86d-4610-8c6f-bccc340545ce-tls-certs\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.252871 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.252835    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:20.261079 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.261043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv6th\" (UniqueName: \"kubernetes.io/projected/3aae51f5-a86d-4610-8c6f-bccc340545ce-kube-api-access-bv6th\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.261079 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.261079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aae51f5-a86d-4610-8c6f-bccc340545ce-tmp\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.261332 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.261120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aae51f5-a86d-4610-8c6f-bccc340545ce-tls-certs\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.263436 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.263398    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aae51f5-a86d-4610-8c6f-bccc340545ce-tmp\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.263571 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.263483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aae51f5-a86d-4610-8c6f-bccc340545ce-tls-certs\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.273139 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.273108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv6th\" (UniqueName: \"kubernetes.io/projected/3aae51f5-a86d-4610-8c6f-bccc340545ce-kube-api-access-bv6th\") pod \"kube-auth-proxy-7d4fcfdb4d-krg2z\" (UID: \"3aae51f5-a86d-4610-8c6f-bccc340545ce\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.342859 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.342799    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:20.413868 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.413836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"
Jul 30 09:56:20.458305 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.458275    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:20.555270 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.555234    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z"]
Jul 30 09:56:20.559000 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:56:20.558899    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aae51f5_a86d_4610_8c6f_bccc340545ce.slice/crio-aacf1539a1f4eb0a6e72a5e7350bdcaed04bf4beaaf35b829ef8183224ff4f8f WatchSource:0}: Error finding container aacf1539a1f4eb0a6e72a5e7350bdcaed04bf4beaaf35b829ef8183224ff4f8f: Status 404 returned error can't find the container with id aacf1539a1f4eb0a6e72a5e7350bdcaed04bf4beaaf35b829ef8183224ff4f8f
Jul 30 09:56:20.645405 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:20.645312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:21.053273 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.053157    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:21.076632 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.076570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z" event={"ID":"3aae51f5-a86d-4610-8c6f-bccc340545ce","Type":"ContainerStarted","Data":"aacf1539a1f4eb0a6e72a5e7350bdcaed04bf4beaaf35b829ef8183224ff4f8f"}
Jul 30 09:56:21.112026 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.111990    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-crl4t"]
Jul 30 09:56:21.116635 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.116609    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:21.119149 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.119125    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 09:56:21.119272 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.119156    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nb5nv\""
Jul 30 09:56:21.127658 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.127632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-crl4t"]
Jul 30 09:56:21.170851 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.170786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn9hs\" (UniqueName: \"kubernetes.io/projected/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-kube-api-access-hn9hs\") pod \"model-serving-api-54d89bd5fc-crl4t\" (UID: \"7cc0ca30-febd-45eb-a72e-4d65f11d59bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:21.171052 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.170889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-crl4t\" (UID: \"7cc0ca30-febd-45eb-a72e-4d65f11d59bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:21.273677 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.273135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn9hs\" (UniqueName: \"kubernetes.io/projected/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-kube-api-access-hn9hs\") pod \"model-serving-api-54d89bd5fc-crl4t\" (UID: \"7cc0ca30-febd-45eb-a72e-4d65f11d59bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:21.273677 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.273226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-crl4t\" (UID: \"7cc0ca30-febd-45eb-a72e-4d65f11d59bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:21.273677 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:56:21.273433    2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 30 09:56:21.273677 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:56:21.273499    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-tls-certs podName:7cc0ca30-febd-45eb-a72e-4d65f11d59bb nodeName:}" failed. No retries permitted until 2026-07-30 09:56:21.773478881 +0000 UTC m=+400.117542317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-tls-certs") pod "model-serving-api-54d89bd5fc-crl4t" (UID: "7cc0ca30-febd-45eb-a72e-4d65f11d59bb") : secret "model-serving-api-tls" not found
Jul 30 09:56:21.292316 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.292284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn9hs\" (UniqueName: \"kubernetes.io/projected/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-kube-api-access-hn9hs\") pod \"model-serving-api-54d89bd5fc-crl4t\" (UID: \"7cc0ca30-febd-45eb-a72e-4d65f11d59bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:21.337184 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.337102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:21.442168 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.442123    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:21.540184 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.540148    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:21.777978 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.777893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-crl4t\" (UID: \"7cc0ca30-febd-45eb-a72e-4d65f11d59bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:21.780252 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:21.780222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cc0ca30-febd-45eb-a72e-4d65f11d59bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-crl4t\" (UID: \"7cc0ca30-febd-45eb-a72e-4d65f11d59bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:22.028475 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:22.028383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:22.165994 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:22.165964    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-crl4t"]
Jul 30 09:56:22.168654 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:56:22.168624    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc0ca30_febd_45eb_a72e_4d65f11d59bb.slice/crio-0ed0290c0cd2e3642e02cd36f4c381680a0a3099f0308a3f793a21ce89b1795c WatchSource:0}: Error finding container 0ed0290c0cd2e3642e02cd36f4c381680a0a3099f0308a3f793a21ce89b1795c: Status 404 returned error can't find the container with id 0ed0290c0cd2e3642e02cd36f4c381680a0a3099f0308a3f793a21ce89b1795c
Jul 30 09:56:22.326347 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:22.326314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:23.091291 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:23.091252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-crl4t" event={"ID":"7cc0ca30-febd-45eb-a72e-4d65f11d59bb","Type":"ContainerStarted","Data":"0ed0290c0cd2e3642e02cd36f4c381680a0a3099f0308a3f793a21ce89b1795c"}
Jul 30 09:56:23.657413 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:23.657372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:23.722058 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:23.722010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:24.098630 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:24.098598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z" event={"ID":"3aae51f5-a86d-4610-8c6f-bccc340545ce","Type":"ContainerStarted","Data":"7ec025be4967fb0493e03cdd0e6c3971dffe9171ab21fa173d25d8f52714fb7e"}
Jul 30 09:56:24.145964 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:24.145913    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z" podStartSLOduration=0.695112953 podStartE2EDuration="4.14589689s" totalImagesPullingTime="3.450783937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:24.145287789 +0000 UTC m=+402.489351247" watchObservedRunningTime="2026-07-30 09:56:24.14589689 +0000 UTC m=+402.489960345"
Jul 30 09:56:25.105335 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:25.105296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-crl4t" event={"ID":"7cc0ca30-febd-45eb-a72e-4d65f11d59bb","Type":"ContainerStarted","Data":"fa1a091079ec84626415ff8b01e2dac9ffeb45258d97e6b12fc0bc044a3e3312"}
Jul 30 09:56:25.105768 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:25.105495    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:25.120999 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:25.120946    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-crl4t" podStartSLOduration=2.234891553 podStartE2EDuration="4.120929532s" totalImagesPullingTime="1.886037979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:25.120447181 +0000 UTC m=+403.464510639" watchObservedRunningTime="2026-07-30 09:56:25.120929532 +0000 UTC m=+403.464992987"
Jul 30 09:56:26.781363 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.781328    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"]
Jul 30 09:56:26.784555 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.784537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:26.787201 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.787179    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 09:56:26.787421 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.787402    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 09:56:26.787477 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.787402    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n8wmp\""
Jul 30 09:56:26.787477 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.787441    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 09:56:26.793534 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.793505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"]
Jul 30 09:56:26.922031 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.921996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2b47\" (UniqueName: \"kubernetes.io/projected/642f24b8-bffe-4bba-a4cd-d4a08d19114b-kube-api-access-k2b47\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:26.922031 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.922037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/642f24b8-bffe-4bba-a4cd-d4a08d19114b-cert\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:26.922263 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.922079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/642f24b8-bffe-4bba-a4cd-d4a08d19114b-manager-config\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:26.922263 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:26.922099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/642f24b8-bffe-4bba-a4cd-d4a08d19114b-metrics-cert\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.023070 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.023017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2b47\" (UniqueName: \"kubernetes.io/projected/642f24b8-bffe-4bba-a4cd-d4a08d19114b-kube-api-access-k2b47\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.023257 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.023083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/642f24b8-bffe-4bba-a4cd-d4a08d19114b-cert\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.023257 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.023156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/642f24b8-bffe-4bba-a4cd-d4a08d19114b-manager-config\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.023257 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.023181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/642f24b8-bffe-4bba-a4cd-d4a08d19114b-metrics-cert\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.024113 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.024083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/642f24b8-bffe-4bba-a4cd-d4a08d19114b-manager-config\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.025879 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.025802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/642f24b8-bffe-4bba-a4cd-d4a08d19114b-metrics-cert\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.026479 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.026457    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/642f24b8-bffe-4bba-a4cd-d4a08d19114b-cert\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.036348 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.036294    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2b47\" (UniqueName: \"kubernetes.io/projected/642f24b8-bffe-4bba-a4cd-d4a08d19114b-kube-api-access-k2b47\") pod \"lws-controller-manager-75b6964665-tvchg\" (UID: \"642f24b8-bffe-4bba-a4cd-d4a08d19114b\") " pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.094714 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.094675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:27.252401 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.252222    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"]
Jul 30 09:56:27.255312 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:56:27.255285    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642f24b8_bffe_4bba_a4cd_d4a08d19114b.slice/crio-0135c314d74913d7a6e8e8b0d74ad887f06864f2bc87fcb6f95a4ca4837cd5ae WatchSource:0}: Error finding container 0135c314d74913d7a6e8e8b0d74ad887f06864f2bc87fcb6f95a4ca4837cd5ae: Status 404 returned error can't find the container with id 0135c314d74913d7a6e8e8b0d74ad887f06864f2bc87fcb6f95a4ca4837cd5ae
Jul 30 09:56:27.373650 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.373622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:27.443748 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:27.443716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:28.122286 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:28.122253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg" event={"ID":"642f24b8-bffe-4bba-a4cd-d4a08d19114b","Type":"ContainerStarted","Data":"0135c314d74913d7a6e8e8b0d74ad887f06864f2bc87fcb6f95a4ca4837cd5ae"}
Jul 30 09:56:28.275194 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:28.275147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:28.529841 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:28.529734    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:28.868341 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:28.868292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:30.134630 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:30.134594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg" event={"ID":"642f24b8-bffe-4bba-a4cd-d4a08d19114b","Type":"ContainerStarted","Data":"430bd6078f7add7bd7c4359b192862cd2122657152b48d238619c650f2382b59"}
Jul 30 09:56:30.156309 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:30.156259    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg" podStartSLOduration=2.324242916 podStartE2EDuration="4.156239661s" totalImagesPullingTime="1.831996745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:30.154650131 +0000 UTC m=+408.498713588" watchObservedRunningTime="2026-07-30 09:56:30.156239661 +0000 UTC m=+408.500303117"
Jul 30 09:56:31.132966 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:31.132932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:31.138685 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:31.138658    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:31.263418 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:31.263388    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:31.379211 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:31.379178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:32.417507 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:32.417478    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:32.528864 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:32.528812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:32.660366 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:32.660337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:36.113698 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:36.113670    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-crl4t"
Jul 30 09:56:42.145865 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:42.145835    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75b6964665-tvchg"
Jul 30 09:56:49.855354 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:49.855319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:58.049271 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:58.049240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:56:58.147356 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:56:58.147323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:20.959208 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:20.959123    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:21.029639 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:21.029592    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:21.140607 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:21.140572    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:30.437836 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:30.437768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:42.125988 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:42.125958    2581 scope.go:117] "RemoveContainer" containerID="971e367ffe6c848aaff3e5da4a04af9a9350adfda6a76c4641f0297429ddde10"
Jul 30 09:57:42.133655 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:42.133635    2581 scope.go:117] "RemoveContainer" containerID="3f050d95d05ccf55448b23eb7af60c658e6057a8a3115c11764fc1dc7a141404"
Jul 30 09:57:42.140634 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:42.140614    2581 scope.go:117] "RemoveContainer" containerID="29dec1a7593c629a557920f7dfaaf953e3d9f282b71580d21bf6dd5b0f6c848c"
Jul 30 09:57:42.148491 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:42.148469    2581 scope.go:117] "RemoveContainer" containerID="3a03d92c2ce51d3ede2cca7713b506c29f397e25b53ad874f17d81008133943e"
Jul 30 09:57:42.157334 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:42.157314    2581 scope.go:117] "RemoveContainer" containerID="d6d7ab55dfe7647d3463640d05af04525257b338a135da7467ee2f4e657d8d0e"
Jul 30 09:57:42.165152 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:42.165131    2581 scope.go:117] "RemoveContainer" containerID="455091287a047b7230936ed6cee7d4cf5210ba06b10b86ccfd709b142ab82e84"
Jul 30 09:57:42.172444 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:42.172420    2581 scope.go:117] "RemoveContainer" containerID="fe4dd0208ca9d15ea87ff0eb34f002280d862345c1df61a2ce8e64f9a28bc1e9"
Jul 30 09:57:45.956105 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:45.956070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:46.009490 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:46.009458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:46.091054 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:46.091025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:46.143944 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:46.143915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:46.697324 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:46.697287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:46.754075 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:46.754045    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:50.465238 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:50.465207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:54.088796 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:54.088760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:56.101488 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:56.101451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:56.201016 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:56.200983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:57.106221 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:57.106179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:57.427432 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:57.427344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:57.505641 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:57.505606    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:58.054505 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:58.054476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:58.118042 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:58.118017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:58.573954 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:58.573914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:57:58.855550 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:57:58.855469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:01.244086 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:01.244055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:02.117253 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:02.117218    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:02.680634 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:02.680597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:04.709487 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.709446    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:04.747094 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.747062    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"]
Jul 30 09:58:04.750285 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.750265    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:04.752771 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.752753    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r4vmp\""
Jul 30 09:58:04.753282 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.753262    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 09:58:04.753373 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.753326    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 09:58:04.760495 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.760474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"]
Jul 30 09:58:04.845662 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.845626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4hm6\" (UniqueName: \"kubernetes.io/projected/df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2-kube-api-access-q4hm6\") pod \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" (UID: \"df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:04.946549 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.946510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4hm6\" (UniqueName: \"kubernetes.io/projected/df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2-kube-api-access-q4hm6\") pod \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" (UID: \"df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:04.958849 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:04.958805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4hm6\" (UniqueName: \"kubernetes.io/projected/df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2-kube-api-access-q4hm6\") pod \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" (UID: \"df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:05.061266 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:05.061236    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:05.193602 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:05.193404    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"]
Jul 30 09:58:05.196689 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:58:05.196665    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0dcc80_d7ae_4b51_bb77_6319bc6fd7a2.slice/crio-063bca826f2b342d4be72500ec9dd0bf78542989e1647cc34852eb793b750f06 WatchSource:0}: Error finding container 063bca826f2b342d4be72500ec9dd0bf78542989e1647cc34852eb793b750f06: Status 404 returned error can't find the container with id 063bca826f2b342d4be72500ec9dd0bf78542989e1647cc34852eb793b750f06
Jul 30 09:58:05.546386 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:05.546296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn" event={"ID":"df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2","Type":"ContainerStarted","Data":"063bca826f2b342d4be72500ec9dd0bf78542989e1647cc34852eb793b750f06"}
Jul 30 09:58:06.289974 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.289941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:06.380313 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.380284    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:06.533030 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.532996    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"]
Jul 30 09:58:06.536996 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.536970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:06.541389 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.541157    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vgwcl\""
Jul 30 09:58:06.541389 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.541272    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 30 09:58:06.541389 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.541283    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 30 09:58:06.552509 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.552460    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"]
Jul 30 09:58:06.554054 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.553977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:06.562247 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.562215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:06.562413 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.562263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn6l7\" (UniqueName: \"kubernetes.io/projected/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-kube-api-access-xn6l7\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:06.562413 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.562304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:06.663085 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.663042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:06.663247 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.663133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:06.663247 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.663178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn6l7\" (UniqueName: \"kubernetes.io/projected/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-kube-api-access-xn6l7\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:06.663367 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:06.663260    2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 30 09:58:06.663367 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:06.663344    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-plugin-serving-cert podName:3529f17f-8456-45c0-9b9d-4050d1ea6ac8 nodeName:}" failed. No retries permitted until 2026-07-30 09:58:07.163320705 +0000 UTC m=+505.507384141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-c9zns" (UID: "3529f17f-8456-45c0-9b9d-4050d1ea6ac8") : secret "plugin-serving-cert" not found
Jul 30 09:58:06.663959 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.663928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:06.674646 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:06.674606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn6l7\" (UniqueName: \"kubernetes.io/projected/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-kube-api-access-xn6l7\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:07.122026 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:07.121991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:07.168138 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:07.168101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:07.170792 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:07.170761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3529f17f-8456-45c0-9b9d-4050d1ea6ac8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c9zns\" (UID: \"3529f17f-8456-45c0-9b9d-4050d1ea6ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:07.450080 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:07.450010    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"
Jul 30 09:58:07.560547 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:07.560505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn" event={"ID":"df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2","Type":"ContainerStarted","Data":"758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c"}
Jul 30 09:58:07.560773 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:07.560640    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:07.579393 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:07.579316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns"]
Jul 30 09:58:07.582206 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:58:07.582173    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3529f17f_8456_45c0_9b9d_4050d1ea6ac8.slice/crio-baede55b88d5e319a98fbe96d36d74faa3fae8d21aed7491f9cb749513be29de WatchSource:0}: Error finding container baede55b88d5e319a98fbe96d36d74faa3fae8d21aed7491f9cb749513be29de: Status 404 returned error can't find the container with id baede55b88d5e319a98fbe96d36d74faa3fae8d21aed7491f9cb749513be29de
Jul 30 09:58:07.582457 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:07.582418    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn" podStartSLOduration=1.4853019170000001 podStartE2EDuration="3.582403261s" totalImagesPullingTime="2.097101344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:58:07.580526289 +0000 UTC m=+505.924589746" watchObservedRunningTime="2026-07-30 09:58:07.582403261 +0000 UTC m=+505.926466716"
Jul 30 09:58:08.567246 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:08.567192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns" event={"ID":"3529f17f-8456-45c0-9b9d-4050d1ea6ac8","Type":"ContainerStarted","Data":"baede55b88d5e319a98fbe96d36d74faa3fae8d21aed7491f9cb749513be29de"}
Jul 30 09:58:09.897264 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:09.897213    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:09.995879 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:09.995841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:17.212414 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:17.212313    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"]
Jul 30 09:58:17.212878 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:17.212575    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" containerName="manager" containerID="cri-o://758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c" gracePeriod=2
Jul 30 09:58:17.214593 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:17.214536    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:17.231306 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:17.231242    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"]
Jul 30 09:58:17.245053 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:17.245010    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-lfwjn\": pods \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:17.247867 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:17.247833    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" is forbidden: User \"system:node:ip-10-0-131-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-179.ec2.internal' and this object" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:20.668921 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:20.668884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:20.768072 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:20.768037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:21.067550 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:21.067519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:22.688326 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:22.688282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:22.788100 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:22.788071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:25.291499 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:25.291468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:25.392445 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:25.392411    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:28.967436 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:28.967409    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:28.969136 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:28.969107    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" is forbidden: User \"system:node:ip-10-0-131-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-179.ec2.internal' and this object" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:29.076463 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.076374    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4hm6\" (UniqueName: \"kubernetes.io/projected/df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2-kube-api-access-q4hm6\") pod \"df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2\" (UID: \"df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2\") "
Jul 30 09:58:29.078545 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.078515    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2-kube-api-access-q4hm6" (OuterVolumeSpecName: "kube-api-access-q4hm6") pod "df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" (UID: "df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2"). InnerVolumeSpecName "kube-api-access-q4hm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:58:29.098036 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.098006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:29.177149 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.177119    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4hm6\" (UniqueName: \"kubernetes.io/projected/df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2-kube-api-access-q4hm6\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:58:29.180533 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.180507    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:29.680974 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.680937    2581 generic.go:356] "Generic (PLEG): container finished" podID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" containerID="758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c" exitCode=0
Jul 30 09:58:29.681149 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.680988    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:29.681149 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.681043    2581 scope.go:117] "RemoveContainer" containerID="758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c"
Jul 30 09:58:29.683155 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:29.683107    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" is forbidden: User \"system:node:ip-10-0-131-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-179.ec2.internal' and this object" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:29.683302 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.683183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns" event={"ID":"3529f17f-8456-45c0-9b9d-4050d1ea6ac8","Type":"ContainerStarted","Data":"2bbe40b5f31a25c285a1a974e469483a86c32cc7305ae56e26bc8eeb7d822c32"}
Jul 30 09:58:29.684919 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:29.684885    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" is forbidden: User \"system:node:ip-10-0-131-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-179.ec2.internal' and this object" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:29.690141 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.690122    2581 scope.go:117] "RemoveContainer" containerID="758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c"
Jul 30 09:58:29.690392 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:29.690372    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c\": container with ID starting with 758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c not found: ID does not exist" containerID="758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c"
Jul 30 09:58:29.690458 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.690400    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c"} err="failed to get container status \"758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c\": rpc error: code = NotFound desc = could not find container \"758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c\": container with ID starting with 758721ea7be5656946339e8c9848f05306f787c1680759a05f506b1876b52e0c not found: ID does not exist"
Jul 30 09:58:29.701268 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:29.701220    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9zns" podStartSLOduration=2.376934037 podStartE2EDuration="23.70120591s" totalImagesPullingTime="21.324271873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:58:29.700638168 +0000 UTC m=+528.044701625" watchObservedRunningTime="2026-07-30 09:58:29.70120591 +0000 UTC m=+528.045269365"
Jul 30 09:58:29.703892 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:58:29.703865    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfwjn\" is forbidden: User \"system:node:ip-10-0-131-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-179.ec2.internal' and this object" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfwjn"
Jul 30 09:58:30.227538 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:30.227502    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" path="/var/lib/kubelet/pods/df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2/volumes"
Jul 30 09:58:39.111886 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:39.111780    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:39.206640 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:39.206605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:41.139375 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:41.139342    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:43.447278 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:43.447247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:43.528845 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:43.528775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:45.893600 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:45.893567    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:46.421508 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:46.421480    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:46.647598 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:46.647565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:46.712237 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:46.712101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:59.890009 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.889974    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bgz74"]
Jul 30 09:58:59.890391 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.890303    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" containerName="manager"
Jul 30 09:58:59.890391 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.890314    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" containerName="manager"
Jul 30 09:58:59.890391 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.890379    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df0dcc80-d7ae-4b51-bb77-6319bc6fd7a2" containerName="manager"
Jul 30 09:58:59.896294 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.896265    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:58:59.928715 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.928687    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bgz74"]
Jul 30 09:58:59.928891 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.928790    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:58:59.930993 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.930969    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 09:58:59.989162 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:58:59.989131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bgz74"]
Jul 30 09:59:00.002056 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.002026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:00.034332 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.034294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c052e2dd-35d9-4243-8141-609cd289a86a-config-file\") pod \"limitador-limitador-64c94fd64f-bgz74\" (UID: \"c052e2dd-35d9-4243-8141-609cd289a86a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:00.034485 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.034360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcj6\" (UniqueName: \"kubernetes.io/projected/c052e2dd-35d9-4243-8141-609cd289a86a-kube-api-access-4dcj6\") pod \"limitador-limitador-64c94fd64f-bgz74\" (UID: \"c052e2dd-35d9-4243-8141-609cd289a86a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:00.105781 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.105749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:00.134840 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.134787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c052e2dd-35d9-4243-8141-609cd289a86a-config-file\") pod \"limitador-limitador-64c94fd64f-bgz74\" (UID: \"c052e2dd-35d9-4243-8141-609cd289a86a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:00.135009 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.134858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcj6\" (UniqueName: \"kubernetes.io/projected/c052e2dd-35d9-4243-8141-609cd289a86a-kube-api-access-4dcj6\") pod \"limitador-limitador-64c94fd64f-bgz74\" (UID: \"c052e2dd-35d9-4243-8141-609cd289a86a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:00.135515 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.135495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c052e2dd-35d9-4243-8141-609cd289a86a-config-file\") pod \"limitador-limitador-64c94fd64f-bgz74\" (UID: \"c052e2dd-35d9-4243-8141-609cd289a86a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:00.145626 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.145551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcj6\" (UniqueName: \"kubernetes.io/projected/c052e2dd-35d9-4243-8141-609cd289a86a-kube-api-access-4dcj6\") pod \"limitador-limitador-64c94fd64f-bgz74\" (UID: \"c052e2dd-35d9-4243-8141-609cd289a86a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:00.238718 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.238686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:00.407755 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.407680    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bgz74"]
Jul 30 09:59:00.410898 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:59:00.410871    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc052e2dd_35d9_4243_8141_609cd289a86a.slice/crio-f0c1cfa05288ad7a9c62ea73653bad5cc235cf4dc4c6fc07820517eb0fd9cdb7 WatchSource:0}: Error finding container f0c1cfa05288ad7a9c62ea73653bad5cc235cf4dc4c6fc07820517eb0fd9cdb7: Status 404 returned error can't find the container with id f0c1cfa05288ad7a9c62ea73653bad5cc235cf4dc4c6fc07820517eb0fd9cdb7
Jul 30 09:59:00.726620 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.726539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:00.797296 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.797261    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fhzv7"]
Jul 30 09:59:00.835625 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.835580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74" event={"ID":"c052e2dd-35d9-4243-8141-609cd289a86a","Type":"ContainerStarted","Data":"f0c1cfa05288ad7a9c62ea73653bad5cc235cf4dc4c6fc07820517eb0fd9cdb7"}
Jul 30 09:59:00.835776 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.835635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhzv7"]
Jul 30 09:59:00.835776 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.835694    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fhzv7"
Jul 30 09:59:00.837980 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.837959    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j697b\""
Jul 30 09:59:00.864863 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.864832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:00.941208 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:00.941170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cll2t\" (UniqueName: \"kubernetes.io/projected/cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8-kube-api-access-cll2t\") pod \"authorino-58cd955675-fhzv7\" (UID: \"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8\") " pod="kuadrant-system/authorino-58cd955675-fhzv7"
Jul 30 09:59:01.009893 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:01.009802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:01.042195 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:01.042153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cll2t\" (UniqueName: \"kubernetes.io/projected/cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8-kube-api-access-cll2t\") pod \"authorino-58cd955675-fhzv7\" (UID: \"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8\") " pod="kuadrant-system/authorino-58cd955675-fhzv7"
Jul 30 09:59:01.049981 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:01.049955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cll2t\" (UniqueName: \"kubernetes.io/projected/cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8-kube-api-access-cll2t\") pod \"authorino-58cd955675-fhzv7\" (UID: \"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8\") " pod="kuadrant-system/authorino-58cd955675-fhzv7"
Jul 30 09:59:01.145115 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:01.145079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fhzv7"
Jul 30 09:59:01.351884 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:01.351642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhzv7"]
Jul 30 09:59:01.355373 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:59:01.355324    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc1ac3d2_f206_49e4_80ad_cb0da0f12aa8.slice/crio-e62b042740a93a967f25c68c15b032eb5406ca69f75a62fb7997e85bef95b541 WatchSource:0}: Error finding container e62b042740a93a967f25c68c15b032eb5406ca69f75a62fb7997e85bef95b541: Status 404 returned error can't find the container with id e62b042740a93a967f25c68c15b032eb5406ca69f75a62fb7997e85bef95b541
Jul 30 09:59:01.836068 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:01.836026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fhzv7" event={"ID":"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8","Type":"ContainerStarted","Data":"e62b042740a93a967f25c68c15b032eb5406ca69f75a62fb7997e85bef95b541"}
Jul 30 09:59:03.849013 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:03.848957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74" event={"ID":"c052e2dd-35d9-4243-8141-609cd289a86a","Type":"ContainerStarted","Data":"a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c"}
Jul 30 09:59:03.849458 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:03.849129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:03.871653 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:03.871593    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74" podStartSLOduration=1.617162988 podStartE2EDuration="4.871569632s" totalImagesPullingTime="3.254406644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:59:03.87147084 +0000 UTC m=+562.215534298" watchObservedRunningTime="2026-07-30 09:59:03.871569632 +0000 UTC m=+562.215633089"
Jul 30 09:59:05.559125 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:05.559096    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhzv7"]
Jul 30 09:59:05.860143 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:05.860105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fhzv7" event={"ID":"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8","Type":"ContainerStarted","Data":"ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e"}
Jul 30 09:59:05.860328 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:05.860172    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fhzv7" podUID="cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8" containerName="authorino" containerID="cri-o://ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e" gracePeriod=30
Jul 30 09:59:05.876580 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:05.876527    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fhzv7" podStartSLOduration=1.71030885 podStartE2EDuration="5.876511015s" totalImagesPullingTime="4.166202165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:59:05.875930425 +0000 UTC m=+564.219993897" watchObservedRunningTime="2026-07-30 09:59:05.876511015 +0000 UTC m=+564.220574471"
Jul 30 09:59:06.108748 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.108720    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fhzv7"
Jul 30 09:59:06.188933 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.188835    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cll2t\" (UniqueName: \"kubernetes.io/projected/cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8-kube-api-access-cll2t\") pod \"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8\" (UID: \"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8\") "
Jul 30 09:59:06.190854 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.190803    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8-kube-api-access-cll2t" (OuterVolumeSpecName: "kube-api-access-cll2t") pod "cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8" (UID: "cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8"). InnerVolumeSpecName "kube-api-access-cll2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:59:06.290285 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.290248    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cll2t\" (UniqueName: \"kubernetes.io/projected/cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8-kube-api-access-cll2t\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:59:06.865899 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.865864    2581 generic.go:356] "Generic (PLEG): container finished" podID="cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8" containerID="ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e" exitCode=0
Jul 30 09:59:06.866376 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.865908    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fhzv7"
Jul 30 09:59:06.866376 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.865958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fhzv7" event={"ID":"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8","Type":"ContainerDied","Data":"ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e"}
Jul 30 09:59:06.866376 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.866011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fhzv7" event={"ID":"cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8","Type":"ContainerDied","Data":"e62b042740a93a967f25c68c15b032eb5406ca69f75a62fb7997e85bef95b541"}
Jul 30 09:59:06.866376 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.866034    2581 scope.go:117] "RemoveContainer" containerID="ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e"
Jul 30 09:59:06.874109 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.874092    2581 scope.go:117] "RemoveContainer" containerID="ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e"
Jul 30 09:59:06.874365 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:59:06.874347    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e\": container with ID starting with ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e not found: ID does not exist" containerID="ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e"
Jul 30 09:59:06.874437 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.874371    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e"} err="failed to get container status \"ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e\": rpc error: code = NotFound desc = could not find container \"ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e\": container with ID starting with ef0cba1261c11c0fcbd81c6098df1d0010aebd8b2e8a3e7a931be8778dfe602e not found: ID does not exist"
Jul 30 09:59:06.879744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.879721    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhzv7"]
Jul 30 09:59:06.883529 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:06.883508    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhzv7"]
Jul 30 09:59:08.227729 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:08.227696    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8" path="/var/lib/kubelet/pods/cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8/volumes"
Jul 30 09:59:14.653882 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:14.653809    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bgz74"]
Jul 30 09:59:14.654396 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:14.654035    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74" podUID="c052e2dd-35d9-4243-8141-609cd289a86a" containerName="limitador" containerID="cri-o://a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c" gracePeriod=30
Jul 30 09:59:14.654767 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:14.654753    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:15.587561 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.587538    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:15.670502 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.670461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dcj6\" (UniqueName: \"kubernetes.io/projected/c052e2dd-35d9-4243-8141-609cd289a86a-kube-api-access-4dcj6\") pod \"c052e2dd-35d9-4243-8141-609cd289a86a\" (UID: \"c052e2dd-35d9-4243-8141-609cd289a86a\") "
Jul 30 09:59:15.670977 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.670570    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c052e2dd-35d9-4243-8141-609cd289a86a-config-file\") pod \"c052e2dd-35d9-4243-8141-609cd289a86a\" (UID: \"c052e2dd-35d9-4243-8141-609cd289a86a\") "
Jul 30 09:59:15.670977 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.670909    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c052e2dd-35d9-4243-8141-609cd289a86a-config-file" (OuterVolumeSpecName: "config-file") pod "c052e2dd-35d9-4243-8141-609cd289a86a" (UID: "c052e2dd-35d9-4243-8141-609cd289a86a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 09:59:15.672639 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.672618    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c052e2dd-35d9-4243-8141-609cd289a86a-kube-api-access-4dcj6" (OuterVolumeSpecName: "kube-api-access-4dcj6") pod "c052e2dd-35d9-4243-8141-609cd289a86a" (UID: "c052e2dd-35d9-4243-8141-609cd289a86a"). InnerVolumeSpecName "kube-api-access-4dcj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:59:15.771592 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.771509    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c052e2dd-35d9-4243-8141-609cd289a86a-config-file\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:59:15.771592 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.771536    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dcj6\" (UniqueName: \"kubernetes.io/projected/c052e2dd-35d9-4243-8141-609cd289a86a-kube-api-access-4dcj6\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:59:15.908151 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.908120    2581 generic.go:356] "Generic (PLEG): container finished" podID="c052e2dd-35d9-4243-8141-609cd289a86a" containerID="a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c" exitCode=0
Jul 30 09:59:15.908354 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.908173    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74"
Jul 30 09:59:15.908354 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.908202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74" event={"ID":"c052e2dd-35d9-4243-8141-609cd289a86a","Type":"ContainerDied","Data":"a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c"}
Jul 30 09:59:15.908354 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.908255    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bgz74" event={"ID":"c052e2dd-35d9-4243-8141-609cd289a86a","Type":"ContainerDied","Data":"f0c1cfa05288ad7a9c62ea73653bad5cc235cf4dc4c6fc07820517eb0fd9cdb7"}
Jul 30 09:59:15.908354 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.908278    2581 scope.go:117] "RemoveContainer" containerID="a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c"
Jul 30 09:59:15.916429 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.916413    2581 scope.go:117] "RemoveContainer" containerID="a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c"
Jul 30 09:59:15.916685 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:59:15.916668    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c\": container with ID starting with a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c not found: ID does not exist" containerID="a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c"
Jul 30 09:59:15.916744 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.916698    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c"} err="failed to get container status \"a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c\": rpc error: code = NotFound desc = could not find container \"a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c\": container with ID starting with a2b4eac42f67c490cf4f626cde2cb2b45bf45a0859d6752b783aeb4d55fdd50c not found: ID does not exist"
Jul 30 09:59:15.927150 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.927123    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bgz74"]
Jul 30 09:59:15.934804 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:15.934780    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bgz74"]
Jul 30 09:59:16.227412 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:16.227380    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c052e2dd-35d9-4243-8141-609cd289a86a" path="/var/lib/kubelet/pods/c052e2dd-35d9-4243-8141-609cd289a86a/volumes"
Jul 30 09:59:19.160082 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.160025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:19.624720 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.624691    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"]
Jul 30 09:59:19.625113 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.625095    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c052e2dd-35d9-4243-8141-609cd289a86a" containerName="limitador"
Jul 30 09:59:19.625206 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.625116    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c052e2dd-35d9-4243-8141-609cd289a86a" containerName="limitador"
Jul 30 09:59:19.625206 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.625133    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8" containerName="authorino"
Jul 30 09:59:19.625206 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.625141    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8" containerName="authorino"
Jul 30 09:59:19.625355 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.625257    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1ac3d2-f206-49e4-80ad-cb0da0f12aa8" containerName="authorino"
Jul 30 09:59:19.625355 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.625272    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c052e2dd-35d9-4243-8141-609cd289a86a" containerName="limitador"
Jul 30 09:59:19.629655 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.629635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:19.632152 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.632127    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 09:59:19.632265 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.632165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dnt74\""
Jul 30 09:59:19.632423 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.632403    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 30 09:59:19.632542 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.632449    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 09:59:19.638465 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.638444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"]
Jul 30 09:59:19.707492 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.707459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f527b3bd-f7b9-413f-9445-b1f686d091b5-data\") pod \"postgres-69fb4594cf-b4wbd\" (UID: \"f527b3bd-f7b9-413f-9445-b1f686d091b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:19.707676 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.707564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmmrj\" (UniqueName: \"kubernetes.io/projected/f527b3bd-f7b9-413f-9445-b1f686d091b5-kube-api-access-fmmrj\") pod \"postgres-69fb4594cf-b4wbd\" (UID: \"f527b3bd-f7b9-413f-9445-b1f686d091b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:19.808177 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.808138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmmrj\" (UniqueName: \"kubernetes.io/projected/f527b3bd-f7b9-413f-9445-b1f686d091b5-kube-api-access-fmmrj\") pod \"postgres-69fb4594cf-b4wbd\" (UID: \"f527b3bd-f7b9-413f-9445-b1f686d091b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:19.808364 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.808205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f527b3bd-f7b9-413f-9445-b1f686d091b5-data\") pod \"postgres-69fb4594cf-b4wbd\" (UID: \"f527b3bd-f7b9-413f-9445-b1f686d091b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:19.808604 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.808587    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f527b3bd-f7b9-413f-9445-b1f686d091b5-data\") pod \"postgres-69fb4594cf-b4wbd\" (UID: \"f527b3bd-f7b9-413f-9445-b1f686d091b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:19.815703 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.815678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmmrj\" (UniqueName: \"kubernetes.io/projected/f527b3bd-f7b9-413f-9445-b1f686d091b5-kube-api-access-fmmrj\") pod \"postgres-69fb4594cf-b4wbd\" (UID: \"f527b3bd-f7b9-413f-9445-b1f686d091b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:19.942786 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:19.942697    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:20.072650 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:20.072626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"]
Jul 30 09:59:20.075136 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:59:20.075107    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf527b3bd_f7b9_413f_9445_b1f686d091b5.slice/crio-a2508a684e74d71cb1ac17d63e7c47f56cae41f04477dfeb62ea2858c3ee9065 WatchSource:0}: Error finding container a2508a684e74d71cb1ac17d63e7c47f56cae41f04477dfeb62ea2858c3ee9065: Status 404 returned error can't find the container with id a2508a684e74d71cb1ac17d63e7c47f56cae41f04477dfeb62ea2858c3ee9065
Jul 30 09:59:20.080211 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:20.080186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:20.931896 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:20.931862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd" event={"ID":"f527b3bd-f7b9-413f-9445-b1f686d091b5","Type":"ContainerStarted","Data":"a2508a684e74d71cb1ac17d63e7c47f56cae41f04477dfeb62ea2858c3ee9065"}
Jul 30 09:59:21.020080 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:21.020047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:23.108837 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:23.108790    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:25.958571 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:25.958530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd" event={"ID":"f527b3bd-f7b9-413f-9445-b1f686d091b5","Type":"ContainerStarted","Data":"c1f727ef9df2bf0e279b0ab470db132b8985879386890c94687adab78c3c8fca"}
Jul 30 09:59:25.958996 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:25.958600    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:25.972401 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:25.972344    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd" podStartSLOduration=1.840165007 podStartE2EDuration="6.972325266s" totalImagesPullingTime="5.132160259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:59:25.971671741 +0000 UTC m=+584.315735200" watchObservedRunningTime="2026-07-30 09:59:25.972325266 +0000 UTC m=+584.316388724"
Jul 30 09:59:31.993413 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:31.993384    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b4wbd"
Jul 30 09:59:32.308897 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.308873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:32.566777 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.566696    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sbcw7"]
Jul 30 09:59:32.572358 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.572339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sbcw7"
Jul 30 09:59:32.574454 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.574426    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j697b\""
Jul 30 09:59:32.575681 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.575659    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sbcw7"]
Jul 30 09:59:32.623334 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.623296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x698l\" (UniqueName: \"kubernetes.io/projected/00e537ef-dfc0-4c54-a129-b0cf1581e23a-kube-api-access-x698l\") pod \"authorino-5d4b67c446-sbcw7\" (UID: \"00e537ef-dfc0-4c54-a129-b0cf1581e23a\") " pod="kuadrant-system/authorino-5d4b67c446-sbcw7"
Jul 30 09:59:32.724114 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.724077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x698l\" (UniqueName: \"kubernetes.io/projected/00e537ef-dfc0-4c54-a129-b0cf1581e23a-kube-api-access-x698l\") pod \"authorino-5d4b67c446-sbcw7\" (UID: \"00e537ef-dfc0-4c54-a129-b0cf1581e23a\") " pod="kuadrant-system/authorino-5d4b67c446-sbcw7"
Jul 30 09:59:32.732802 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.732770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x698l\" (UniqueName: \"kubernetes.io/projected/00e537ef-dfc0-4c54-a129-b0cf1581e23a-kube-api-access-x698l\") pod \"authorino-5d4b67c446-sbcw7\" (UID: \"00e537ef-dfc0-4c54-a129-b0cf1581e23a\") " pod="kuadrant-system/authorino-5d4b67c446-sbcw7"
Jul 30 09:59:32.845236 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.845158    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sbcw7"]
Jul 30 09:59:32.845453 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.845436    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sbcw7"
Jul 30 09:59:32.874516 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.874484    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5987799fbf-c5vxv"]
Jul 30 09:59:32.880988 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.880960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 09:59:32.883031 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.883008    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 09:59:32.886933 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.886909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5987799fbf-c5vxv"]
Jul 30 09:59:32.925828 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.925780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-tls-cert\") pod \"authorino-5987799fbf-c5vxv\" (UID: \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\") " pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 09:59:32.926024 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.925896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhvrs\" (UniqueName: \"kubernetes.io/projected/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-kube-api-access-mhvrs\") pod \"authorino-5987799fbf-c5vxv\" (UID: \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\") " pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 09:59:32.983017 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:32.982984    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sbcw7"]
Jul 30 09:59:32.985809 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:59:32.985781    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00e537ef_dfc0_4c54_a129_b0cf1581e23a.slice/crio-e35d5fbe32218f294d064f86537aa644551e4738f721b6da00405b900ccc1c67 WatchSource:0}: Error finding container e35d5fbe32218f294d064f86537aa644551e4738f721b6da00405b900ccc1c67: Status 404 returned error can't find the container with id e35d5fbe32218f294d064f86537aa644551e4738f721b6da00405b900ccc1c67
Jul 30 09:59:33.016752 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.016725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:33.026501 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.026477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-tls-cert\") pod \"authorino-5987799fbf-c5vxv\" (UID: \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\") " pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 09:59:33.026607 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.026523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhvrs\" (UniqueName: \"kubernetes.io/projected/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-kube-api-access-mhvrs\") pod \"authorino-5987799fbf-c5vxv\" (UID: \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\") " pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 09:59:33.028925 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.028903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-tls-cert\") pod \"authorino-5987799fbf-c5vxv\" (UID: \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\") " pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 09:59:33.035570 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.035546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhvrs\" (UniqueName: \"kubernetes.io/projected/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-kube-api-access-mhvrs\") pod \"authorino-5987799fbf-c5vxv\" (UID: \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\") " pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 09:59:33.192716 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.192629    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 09:59:33.351010 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.350936    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5987799fbf-c5vxv"]
Jul 30 09:59:33.353074 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:59:33.353048    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ccbbd74_1ece_4637_9cea_d3b7449fcc2c.slice/crio-5f9c912653a2bc2f4d540e419e3712cd9246ba699173def70364565417e11dc3 WatchSource:0}: Error finding container 5f9c912653a2bc2f4d540e419e3712cd9246ba699173def70364565417e11dc3: Status 404 returned error can't find the container with id 5f9c912653a2bc2f4d540e419e3712cd9246ba699173def70364565417e11dc3
Jul 30 09:59:33.997199 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.997166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5987799fbf-c5vxv" event={"ID":"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c","Type":"ContainerStarted","Data":"be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1"}
Jul 30 09:59:33.997392 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.997213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5987799fbf-c5vxv" event={"ID":"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c","Type":"ContainerStarted","Data":"5f9c912653a2bc2f4d540e419e3712cd9246ba699173def70364565417e11dc3"}
Jul 30 09:59:33.999044 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.999019    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sbcw7" event={"ID":"00e537ef-dfc0-4c54-a129-b0cf1581e23a","Type":"ContainerStarted","Data":"720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4"}
Jul 30 09:59:33.999165 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.999055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sbcw7" event={"ID":"00e537ef-dfc0-4c54-a129-b0cf1581e23a","Type":"ContainerStarted","Data":"e35d5fbe32218f294d064f86537aa644551e4738f721b6da00405b900ccc1c67"}
Jul 30 09:59:33.999165 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:33.999082    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-sbcw7" podUID="00e537ef-dfc0-4c54-a129-b0cf1581e23a" containerName="authorino" containerID="cri-o://720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4" gracePeriod=30
Jul 30 09:59:34.014432 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:34.014385    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5987799fbf-c5vxv" podStartSLOduration=1.5226857809999998 podStartE2EDuration="2.014368313s" totalImagesPullingTime="491.682532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:59:34.013475256 +0000 UTC m=+592.357538716" watchObservedRunningTime="2026-07-30 09:59:34.014368313 +0000 UTC m=+592.358431768"
Jul 30 09:59:34.029652 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:34.029595    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-sbcw7" podStartSLOduration=1.607666574 podStartE2EDuration="2.029560788s" totalImagesPullingTime="421.894214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:59:34.028587697 +0000 UTC m=+592.372651154" watchObservedRunningTime="2026-07-30 09:59:34.029560788 +0000 UTC m=+592.373624245"
Jul 30 09:59:34.293713 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:34.293676    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sbcw7"
Jul 30 09:59:34.336688 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:34.336659    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x698l\" (UniqueName: \"kubernetes.io/projected/00e537ef-dfc0-4c54-a129-b0cf1581e23a-kube-api-access-x698l\") pod \"00e537ef-dfc0-4c54-a129-b0cf1581e23a\" (UID: \"00e537ef-dfc0-4c54-a129-b0cf1581e23a\") "
Jul 30 09:59:34.338757 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:34.338730    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e537ef-dfc0-4c54-a129-b0cf1581e23a-kube-api-access-x698l" (OuterVolumeSpecName: "kube-api-access-x698l") pod "00e537ef-dfc0-4c54-a129-b0cf1581e23a" (UID: "00e537ef-dfc0-4c54-a129-b0cf1581e23a"). InnerVolumeSpecName "kube-api-access-x698l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:59:34.437832 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:34.437737    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x698l\" (UniqueName: \"kubernetes.io/projected/00e537ef-dfc0-4c54-a129-b0cf1581e23a-kube-api-access-x698l\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:59:35.004750 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.004671    2581 generic.go:356] "Generic (PLEG): container finished" podID="00e537ef-dfc0-4c54-a129-b0cf1581e23a" containerID="720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4" exitCode=0
Jul 30 09:59:35.004750 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.004715    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sbcw7"
Jul 30 09:59:35.004999 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.004757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sbcw7" event={"ID":"00e537ef-dfc0-4c54-a129-b0cf1581e23a","Type":"ContainerDied","Data":"720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4"}
Jul 30 09:59:35.004999 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.004796    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sbcw7" event={"ID":"00e537ef-dfc0-4c54-a129-b0cf1581e23a","Type":"ContainerDied","Data":"e35d5fbe32218f294d064f86537aa644551e4738f721b6da00405b900ccc1c67"}
Jul 30 09:59:35.004999 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.004813    2581 scope.go:117] "RemoveContainer" containerID="720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4"
Jul 30 09:59:35.013611 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.013594    2581 scope.go:117] "RemoveContainer" containerID="720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4"
Jul 30 09:59:35.013943 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:59:35.013921    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4\": container with ID starting with 720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4 not found: ID does not exist" containerID="720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4"
Jul 30 09:59:35.014027 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.013952    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4"} err="failed to get container status \"720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4\": rpc error: code = NotFound desc = could not find container \"720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4\": container with ID starting with 720850c8732bed135a897322006a63d095fac0de341597f8f03fac4dc516dcd4 not found: ID does not exist"
Jul 30 09:59:35.024632 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.024607    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sbcw7"]
Jul 30 09:59:35.032832 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:35.030274    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sbcw7"]
Jul 30 09:59:36.227106 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:36.227066    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e537ef-dfc0-4c54-a129-b0cf1581e23a" path="/var/lib/kubelet/pods/00e537ef-dfc0-4c54-a129-b0cf1581e23a/volumes"
Jul 30 09:59:38.942481 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.942447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:38.976417 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.976385    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6df6b96bd6-9jw7x"]
Jul 30 09:59:38.976723 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.976712    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e537ef-dfc0-4c54-a129-b0cf1581e23a" containerName="authorino"
Jul 30 09:59:38.976766 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.976725    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e537ef-dfc0-4c54-a129-b0cf1581e23a" containerName="authorino"
Jul 30 09:59:38.976800 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.976780    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e537ef-dfc0-4c54-a129-b0cf1581e23a" containerName="authorino"
Jul 30 09:59:38.984245 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.984216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:38.986153 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.986121    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 09:59:38.986281 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.986251    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 09:59:38.986521 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.986505    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pzbsj\""
Jul 30 09:59:38.987244 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:38.987225    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6df6b96bd6-9jw7x"]
Jul 30 09:59:39.069991 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.069960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1099966c-2123-477a-b336-a9799f46ef6f-webhook-cert\") pod \"maas-controller-6df6b96bd6-9jw7x\" (UID: \"1099966c-2123-477a-b336-a9799f46ef6f\") " pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:39.070163 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.070005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9s22\" (UniqueName: \"kubernetes.io/projected/1099966c-2123-477a-b336-a9799f46ef6f-kube-api-access-h9s22\") pod \"maas-controller-6df6b96bd6-9jw7x\" (UID: \"1099966c-2123-477a-b336-a9799f46ef6f\") " pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:39.170522 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.170491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9s22\" (UniqueName: \"kubernetes.io/projected/1099966c-2123-477a-b336-a9799f46ef6f-kube-api-access-h9s22\") pod \"maas-controller-6df6b96bd6-9jw7x\" (UID: \"1099966c-2123-477a-b336-a9799f46ef6f\") " pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:39.170703 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.170566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1099966c-2123-477a-b336-a9799f46ef6f-webhook-cert\") pod \"maas-controller-6df6b96bd6-9jw7x\" (UID: \"1099966c-2123-477a-b336-a9799f46ef6f\") " pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:39.173245 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.173214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1099966c-2123-477a-b336-a9799f46ef6f-webhook-cert\") pod \"maas-controller-6df6b96bd6-9jw7x\" (UID: \"1099966c-2123-477a-b336-a9799f46ef6f\") " pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:39.179144 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.179124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9s22\" (UniqueName: \"kubernetes.io/projected/1099966c-2123-477a-b336-a9799f46ef6f-kube-api-access-h9s22\") pod \"maas-controller-6df6b96bd6-9jw7x\" (UID: \"1099966c-2123-477a-b336-a9799f46ef6f\") " pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:39.295997 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.295899    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:39.421734 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.421707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6df6b96bd6-9jw7x"]
Jul 30 09:59:39.424189 ip-10-0-131-179 kubenswrapper[2581]: W0730 09:59:39.424163    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1099966c_2123_477a_b336_a9799f46ef6f.slice/crio-32f0a4589717b49021fd518742544cffaa2200944c55fa06c3f406db2c9018d1 WatchSource:0}: Error finding container 32f0a4589717b49021fd518742544cffaa2200944c55fa06c3f406db2c9018d1: Status 404 returned error can't find the container with id 32f0a4589717b49021fd518742544cffaa2200944c55fa06c3f406db2c9018d1
Jul 30 09:59:39.600730 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.600697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:39.699976 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:39.699943    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:40.029383 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:40.029300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x" event={"ID":"1099966c-2123-477a-b336-a9799f46ef6f","Type":"ContainerStarted","Data":"32f0a4589717b49021fd518742544cffaa2200944c55fa06c3f406db2c9018d1"}
Jul 30 09:59:41.913268 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:41.913236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:42.012804 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:42.012777    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 09:59:42.041095 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:42.041017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x" event={"ID":"1099966c-2123-477a-b336-a9799f46ef6f","Type":"ContainerStarted","Data":"6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f"}
Jul 30 09:59:42.041252 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:42.041142    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:42.061323 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:42.061273    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x" podStartSLOduration=1.7210080479999998 podStartE2EDuration="4.061258524s" totalImagesPullingTime="2.340250476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:59:42.060259404 +0000 UTC m=+600.404322861" watchObservedRunningTime="2026-07-30 09:59:42.061258524 +0000 UTC m=+600.405321979"
Jul 30 09:59:42.133426 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:42.133400    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 09:59:42.134648 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:42.134627    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 09:59:53.048021 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:53.047918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:53.780288 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:53.780254    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6df6b96bd6-9jw7x"]
Jul 30 09:59:53.780474 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:53.780449    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x" podUID="1099966c-2123-477a-b336-a9799f46ef6f" containerName="manager" containerID="cri-o://6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f" gracePeriod=30
Jul 30 09:59:53.794716 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:59:53.794677    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1099966c_2123_477a_b336_a9799f46ef6f.slice/crio-6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 09:59:54.029626 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.029599    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:54.090260 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.090234    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1099966c-2123-477a-b336-a9799f46ef6f-webhook-cert\") pod \"1099966c-2123-477a-b336-a9799f46ef6f\" (UID: \"1099966c-2123-477a-b336-a9799f46ef6f\") "
Jul 30 09:59:54.090653 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.090341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9s22\" (UniqueName: \"kubernetes.io/projected/1099966c-2123-477a-b336-a9799f46ef6f-kube-api-access-h9s22\") pod \"1099966c-2123-477a-b336-a9799f46ef6f\" (UID: \"1099966c-2123-477a-b336-a9799f46ef6f\") "
Jul 30 09:59:54.092545 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.092510    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1099966c-2123-477a-b336-a9799f46ef6f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1099966c-2123-477a-b336-a9799f46ef6f" (UID: "1099966c-2123-477a-b336-a9799f46ef6f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 09:59:54.092678 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.092595    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1099966c-2123-477a-b336-a9799f46ef6f-kube-api-access-h9s22" (OuterVolumeSpecName: "kube-api-access-h9s22") pod "1099966c-2123-477a-b336-a9799f46ef6f" (UID: "1099966c-2123-477a-b336-a9799f46ef6f"). InnerVolumeSpecName "kube-api-access-h9s22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 09:59:54.094530 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.094506    2581 generic.go:356] "Generic (PLEG): container finished" podID="1099966c-2123-477a-b336-a9799f46ef6f" containerID="6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f" exitCode=0
Jul 30 09:59:54.094651 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.094546    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x"
Jul 30 09:59:54.094651 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.094563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x" event={"ID":"1099966c-2123-477a-b336-a9799f46ef6f","Type":"ContainerDied","Data":"6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f"}
Jul 30 09:59:54.094651 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.094603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df6b96bd6-9jw7x" event={"ID":"1099966c-2123-477a-b336-a9799f46ef6f","Type":"ContainerDied","Data":"32f0a4589717b49021fd518742544cffaa2200944c55fa06c3f406db2c9018d1"}
Jul 30 09:59:54.094651 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.094639    2581 scope.go:117] "RemoveContainer" containerID="6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f"
Jul 30 09:59:54.109238 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.109215    2581 scope.go:117] "RemoveContainer" containerID="6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f"
Jul 30 09:59:54.109538 ip-10-0-131-179 kubenswrapper[2581]: E0730 09:59:54.109507    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f\": container with ID starting with 6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f not found: ID does not exist" containerID="6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f"
Jul 30 09:59:54.109627 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.109552    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f"} err="failed to get container status \"6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f\": rpc error: code = NotFound desc = could not find container \"6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f\": container with ID starting with 6aa6e67542720fdec1f7656a14e3f7c5feb69677ad969bc7e486ad36439c008f not found: ID does not exist"
Jul 30 09:59:54.119298 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.119273    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6df6b96bd6-9jw7x"]
Jul 30 09:59:54.123106 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.123081    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6df6b96bd6-9jw7x"]
Jul 30 09:59:54.191065 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.191026    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9s22\" (UniqueName: \"kubernetes.io/projected/1099966c-2123-477a-b336-a9799f46ef6f-kube-api-access-h9s22\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:59:54.191065 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.191059    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1099966c-2123-477a-b336-a9799f46ef6f-webhook-cert\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 09:59:54.228718 ip-10-0-131-179 kubenswrapper[2581]: I0730 09:59:54.228678    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1099966c-2123-477a-b336-a9799f46ef6f" path="/var/lib/kubelet/pods/1099966c-2123-477a-b336-a9799f46ef6f/volumes"
Jul 30 10:00:12.848353 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:12.848263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:00:14.550782 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.550743    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"]
Jul 30 10:00:14.551297 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.551233    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1099966c-2123-477a-b336-a9799f46ef6f" containerName="manager"
Jul 30 10:00:14.551297 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.551253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1099966c-2123-477a-b336-a9799f46ef6f" containerName="manager"
Jul 30 10:00:14.551737 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.551364    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1099966c-2123-477a-b336-a9799f46ef6f" containerName="manager"
Jul 30 10:00:14.560019 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.559990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.561834 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.561791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 30 10:00:14.561977 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.561927    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7c4ls\""
Jul 30 10:00:14.565420 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.565395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"]
Jul 30 10:00:14.663285 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.663234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dpxr\" (UniqueName: \"kubernetes.io/projected/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-kube-api-access-4dpxr\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.663461 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.663359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-openshift-service-ca\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.663461 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.663434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-maas-api-tls\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.764153 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.764116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-openshift-service-ca\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.764323 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.764177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-maas-api-tls\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.764323 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.764209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dpxr\" (UniqueName: \"kubernetes.io/projected/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-kube-api-access-4dpxr\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.764723 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.764702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-openshift-service-ca\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.766768 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.766741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-maas-api-tls\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.775834 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.775800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dpxr\" (UniqueName: \"kubernetes.io/projected/37f0403f-2dae-4faa-9df9-a81c5a77f1b8-kube-api-access-4dpxr\") pod \"maas-api-56dbcbcdbf-c8shw\" (UID: \"37f0403f-2dae-4faa-9df9-a81c5a77f1b8\") " pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:14.873063 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:14.873025    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:15.027960 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:15.027929    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"]
Jul 30 10:00:15.029931 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:00:15.029909    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f0403f_2dae_4faa_9df9_a81c5a77f1b8.slice/crio-40367057f6a5fa28183a781090d678b73e637ad6025cf397c5e0df039121ca0e WatchSource:0}: Error finding container 40367057f6a5fa28183a781090d678b73e637ad6025cf397c5e0df039121ca0e: Status 404 returned error can't find the container with id 40367057f6a5fa28183a781090d678b73e637ad6025cf397c5e0df039121ca0e
Jul 30 10:00:15.194843 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:15.194743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw" event={"ID":"37f0403f-2dae-4faa-9df9-a81c5a77f1b8","Type":"ContainerStarted","Data":"40367057f6a5fa28183a781090d678b73e637ad6025cf397c5e0df039121ca0e"}
Jul 30 10:00:15.455940 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:15.455839    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:00:17.205775 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:17.205737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw" event={"ID":"37f0403f-2dae-4faa-9df9-a81c5a77f1b8","Type":"ContainerStarted","Data":"7ffb0df2402c1b1786b8f5478c93e4cbdefb5f74a1827704c89840f8695a52f7"}
Jul 30 10:00:17.206246 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:17.205936    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:17.225864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:17.225782    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw" podStartSLOduration=1.221296487 podStartE2EDuration="3.225763839s" totalImagesPullingTime="2.004467352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:00:17.225413997 +0000 UTC m=+635.569477454" watchObservedRunningTime="2026-07-30 10:00:17.225763839 +0000 UTC m=+635.569827296"
Jul 30 10:00:23.216664 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:23.216633    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-56dbcbcdbf-c8shw"
Jul 30 10:00:24.278486 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:24.278455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:00:24.441627 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:24.441586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:00:34.882701 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:34.882672    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:00:43.526067 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.526034    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"]
Jul 30 10:00:43.529224 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.529203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.532046 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.532020    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 10:00:43.532046 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.532043    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 10:00:43.532237 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.532050    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mcpsp\""
Jul 30 10:00:43.532237 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.532020    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 10:00:43.544264 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.544240    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"]
Jul 30 10:00:43.617704 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.617671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.617704 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.617712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.618005 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.617731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k4z4\" (UniqueName: \"kubernetes.io/projected/78da463a-d05d-44c7-b911-3599a1e099d6-kube-api-access-8k4z4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.618005 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.617855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78da463a-d05d-44c7-b911-3599a1e099d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.618005 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.617911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.618005 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.617950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.718477 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.718436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.718477 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.718481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k4z4\" (UniqueName: \"kubernetes.io/projected/78da463a-d05d-44c7-b911-3599a1e099d6-kube-api-access-8k4z4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.718745 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.718529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78da463a-d05d-44c7-b911-3599a1e099d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.718745 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.718555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.718745 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.718583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.718745 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.718627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.719003 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.718942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.719072 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.719028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.719125 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.719090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.720708 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.720687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78da463a-d05d-44c7-b911-3599a1e099d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.721307 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.721286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78da463a-d05d-44c7-b911-3599a1e099d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.732268 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.732242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k4z4\" (UniqueName: \"kubernetes.io/projected/78da463a-d05d-44c7-b911-3599a1e099d6-kube-api-access-8k4z4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh\" (UID: \"78da463a-d05d-44c7-b911-3599a1e099d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.841152 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.841119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:43.867753 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.867718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:00:43.974138 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.974106    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"]
Jul 30 10:00:43.977276 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:00:43.977254    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78da463a_d05d_44c7_b911_3599a1e099d6.slice/crio-4941ad14ed6f42aca11cf32a0051dfa0fa9c913de088c2e0ad0180e1496e9a11 WatchSource:0}: Error finding container 4941ad14ed6f42aca11cf32a0051dfa0fa9c913de088c2e0ad0180e1496e9a11: Status 404 returned error can't find the container with id 4941ad14ed6f42aca11cf32a0051dfa0fa9c913de088c2e0ad0180e1496e9a11
Jul 30 10:00:43.978706 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:43.978688    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:00:44.324087 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:44.324051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh" event={"ID":"78da463a-d05d-44c7-b911-3599a1e099d6","Type":"ContainerStarted","Data":"4941ad14ed6f42aca11cf32a0051dfa0fa9c913de088c2e0ad0180e1496e9a11"}
Jul 30 10:00:49.347638 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:49.347600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh" event={"ID":"78da463a-d05d-44c7-b911-3599a1e099d6","Type":"ContainerStarted","Data":"3945fd489c7c1ebe425e6e66897c4ce74368bb1e88b235cd03b0e50802437c97"}
Jul 30 10:00:49.366320 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:49.366265    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh" podStartSLOduration=1.994489857 podStartE2EDuration="6.366247709s" totalImagesPullingTime="4.371757852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:00:49.365192461 +0000 UTC m=+667.709255917" watchObservedRunningTime="2026-07-30 10:00:49.366247709 +0000 UTC m=+667.710311165"
Jul 30 10:00:50.234863 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:50.234812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:00:53.841794 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:53.841759    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:53.842286 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:53.841842    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:53.854548 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:53.854519    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:54.382421 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:54.382389    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh"
Jul 30 10:00:58.049446 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:00:58.049386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:01:05.055067 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:05.055034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:01:09.523423 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:09.523391    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:01:11.396378 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.396342    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"]
Jul 30 10:01:11.399275 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.399244    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.401316 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.401292    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 30 10:01:11.412235 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.412163    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"]
Jul 30 10:01:11.424895 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.424869    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:01:11.561290 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.561257    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.561452 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.561305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.561452 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.561331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bssgc\" (UniqueName: \"kubernetes.io/projected/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-kube-api-access-bssgc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.561452 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.561429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.561582 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.561557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.561667 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.561648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.662665 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.662575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.662665 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.662627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.662933 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.662745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.662933 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.662790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.662933 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.662812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bssgc\" (UniqueName: \"kubernetes.io/projected/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-kube-api-access-bssgc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.662933 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.662894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.663157 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.663048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.663157 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.663111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.663246 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.663227    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.664896 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.664876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.665182 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.665167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.671113 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.671091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bssgc\" (UniqueName: \"kubernetes.io/projected/ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44-kube-api-access-bssgc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qhtqk\" (UID: \"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.709665 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.709627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:11.841870 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:11.841843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"]
Jul 30 10:01:11.844154 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:01:11.844113    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2ca8cc_86b5_4530_8e5b_e0d84f03fb44.slice/crio-24cd9164a7d704db5df2492ced1fbdea690cb3b3c55bf67044905688916ce740 WatchSource:0}: Error finding container 24cd9164a7d704db5df2492ced1fbdea690cb3b3c55bf67044905688916ce740: Status 404 returned error can't find the container with id 24cd9164a7d704db5df2492ced1fbdea690cb3b3c55bf67044905688916ce740
Jul 30 10:01:12.452498 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:12.452461    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk" event={"ID":"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44","Type":"ContainerStarted","Data":"02d7406a9f4e44c258196c71d37e7f60077d027145b7d6ea2315f5069701b538"}
Jul 30 10:01:12.452897 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:12.452516    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk" event={"ID":"ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44","Type":"ContainerStarted","Data":"24cd9164a7d704db5df2492ced1fbdea690cb3b3c55bf67044905688916ce740"}
Jul 30 10:01:12.469067 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:12.469007    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk" podStartSLOduration=1.033517031 podStartE2EDuration="1.468991598s" totalImagesPullingTime="435.474567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:01:12.468070566 +0000 UTC m=+690.812134021" watchObservedRunningTime="2026-07-30 10:01:12.468991598 +0000 UTC m=+690.813055053"
Jul 30 10:01:18.419129 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.419092    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"]
Jul 30 10:01:18.422656 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.422638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.424746 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.424715    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 30 10:01:18.430552 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.430528    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"]
Jul 30 10:01:18.518101 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.518054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:01:18.526664 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.526638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.526664 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.526668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.526905 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.526715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.526905 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.526751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pkc7\" (UniqueName: \"kubernetes.io/projected/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-kube-api-access-4pkc7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.526905 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.526772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.526905 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.526799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628256 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628256 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628506 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628506 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628506 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628506 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pkc7\" (UniqueName: \"kubernetes.io/projected/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-kube-api-access-4pkc7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628747 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628850 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628793    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.628948 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.628925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.630680 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.630658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.630813 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.630795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.635532 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.635512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pkc7\" (UniqueName: \"kubernetes.io/projected/8c8efd57-bb39-48bc-8feb-cb4ec30531c5-kube-api-access-4pkc7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck\" (UID: \"8c8efd57-bb39-48bc-8feb-cb4ec30531c5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.734484 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.734396    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:18.865072 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:18.865037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"]
Jul 30 10:01:18.868417 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:01:18.868390    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8efd57_bb39_48bc_8feb_cb4ec30531c5.slice/crio-0651bc33d78048acd92ba8b67b534cb373a57c7c33e4c1614bf6379677d31475 WatchSource:0}: Error finding container 0651bc33d78048acd92ba8b67b534cb373a57c7c33e4c1614bf6379677d31475: Status 404 returned error can't find the container with id 0651bc33d78048acd92ba8b67b534cb373a57c7c33e4c1614bf6379677d31475
Jul 30 10:01:19.485314 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:19.485279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck" event={"ID":"8c8efd57-bb39-48bc-8feb-cb4ec30531c5","Type":"ContainerStarted","Data":"0651bc33d78048acd92ba8b67b534cb373a57c7c33e4c1614bf6379677d31475"}
Jul 30 10:01:20.491079 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:20.491033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck" event={"ID":"8c8efd57-bb39-48bc-8feb-cb4ec30531c5","Type":"ContainerStarted","Data":"f634884225dc5abaa026a59dfd9a8f2fe44f79e0cd8c5ca57cbacf5072d4d841"}
Jul 30 10:01:20.507622 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:20.507568    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck" podStartSLOduration=1.780307616 podStartE2EDuration="2.507552824s" totalImagesPullingTime="727.245208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:01:20.50588309 +0000 UTC m=+698.849946547" watchObservedRunningTime="2026-07-30 10:01:20.507552824 +0000 UTC m=+698.851616279"
Jul 30 10:01:21.710372 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:21.710267    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:21.710372 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:21.710331    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:21.722812 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:21.722782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:22.510783 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:22.510743    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qhtqk"
Jul 30 10:01:27.542221 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:27.542190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:01:28.735080 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:28.735040    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:28.735473 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:28.735212    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:28.747454 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:28.747427    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:29.544684 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:29.544656    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck"
Jul 30 10:01:41.976084 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:01:41.976009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:02:45.801419 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:45.801380    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5987799fbf-c5vxv"]
Jul 30 10:02:45.801939 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:45.801631    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5987799fbf-c5vxv" podUID="6ccbbd74-1ece-4637-9cea-d3b7449fcc2c" containerName="authorino" containerID="cri-o://be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1" gracePeriod=30
Jul 30 10:02:46.051709 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.051648    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 10:02:46.222570 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.222533    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-tls-cert\") pod \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\" (UID: \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\") "
Jul 30 10:02:46.222570 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.222570    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhvrs\" (UniqueName: \"kubernetes.io/projected/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-kube-api-access-mhvrs\") pod \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\" (UID: \"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c\") "
Jul 30 10:02:46.224644 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.224612    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-kube-api-access-mhvrs" (OuterVolumeSpecName: "kube-api-access-mhvrs") pod "6ccbbd74-1ece-4637-9cea-d3b7449fcc2c" (UID: "6ccbbd74-1ece-4637-9cea-d3b7449fcc2c"). InnerVolumeSpecName "kube-api-access-mhvrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:02:46.233611 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.233582    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6ccbbd74-1ece-4637-9cea-d3b7449fcc2c" (UID: "6ccbbd74-1ece-4637-9cea-d3b7449fcc2c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:02:46.323528 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.323478    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-tls-cert\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:02:46.323528 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.323529    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhvrs\" (UniqueName: \"kubernetes.io/projected/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c-kube-api-access-mhvrs\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:02:46.761609 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.761527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:02:46.865385 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.865354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:02:46.882651 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.882619    2581 generic.go:356] "Generic (PLEG): container finished" podID="6ccbbd74-1ece-4637-9cea-d3b7449fcc2c" containerID="be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1" exitCode=0
Jul 30 10:02:46.882811 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.882660    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5987799fbf-c5vxv"
Jul 30 10:02:46.882811 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.882706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5987799fbf-c5vxv" event={"ID":"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c","Type":"ContainerDied","Data":"be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1"}
Jul 30 10:02:46.882811 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.882746    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5987799fbf-c5vxv" event={"ID":"6ccbbd74-1ece-4637-9cea-d3b7449fcc2c","Type":"ContainerDied","Data":"5f9c912653a2bc2f4d540e419e3712cd9246ba699173def70364565417e11dc3"}
Jul 30 10:02:46.882811 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.882764    2581 scope.go:117] "RemoveContainer" containerID="be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1"
Jul 30 10:02:46.892005 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.891989    2581 scope.go:117] "RemoveContainer" containerID="be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1"
Jul 30 10:02:46.892311 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:02:46.892293    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1\": container with ID starting with be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1 not found: ID does not exist" containerID="be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1"
Jul 30 10:02:46.892368 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.892320    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1"} err="failed to get container status \"be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1\": rpc error: code = NotFound desc = could not find container \"be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1\": container with ID starting with be26821da02f9ff9e47416fdf1d53ddc5a79014b6e71416233e3954d2a436ee1 not found: ID does not exist"
Jul 30 10:02:46.905411 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.905376    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5987799fbf-c5vxv"]
Jul 30 10:02:46.910310 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:46.910283    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5987799fbf-c5vxv"]
Jul 30 10:02:48.227395 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:02:48.227361    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ccbbd74-1ece-4637-9cea-d3b7449fcc2c" path="/var/lib/kubelet/pods/6ccbbd74-1ece-4637-9cea-d3b7449fcc2c/volumes"
Jul 30 10:04:01.441273 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:01.441241    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:04:36.872861 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.872757    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vx9g6"]
Jul 30 10:04:36.873591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.873325    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ccbbd74-1ece-4637-9cea-d3b7449fcc2c" containerName="authorino"
Jul 30 10:04:36.873591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.873347    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ccbbd74-1ece-4637-9cea-d3b7449fcc2c" containerName="authorino"
Jul 30 10:04:36.873591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.873448    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ccbbd74-1ece-4637-9cea-d3b7449fcc2c" containerName="authorino"
Jul 30 10:04:36.876709 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.876687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:36.878579 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.878558    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 10:04:36.879067 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.879048    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 10:04:36.879144 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.879064    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pzbsj\""
Jul 30 10:04:36.889352 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:36.889322    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vx9g6"]
Jul 30 10:04:37.000811 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.000771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713ed0e5-5ddb-4f33-9178-4e5041546bbe-webhook-cert\") pod \"maas-controller-54646dcfcb-vx9g6\" (UID: \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\") " pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:37.001034 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.000896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qk67\" (UniqueName: \"kubernetes.io/projected/713ed0e5-5ddb-4f33-9178-4e5041546bbe-kube-api-access-6qk67\") pod \"maas-controller-54646dcfcb-vx9g6\" (UID: \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\") " pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:37.101498 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.101452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qk67\" (UniqueName: \"kubernetes.io/projected/713ed0e5-5ddb-4f33-9178-4e5041546bbe-kube-api-access-6qk67\") pod \"maas-controller-54646dcfcb-vx9g6\" (UID: \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\") " pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:37.101715 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.101584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713ed0e5-5ddb-4f33-9178-4e5041546bbe-webhook-cert\") pod \"maas-controller-54646dcfcb-vx9g6\" (UID: \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\") " pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:37.104066 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.104042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713ed0e5-5ddb-4f33-9178-4e5041546bbe-webhook-cert\") pod \"maas-controller-54646dcfcb-vx9g6\" (UID: \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\") " pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:37.109436 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.109408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qk67\" (UniqueName: \"kubernetes.io/projected/713ed0e5-5ddb-4f33-9178-4e5041546bbe-kube-api-access-6qk67\") pod \"maas-controller-54646dcfcb-vx9g6\" (UID: \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\") " pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:37.197099 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.197005    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:37.332640 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.332586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vx9g6"]
Jul 30 10:04:37.334956 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:04:37.334929    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713ed0e5_5ddb_4f33_9178_4e5041546bbe.slice/crio-9d97c759c5d2648892cd9c1e468813d2af538ff8b6a44643cf8d1b4aad0f8f71 WatchSource:0}: Error finding container 9d97c759c5d2648892cd9c1e468813d2af538ff8b6a44643cf8d1b4aad0f8f71: Status 404 returned error can't find the container with id 9d97c759c5d2648892cd9c1e468813d2af538ff8b6a44643cf8d1b4aad0f8f71
Jul 30 10:04:37.389363 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:37.389327    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-vx9g6" event={"ID":"713ed0e5-5ddb-4f33-9178-4e5041546bbe","Type":"ContainerStarted","Data":"9d97c759c5d2648892cd9c1e468813d2af538ff8b6a44643cf8d1b4aad0f8f71"}
Jul 30 10:04:38.395765 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:38.395724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-vx9g6" event={"ID":"713ed0e5-5ddb-4f33-9178-4e5041546bbe","Type":"ContainerStarted","Data":"4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde"}
Jul 30 10:04:38.396250 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:38.395806    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:38.412837 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:38.412778    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54646dcfcb-vx9g6" podStartSLOduration=1.838683746 podStartE2EDuration="2.412760959s" totalImagesPullingTime="574.077213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:04:38.411102496 +0000 UTC m=+896.755165953" watchObservedRunningTime="2026-07-30 10:04:38.412760959 +0000 UTC m=+896.756824412"
Jul 30 10:04:42.163155 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:42.163124    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:04:42.163926 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:42.163907    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:04:49.402503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:49.402473    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:53.951606 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:53.951573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:04:54.065188 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.065149    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vx9g6"]
Jul 30 10:04:54.065411 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.065365    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54646dcfcb-vx9g6" podUID="713ed0e5-5ddb-4f33-9178-4e5041546bbe" containerName="manager" containerID="cri-o://4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde" gracePeriod=30
Jul 30 10:04:54.305957 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.305933    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:54.458702 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.458671    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qk67\" (UniqueName: \"kubernetes.io/projected/713ed0e5-5ddb-4f33-9178-4e5041546bbe-kube-api-access-6qk67\") pod \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\" (UID: \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\") "
Jul 30 10:04:54.458941 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.458710    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713ed0e5-5ddb-4f33-9178-4e5041546bbe-webhook-cert\") pod \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\" (UID: \"713ed0e5-5ddb-4f33-9178-4e5041546bbe\") "
Jul 30 10:04:54.460853 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.460808    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/713ed0e5-5ddb-4f33-9178-4e5041546bbe-kube-api-access-6qk67" (OuterVolumeSpecName: "kube-api-access-6qk67") pod "713ed0e5-5ddb-4f33-9178-4e5041546bbe" (UID: "713ed0e5-5ddb-4f33-9178-4e5041546bbe"). InnerVolumeSpecName "kube-api-access-6qk67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:04:54.460930 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.460852    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/713ed0e5-5ddb-4f33-9178-4e5041546bbe-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "713ed0e5-5ddb-4f33-9178-4e5041546bbe" (UID: "713ed0e5-5ddb-4f33-9178-4e5041546bbe"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:04:54.469121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.469022    2581 generic.go:356] "Generic (PLEG): container finished" podID="713ed0e5-5ddb-4f33-9178-4e5041546bbe" containerID="4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde" exitCode=0
Jul 30 10:04:54.469121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.469076    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-vx9g6"
Jul 30 10:04:54.469121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.469097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-vx9g6" event={"ID":"713ed0e5-5ddb-4f33-9178-4e5041546bbe","Type":"ContainerDied","Data":"4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde"}
Jul 30 10:04:54.469231 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.469143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-vx9g6" event={"ID":"713ed0e5-5ddb-4f33-9178-4e5041546bbe","Type":"ContainerDied","Data":"9d97c759c5d2648892cd9c1e468813d2af538ff8b6a44643cf8d1b4aad0f8f71"}
Jul 30 10:04:54.469231 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.469165    2581 scope.go:117] "RemoveContainer" containerID="4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde"
Jul 30 10:04:54.484754 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.484734    2581 scope.go:117] "RemoveContainer" containerID="4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde"
Jul 30 10:04:54.485100 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:04:54.485072    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde\": container with ID starting with 4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde not found: ID does not exist" containerID="4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde"
Jul 30 10:04:54.485169 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.485114    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde"} err="failed to get container status \"4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde\": rpc error: code = NotFound desc = could not find container \"4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde\": container with ID starting with 4c0fa274c730ac658b519f6a765a8b56e1680b1ab958f82bfeb153b2995a7fde not found: ID does not exist"
Jul 30 10:04:54.494423 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.494398    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vx9g6"]
Jul 30 10:04:54.497758 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.497733    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vx9g6"]
Jul 30 10:04:54.560143 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.560105    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qk67\" (UniqueName: \"kubernetes.io/projected/713ed0e5-5ddb-4f33-9178-4e5041546bbe-kube-api-access-6qk67\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:04:54.560143 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:54.560139    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713ed0e5-5ddb-4f33-9178-4e5041546bbe-webhook-cert\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:04:55.206456 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.206410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:04:55.332099 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.332065    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vbhqz"]
Jul 30 10:04:55.332470 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.332457    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="713ed0e5-5ddb-4f33-9178-4e5041546bbe" containerName="manager"
Jul 30 10:04:55.332515 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.332472    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="713ed0e5-5ddb-4f33-9178-4e5041546bbe" containerName="manager"
Jul 30 10:04:55.332550 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.332542    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="713ed0e5-5ddb-4f33-9178-4e5041546bbe" containerName="manager"
Jul 30 10:04:55.336932 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.336898    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:55.338783 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.338762    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 10:04:55.339319 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.339294    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 10:04:55.339446 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.339327    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pzbsj\""
Jul 30 10:04:55.342927 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.342906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vbhqz"]
Jul 30 10:04:55.469061 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.468964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxvh7\" (UniqueName: \"kubernetes.io/projected/89aac36b-c888-4941-83c9-9d956540051b-kube-api-access-lxvh7\") pod \"maas-controller-54646dcfcb-vbhqz\" (UID: \"89aac36b-c888-4941-83c9-9d956540051b\") " pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:55.469212 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.469076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89aac36b-c888-4941-83c9-9d956540051b-webhook-cert\") pod \"maas-controller-54646dcfcb-vbhqz\" (UID: \"89aac36b-c888-4941-83c9-9d956540051b\") " pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:55.570379 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.570337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89aac36b-c888-4941-83c9-9d956540051b-webhook-cert\") pod \"maas-controller-54646dcfcb-vbhqz\" (UID: \"89aac36b-c888-4941-83c9-9d956540051b\") " pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:55.570579 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.570436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxvh7\" (UniqueName: \"kubernetes.io/projected/89aac36b-c888-4941-83c9-9d956540051b-kube-api-access-lxvh7\") pod \"maas-controller-54646dcfcb-vbhqz\" (UID: \"89aac36b-c888-4941-83c9-9d956540051b\") " pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:55.572858 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.572805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89aac36b-c888-4941-83c9-9d956540051b-webhook-cert\") pod \"maas-controller-54646dcfcb-vbhqz\" (UID: \"89aac36b-c888-4941-83c9-9d956540051b\") " pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:55.580006 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.579966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxvh7\" (UniqueName: \"kubernetes.io/projected/89aac36b-c888-4941-83c9-9d956540051b-kube-api-access-lxvh7\") pod \"maas-controller-54646dcfcb-vbhqz\" (UID: \"89aac36b-c888-4941-83c9-9d956540051b\") " pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:55.648576 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.648543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:55.777887 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:55.777862    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-vbhqz"]
Jul 30 10:04:55.780332 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:04:55.780304    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89aac36b_c888_4941_83c9_9d956540051b.slice/crio-f57176aad75285b59d69a57afd87504f5dd8f5570acb061c17bb7b45fa08a99a WatchSource:0}: Error finding container f57176aad75285b59d69a57afd87504f5dd8f5570acb061c17bb7b45fa08a99a: Status 404 returned error can't find the container with id f57176aad75285b59d69a57afd87504f5dd8f5570acb061c17bb7b45fa08a99a
Jul 30 10:04:56.228400 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:56.228368    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="713ed0e5-5ddb-4f33-9178-4e5041546bbe" path="/var/lib/kubelet/pods/713ed0e5-5ddb-4f33-9178-4e5041546bbe/volumes"
Jul 30 10:04:56.482593 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:56.482501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-vbhqz" event={"ID":"89aac36b-c888-4941-83c9-9d956540051b","Type":"ContainerStarted","Data":"9bea234d80182326cf302fec74cb2238512a1c8d53e6ae64e722180282838731"}
Jul 30 10:04:56.482593 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:56.482553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-vbhqz" event={"ID":"89aac36b-c888-4941-83c9-9d956540051b","Type":"ContainerStarted","Data":"f57176aad75285b59d69a57afd87504f5dd8f5570acb061c17bb7b45fa08a99a"}
Jul 30 10:04:56.482801 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:56.482649    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:04:56.498921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:04:56.498877    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54646dcfcb-vbhqz" podStartSLOduration=1.111023376 podStartE2EDuration="1.498860114s" totalImagesPullingTime="387.836738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:04:56.496680911 +0000 UTC m=+914.840744367" watchObservedRunningTime="2026-07-30 10:04:56.498860114 +0000 UTC m=+914.842923570"
Jul 30 10:05:07.489133 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:05:07.489097    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54646dcfcb-vbhqz"
Jul 30 10:05:10.673765 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:05:10.673732    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:05:58.311353 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:05:58.311312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:00.101560 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:00.101524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:04.210673 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:04.210590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:04.275404 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:04.275356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:04.392540 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:04.392509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:04.516951 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:04.516806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:04.691157 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:04.691122    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:10.230751 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:10.230720    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:10.285028 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:10.284996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:46.611636 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:46.611597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:06:50.137111 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:06:50.137075    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:09:03.396615 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:09:03.396584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:09:42.191835 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:09:42.191790    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:09:42.195311 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:09:42.195290    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:12:18.545316 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:12:18.545239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:12:19.972696 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:12:19.972638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:12:51.929322 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:12:51.929288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:13:42.574465 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:13:42.574386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:13:53.666460 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:13:53.666422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:14:32.549462 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:14:32.549434    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:14:32.649508 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:14:32.649476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:14:42.219431 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:14:42.219399    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:14:42.223884 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:14:42.223859    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:15:00.158593 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:00.158557    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx"]
Jul 30 10:15:00.162309 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:00.162287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx"
Jul 30 10:15:00.164954 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:00.164930    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:15:00.177788 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:00.177762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx"
Jul 30 10:15:00.193008 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:00.192975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx"]
Jul 30 10:15:00.319299 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:00.319271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx"]
Jul 30 10:15:00.322648 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:15:00.322620    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700481e0_679d_44ce_a4c3_ac9d5970d530.slice/crio-ffdaebf92b8197791c9358505e2826bfe464696ac643876a115079a1860a2703 WatchSource:0}: Error finding container ffdaebf92b8197791c9358505e2826bfe464696ac643876a115079a1860a2703: Status 404 returned error can't find the container with id ffdaebf92b8197791c9358505e2826bfe464696ac643876a115079a1860a2703
Jul 30 10:15:00.324505 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:00.324487    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:15:01.203765 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:01.203730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx" event={"ID":"700481e0-679d-44ce-a4c3-ac9d5970d530","Type":"ContainerStarted","Data":"ffdaebf92b8197791c9358505e2826bfe464696ac643876a115079a1860a2703"}
Jul 30 10:15:04.218868 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:04.218833    2581 generic.go:356] "Generic (PLEG): container finished" podID="700481e0-679d-44ce-a4c3-ac9d5970d530" containerID="89970aa2fa94c7e8bf9e782244776565bd8d45bd63332e489ccc755195b9668d" exitCode=0
Jul 30 10:15:04.219248 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:04.218878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx" event={"ID":"700481e0-679d-44ce-a4c3-ac9d5970d530","Type":"ContainerDied","Data":"89970aa2fa94c7e8bf9e782244776565bd8d45bd63332e489ccc755195b9668d"}
Jul 30 10:15:05.356103 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:05.356074    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx"
Jul 30 10:15:06.230052 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:06.230009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx" event={"ID":"700481e0-679d-44ce-a4c3-ac9d5970d530","Type":"ContainerDied","Data":"ffdaebf92b8197791c9358505e2826bfe464696ac643876a115079a1860a2703"}
Jul 30 10:15:06.230219 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:06.230079    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffdaebf92b8197791c9358505e2826bfe464696ac643876a115079a1860a2703"
Jul 30 10:15:06.230219 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:06.230024    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756775-qb4jx"
Jul 30 10:15:27.603317 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:15:27.603280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:16:47.217010 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.216925    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"]
Jul 30 10:16:47.217578 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.217469    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="700481e0-679d-44ce-a4c3-ac9d5970d530" containerName="cleanup"
Jul 30 10:16:47.217578 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.217490    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="700481e0-679d-44ce-a4c3-ac9d5970d530" containerName="cleanup"
Jul 30 10:16:47.217578 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.217572    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="700481e0-679d-44ce-a4c3-ac9d5970d530" containerName="cleanup"
Jul 30 10:16:47.220593 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.220572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.222443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.222427    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-18824086-kserve-self-signed-certs\""
Jul 30 10:16:47.236542 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.236508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"]
Jul 30 10:16:47.255598 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.255565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:16:47.321754 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.321717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-tmp-dir\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.321754 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.321760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bec275-2ac7-47b5-9487-032e2bce0f95-tls-certs\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.321988 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.321871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-home\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.321988 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.321907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clxwk\" (UniqueName: \"kubernetes.io/projected/53bec275-2ac7-47b5-9487-032e2bce0f95-kube-api-access-clxwk\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.322107 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.322025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-dshm\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.322107 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.322063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-model-cache\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.422994 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.422951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bec275-2ac7-47b5-9487-032e2bce0f95-tls-certs\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.423173 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.423065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-home\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.423173 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.423107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxwk\" (UniqueName: \"kubernetes.io/projected/53bec275-2ac7-47b5-9487-032e2bce0f95-kube-api-access-clxwk\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.423266 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.423176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-dshm\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.423266 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.423200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-model-cache\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.423266 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.423226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-tmp-dir\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.423604 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.423578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-home\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.423738 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.423578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-model-cache\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.423738 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.423682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-tmp-dir\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.425365 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.425343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-dshm\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.425566 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.425544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bec275-2ac7-47b5-9487-032e2bce0f95-tls-certs\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.430715 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.430692    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clxwk\" (UniqueName: \"kubernetes.io/projected/53bec275-2ac7-47b5-9487-032e2bce0f95-kube-api-access-clxwk\") pod \"e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") " pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.530493 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.530385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:47.664685 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.664615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"]
Jul 30 10:16:47.667007 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:16:47.666958    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53bec275_2ac7_47b5_9487_032e2bce0f95.slice/crio-a818068dffce6a6667d310dd2babc3949881c5711b888d43d1da58df2cd9dcb3 WatchSource:0}: Error finding container a818068dffce6a6667d310dd2babc3949881c5711b888d43d1da58df2cd9dcb3: Status 404 returned error can't find the container with id a818068dffce6a6667d310dd2babc3949881c5711b888d43d1da58df2cd9dcb3
Jul 30 10:16:47.697117 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:47.697087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh" event={"ID":"53bec275-2ac7-47b5-9487-032e2bce0f95","Type":"ContainerStarted","Data":"a818068dffce6a6667d310dd2babc3949881c5711b888d43d1da58df2cd9dcb3"}
Jul 30 10:16:48.703717 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:48.703676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh" event={"ID":"53bec275-2ac7-47b5-9487-032e2bce0f95","Type":"ContainerStarted","Data":"edd7ff8a19b4606a534bc3d8aad9e0f7b6482fe9da37c27d85d0b75192d812e8"}
Jul 30 10:16:48.720128 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:48.720071    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh" podStartSLOduration=1.720053036 podStartE2EDuration="1.720053036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:16:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:16:48.718597689 +0000 UTC m=+1627.062661145" watchObservedRunningTime="2026-07-30 10:16:48.720053036 +0000 UTC m=+1627.064116491"
Jul 30 10:16:57.531121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:57.531025    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:57.531121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:57.531078    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:57.543872 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:57.543842    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:57.755427 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:57.755393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:16:59.233241 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:16:59.233206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:17:26.782264 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:26.782229    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"]
Jul 30 10:17:26.812656 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:26.812599    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:17:28.941875 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:28.941844    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:17:41.801445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:41.801407    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh" podUID="53bec275-2ac7-47b5-9487-032e2bce0f95" containerName="main" containerID="cri-o://edd7ff8a19b4606a534bc3d8aad9e0f7b6482fe9da37c27d85d0b75192d812e8" gracePeriod=45
Jul 30 10:17:41.950066 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:41.950033    2581 generic.go:356] "Generic (PLEG): container finished" podID="53bec275-2ac7-47b5-9487-032e2bce0f95" containerID="edd7ff8a19b4606a534bc3d8aad9e0f7b6482fe9da37c27d85d0b75192d812e8" exitCode=0
Jul 30 10:17:41.950237 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:41.950125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh" event={"ID":"53bec275-2ac7-47b5-9487-032e2bce0f95","Type":"ContainerDied","Data":"edd7ff8a19b4606a534bc3d8aad9e0f7b6482fe9da37c27d85d0b75192d812e8"}
Jul 30 10:17:42.043988 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.043962    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:17:42.206257 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206225    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clxwk\" (UniqueName: \"kubernetes.io/projected/53bec275-2ac7-47b5-9487-032e2bce0f95-kube-api-access-clxwk\") pod \"53bec275-2ac7-47b5-9487-032e2bce0f95\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") "
Jul 30 10:17:42.206445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-home\") pod \"53bec275-2ac7-47b5-9487-032e2bce0f95\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") "
Jul 30 10:17:42.206445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206338    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bec275-2ac7-47b5-9487-032e2bce0f95-tls-certs\") pod \"53bec275-2ac7-47b5-9487-032e2bce0f95\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") "
Jul 30 10:17:42.206445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206359    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-tmp-dir\") pod \"53bec275-2ac7-47b5-9487-032e2bce0f95\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") "
Jul 30 10:17:42.206445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-dshm\") pod \"53bec275-2ac7-47b5-9487-032e2bce0f95\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") "
Jul 30 10:17:42.206445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-model-cache\") pod \"53bec275-2ac7-47b5-9487-032e2bce0f95\" (UID: \"53bec275-2ac7-47b5-9487-032e2bce0f95\") "
Jul 30 10:17:42.206714 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206625    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "53bec275-2ac7-47b5-9487-032e2bce0f95" (UID: "53bec275-2ac7-47b5-9487-032e2bce0f95"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:17:42.206714 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206660    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-home" (OuterVolumeSpecName: "home") pod "53bec275-2ac7-47b5-9487-032e2bce0f95" (UID: "53bec275-2ac7-47b5-9487-032e2bce0f95"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:17:42.206806 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206715    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-tmp-dir\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:17:42.206878 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.206800    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-model-cache" (OuterVolumeSpecName: "model-cache") pod "53bec275-2ac7-47b5-9487-032e2bce0f95" (UID: "53bec275-2ac7-47b5-9487-032e2bce0f95"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:17:42.208580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.208555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-dshm" (OuterVolumeSpecName: "dshm") pod "53bec275-2ac7-47b5-9487-032e2bce0f95" (UID: "53bec275-2ac7-47b5-9487-032e2bce0f95"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:17:42.208580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.208567    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53bec275-2ac7-47b5-9487-032e2bce0f95-kube-api-access-clxwk" (OuterVolumeSpecName: "kube-api-access-clxwk") pod "53bec275-2ac7-47b5-9487-032e2bce0f95" (UID: "53bec275-2ac7-47b5-9487-032e2bce0f95"). InnerVolumeSpecName "kube-api-access-clxwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:17:42.208687 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.208585    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53bec275-2ac7-47b5-9487-032e2bce0f95-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "53bec275-2ac7-47b5-9487-032e2bce0f95" (UID: "53bec275-2ac7-47b5-9487-032e2bce0f95"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:17:42.308131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.308093    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-home\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:17:42.308131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.308120    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bec275-2ac7-47b5-9487-032e2bce0f95-tls-certs\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:17:42.308131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.308130    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-dshm\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:17:42.308131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.308138    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53bec275-2ac7-47b5-9487-032e2bce0f95-model-cache\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:17:42.308457 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.308148    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clxwk\" (UniqueName: \"kubernetes.io/projected/53bec275-2ac7-47b5-9487-032e2bce0f95-kube-api-access-clxwk\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:17:42.955327 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.955297    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"
Jul 30 10:17:42.955774 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.955335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh" event={"ID":"53bec275-2ac7-47b5-9487-032e2bce0f95","Type":"ContainerDied","Data":"a818068dffce6a6667d310dd2babc3949881c5711b888d43d1da58df2cd9dcb3"}
Jul 30 10:17:42.955774 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.955387    2581 scope.go:117] "RemoveContainer" containerID="edd7ff8a19b4606a534bc3d8aad9e0f7b6482fe9da37c27d85d0b75192d812e8"
Jul 30 10:17:42.969338 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.969315    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"]
Jul 30 10:17:42.973514 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:42.973493    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-18824086-kserve-6d4f5b9655-rztfh"]
Jul 30 10:17:44.227548 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:17:44.227510    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53bec275-2ac7-47b5-9487-032e2bce0f95" path="/var/lib/kubelet/pods/53bec275-2ac7-47b5-9487-032e2bce0f95/volumes"
Jul 30 10:19:38.095140 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:19:38.095061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:19:38.184727 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:19:38.184693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:19:42.248180 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:19:42.248154    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:19:42.253491 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:19:42.253469    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:21:30.493954 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:21:30.493908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:07.104417 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:07.104377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:10.295488 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:10.295452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:10.397751 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:10.397703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:10.775494 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:10.775461    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:11.331931 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:11.331894    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:16.725613 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:16.725579    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:16.879339 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:16.879297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:16.941543 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:16.941511    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:17.265270 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:17.265237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:17.380401 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:17.380363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:19.655793 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:19.655763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:19.755266 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:19.755231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:20.893629 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.893596    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"]
Jul 30 10:22:20.894064 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.894051    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53bec275-2ac7-47b5-9487-032e2bce0f95" containerName="main"
Jul 30 10:22:20.894142 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.894072    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53bec275-2ac7-47b5-9487-032e2bce0f95" containerName="main"
Jul 30 10:22:20.894224 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.894205    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53bec275-2ac7-47b5-9487-032e2bce0f95" containerName="main"
Jul 30 10:22:20.897288 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.897272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:20.899244 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.899225    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a3cc1f19-serving-cert\""
Jul 30 10:22:20.907724 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.907696    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"]
Jul 30 10:22:20.930842 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.930783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:20.985302 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.985265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54pgv\" (UniqueName: \"kubernetes.io/projected/0df335bd-e69e-4c82-93af-84c7445aed39-kube-api-access-54pgv\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:20.985494 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.985312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df335bd-e69e-4c82-93af-84c7445aed39-openshift-service-ca\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:20.985494 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:20.985344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0df335bd-e69e-4c82-93af-84c7445aed39-maas-api-tls\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:21.030583 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.030534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:21.086858 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.086800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df335bd-e69e-4c82-93af-84c7445aed39-openshift-service-ca\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:21.087028 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.086875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0df335bd-e69e-4c82-93af-84c7445aed39-maas-api-tls\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:21.087028 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.086944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54pgv\" (UniqueName: \"kubernetes.io/projected/0df335bd-e69e-4c82-93af-84c7445aed39-kube-api-access-54pgv\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:21.087514 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.087489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df335bd-e69e-4c82-93af-84c7445aed39-openshift-service-ca\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:21.089426 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.089402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0df335bd-e69e-4c82-93af-84c7445aed39-maas-api-tls\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:21.094337 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.094312    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54pgv\" (UniqueName: \"kubernetes.io/projected/0df335bd-e69e-4c82-93af-84c7445aed39-kube-api-access-54pgv\") pod \"maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:21.210794 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.210701    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:21.348051 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.347968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"]
Jul 30 10:22:21.350524 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:22:21.350494    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df335bd_e69e_4c82_93af_84c7445aed39.slice/crio-7972730f59e5401d1e90d51ad6fc31c40333a24175aef315f8b0c6b3630bfc05 WatchSource:0}: Error finding container 7972730f59e5401d1e90d51ad6fc31c40333a24175aef315f8b0c6b3630bfc05: Status 404 returned error can't find the container with id 7972730f59e5401d1e90d51ad6fc31c40333a24175aef315f8b0c6b3630bfc05
Jul 30 10:22:21.351840 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.351800    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:22:21.394151 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.394111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:21.546958 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:21.546875    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:22.243633 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:22.243540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts" event={"ID":"0df335bd-e69e-4c82-93af-84c7445aed39","Type":"ContainerStarted","Data":"cd4b199177383b927b96c6de73cd4403615e37521e3d04ea779292fa745b23a7"}
Jul 30 10:22:22.243633 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:22.243590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts" event={"ID":"0df335bd-e69e-4c82-93af-84c7445aed39","Type":"ContainerStarted","Data":"7972730f59e5401d1e90d51ad6fc31c40333a24175aef315f8b0c6b3630bfc05"}
Jul 30 10:22:22.243633 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:22.243611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:22.259613 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:22.259561    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts" podStartSLOduration=1.704440886 podStartE2EDuration="2.259544272s" totalImagesPullingTime="555.103386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:22.2584419 +0000 UTC m=+1960.602505358" watchObservedRunningTime="2026-07-30 10:22:22.259544272 +0000 UTC m=+1960.603607767"
Jul 30 10:22:28.254828 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:28.254797    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:45.392864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.392758    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"]
Jul 30 10:22:45.396305 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.396284    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"
Jul 30 10:22:45.398261 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.398239    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:22:45.402123 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.402099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"]
Jul 30 10:22:45.507990 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.507947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/490a510d-d301-42e2-a8f3-ad0ce9f003b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp\" (UID: \"490a510d-d301-42e2-a8f3-ad0ce9f003b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"
Jul 30 10:22:45.609360 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.609323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/490a510d-d301-42e2-a8f3-ad0ce9f003b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp\" (UID: \"490a510d-d301-42e2-a8f3-ad0ce9f003b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"
Jul 30 10:22:45.610012 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.609990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/490a510d-d301-42e2-a8f3-ad0ce9f003b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp\" (UID: \"490a510d-d301-42e2-a8f3-ad0ce9f003b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"
Jul 30 10:22:45.708648 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.708556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"
Jul 30 10:22:45.844366 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:45.844341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"]
Jul 30 10:22:45.846453 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:22:45.846420    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490a510d_d301_42e2_a8f3_ad0ce9f003b5.slice/crio-280d5909aefcce5e297c49aaa04c37feae946b38e5b56ec7fa296896030da9a9 WatchSource:0}: Error finding container 280d5909aefcce5e297c49aaa04c37feae946b38e5b56ec7fa296896030da9a9: Status 404 returned error can't find the container with id 280d5909aefcce5e297c49aaa04c37feae946b38e5b56ec7fa296896030da9a9
Jul 30 10:22:46.362365 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:46.362319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp" event={"ID":"490a510d-d301-42e2-a8f3-ad0ce9f003b5","Type":"ContainerStarted","Data":"577ed59081cabe53f89274886b7f402d266dee323eb2b31a34d60212c0c2d086"}
Jul 30 10:22:46.362577 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:46.362373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp" event={"ID":"490a510d-d301-42e2-a8f3-ad0ce9f003b5","Type":"ContainerStarted","Data":"280d5909aefcce5e297c49aaa04c37feae946b38e5b56ec7fa296896030da9a9"}
Jul 30 10:22:46.376240 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:46.376187    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp" podStartSLOduration=1.37617049 podStartE2EDuration="1.37617049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:46.375060696 +0000 UTC m=+1984.719124156" watchObservedRunningTime="2026-07-30 10:22:46.37617049 +0000 UTC m=+1984.720233937"
Jul 30 10:22:47.368505 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:47.368471    2581 generic.go:356] "Generic (PLEG): container finished" podID="490a510d-d301-42e2-a8f3-ad0ce9f003b5" containerID="577ed59081cabe53f89274886b7f402d266dee323eb2b31a34d60212c0c2d086" exitCode=0
Jul 30 10:22:47.368974 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:47.368540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp" event={"ID":"490a510d-d301-42e2-a8f3-ad0ce9f003b5","Type":"ContainerDied","Data":"577ed59081cabe53f89274886b7f402d266dee323eb2b31a34d60212c0c2d086"}
Jul 30 10:22:48.504563 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:48.504534    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"
Jul 30 10:22:48.534211 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:48.534174    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/490a510d-d301-42e2-a8f3-ad0ce9f003b5-maas-api-service-ca\") pod \"490a510d-d301-42e2-a8f3-ad0ce9f003b5\" (UID: \"490a510d-d301-42e2-a8f3-ad0ce9f003b5\") "
Jul 30 10:22:48.534559 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:48.534533    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490a510d-d301-42e2-a8f3-ad0ce9f003b5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "490a510d-d301-42e2-a8f3-ad0ce9f003b5" (UID: "490a510d-d301-42e2-a8f3-ad0ce9f003b5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:22:48.635300 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:48.635210    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/490a510d-d301-42e2-a8f3-ad0ce9f003b5-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:22:49.379057 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:49.379017    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"
Jul 30 10:22:49.379057 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:49.379029    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp" event={"ID":"490a510d-d301-42e2-a8f3-ad0ce9f003b5","Type":"ContainerDied","Data":"280d5909aefcce5e297c49aaa04c37feae946b38e5b56ec7fa296896030da9a9"}
Jul 30 10:22:49.379257 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:49.379086    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="280d5909aefcce5e297c49aaa04c37feae946b38e5b56ec7fa296896030da9a9"
Jul 30 10:22:51.241150 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.241118    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"]
Jul 30 10:22:51.241756 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.241394    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts" podUID="0df335bd-e69e-4c82-93af-84c7445aed39" containerName="maas-api" containerID="cri-o://cd4b199177383b927b96c6de73cd4403615e37521e3d04ea779292fa745b23a7" gracePeriod=30
Jul 30 10:22:51.270765 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.270739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:51.393636 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.393599    2581 generic.go:356] "Generic (PLEG): container finished" podID="0df335bd-e69e-4c82-93af-84c7445aed39" containerID="cd4b199177383b927b96c6de73cd4403615e37521e3d04ea779292fa745b23a7" exitCode=0
Jul 30 10:22:51.393793 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.393671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts" event={"ID":"0df335bd-e69e-4c82-93af-84c7445aed39","Type":"ContainerDied","Data":"cd4b199177383b927b96c6de73cd4403615e37521e3d04ea779292fa745b23a7"}
Jul 30 10:22:51.419519 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.419490    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"]
Jul 30 10:22:51.421171 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.421147    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3cc1f19-4bclp"]
Jul 30 10:22:51.492765 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.492706    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:51.563546 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.563497    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df335bd-e69e-4c82-93af-84c7445aed39-openshift-service-ca\") pod \"0df335bd-e69e-4c82-93af-84c7445aed39\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") "
Jul 30 10:22:51.563978 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.563584    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54pgv\" (UniqueName: \"kubernetes.io/projected/0df335bd-e69e-4c82-93af-84c7445aed39-kube-api-access-54pgv\") pod \"0df335bd-e69e-4c82-93af-84c7445aed39\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") "
Jul 30 10:22:51.563978 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.563614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0df335bd-e69e-4c82-93af-84c7445aed39-maas-api-tls\") pod \"0df335bd-e69e-4c82-93af-84c7445aed39\" (UID: \"0df335bd-e69e-4c82-93af-84c7445aed39\") "
Jul 30 10:22:51.564625 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.564445    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0df335bd-e69e-4c82-93af-84c7445aed39-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0df335bd-e69e-4c82-93af-84c7445aed39" (UID: "0df335bd-e69e-4c82-93af-84c7445aed39"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:22:51.567788 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.567760    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df335bd-e69e-4c82-93af-84c7445aed39-kube-api-access-54pgv" (OuterVolumeSpecName: "kube-api-access-54pgv") pod "0df335bd-e69e-4c82-93af-84c7445aed39" (UID: "0df335bd-e69e-4c82-93af-84c7445aed39"). InnerVolumeSpecName "kube-api-access-54pgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:22:51.567929 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.567864    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df335bd-e69e-4c82-93af-84c7445aed39-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0df335bd-e69e-4c82-93af-84c7445aed39" (UID: "0df335bd-e69e-4c82-93af-84c7445aed39"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:22:51.664394 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.664361    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54pgv\" (UniqueName: \"kubernetes.io/projected/0df335bd-e69e-4c82-93af-84c7445aed39-kube-api-access-54pgv\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:22:51.664394 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.664392    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0df335bd-e69e-4c82-93af-84c7445aed39-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:22:51.664589 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:51.664407    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df335bd-e69e-4c82-93af-84c7445aed39-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:22:52.227863 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:52.227802    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490a510d-d301-42e2-a8f3-ad0ce9f003b5" path="/var/lib/kubelet/pods/490a510d-d301-42e2-a8f3-ad0ce9f003b5/volumes"
Jul 30 10:22:52.399586 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:52.399554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts" event={"ID":"0df335bd-e69e-4c82-93af-84c7445aed39","Type":"ContainerDied","Data":"7972730f59e5401d1e90d51ad6fc31c40333a24175aef315f8b0c6b3630bfc05"}
Jul 30 10:22:52.400035 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:52.399592    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"
Jul 30 10:22:52.400035 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:52.399617    2581 scope.go:117] "RemoveContainer" containerID="cd4b199177383b927b96c6de73cd4403615e37521e3d04ea779292fa745b23a7"
Jul 30 10:22:52.414721 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:52.414675    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"]
Jul 30 10:22:52.416319 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:52.416295    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a3cc1f19-874b48cdf-dsdts"]
Jul 30 10:22:54.227648 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:54.227604    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df335bd-e69e-4c82-93af-84c7445aed39" path="/var/lib/kubelet/pods/0df335bd-e69e-4c82-93af-84c7445aed39/volumes"
Jul 30 10:22:55.209624 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.209592    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"]
Jul 30 10:22:55.210103 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.210084    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490a510d-d301-42e2-a8f3-ad0ce9f003b5" containerName="revoke-keys"
Jul 30 10:22:55.210232 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.210104    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="490a510d-d301-42e2-a8f3-ad0ce9f003b5" containerName="revoke-keys"
Jul 30 10:22:55.210232 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.210127    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df335bd-e69e-4c82-93af-84c7445aed39" containerName="maas-api"
Jul 30 10:22:55.210232 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.210135    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df335bd-e69e-4c82-93af-84c7445aed39" containerName="maas-api"
Jul 30 10:22:55.210406 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.210302    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="490a510d-d301-42e2-a8f3-ad0ce9f003b5" containerName="revoke-keys"
Jul 30 10:22:55.210406 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.210315    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df335bd-e69e-4c82-93af-84c7445aed39" containerName="maas-api"
Jul 30 10:22:55.214994 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.214974    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.216982 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.216958    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-4daf5ef5-serving-cert\""
Jul 30 10:22:55.222852 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.222559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"]
Jul 30 10:22:55.299701 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.299657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e7e564-22db-479f-b1e1-8df98e843010-openshift-service-ca\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.300148 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.299781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlb2j\" (UniqueName: \"kubernetes.io/projected/a7e7e564-22db-479f-b1e1-8df98e843010-kube-api-access-mlb2j\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.300148 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.299842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.400752 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.400705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlb2j\" (UniqueName: \"kubernetes.io/projected/a7e7e564-22db-479f-b1e1-8df98e843010-kube-api-access-mlb2j\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.400990 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.400758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.400990 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.400857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e7e564-22db-479f-b1e1-8df98e843010-openshift-service-ca\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.400990 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:22:55.400926    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-serving-cert: secret "maas-api-e2e-migrate-4daf5ef5-serving-cert" not found
Jul 30 10:22:55.401178 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:22:55.401012    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls podName:a7e7e564-22db-479f-b1e1-8df98e843010 nodeName:}" failed. No retries permitted until 2026-07-30 10:22:55.900987896 +0000 UTC m=+1994.245051333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls") pod "maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq" (UID: "a7e7e564-22db-479f-b1e1-8df98e843010") : secret "maas-api-e2e-migrate-4daf5ef5-serving-cert" not found
Jul 30 10:22:55.401537 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.401513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e7e564-22db-479f-b1e1-8df98e843010-openshift-service-ca\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.408273 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.408249    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlb2j\" (UniqueName: \"kubernetes.io/projected/a7e7e564-22db-479f-b1e1-8df98e843010-kube-api-access-mlb2j\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.819342 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.819309    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"]
Jul 30 10:22:55.823250 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.823225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:22:55.825437 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.825413    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-4daf5ef5-dockercfg-d67gc\""
Jul 30 10:22:55.825568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.825465    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-4daf5ef5\""
Jul 30 10:22:55.832371 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.832340    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"]
Jul 30 10:22:55.906524 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.906478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:55.906703 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.906541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45jtx\" (UniqueName: \"kubernetes.io/projected/9aa57409-b0a0-487f-ab81-77c268f43a41-kube-api-access-45jtx\") pod \"payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9\" (UID: \"9aa57409-b0a0-487f-ab81-77c268f43a41\") " pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:22:55.906703 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.906630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aa57409-b0a0-487f-ab81-77c268f43a41-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9\" (UID: \"9aa57409-b0a0-487f-ab81-77c268f43a41\") " pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:22:55.908966 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:55.908942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls\") pod \"maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:56.007267 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.007227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aa57409-b0a0-487f-ab81-77c268f43a41-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9\" (UID: \"9aa57409-b0a0-487f-ab81-77c268f43a41\") " pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:22:56.007524 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.007339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45jtx\" (UniqueName: \"kubernetes.io/projected/9aa57409-b0a0-487f-ab81-77c268f43a41-kube-api-access-45jtx\") pod \"payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9\" (UID: \"9aa57409-b0a0-487f-ab81-77c268f43a41\") " pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:22:56.008193 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.008167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aa57409-b0a0-487f-ab81-77c268f43a41-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9\" (UID: \"9aa57409-b0a0-487f-ab81-77c268f43a41\") " pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:22:56.015937 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.015903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45jtx\" (UniqueName: \"kubernetes.io/projected/9aa57409-b0a0-487f-ab81-77c268f43a41-kube-api-access-45jtx\") pod \"payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9\" (UID: \"9aa57409-b0a0-487f-ab81-77c268f43a41\") " pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:22:56.127432 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.127342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:56.137212 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.137188    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:22:56.280692 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.280663    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"]
Jul 30 10:22:56.282632 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:22:56.282592    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e7e564_22db_479f_b1e1_8df98e843010.slice/crio-b32a4ec22229c076a0b1effdb6cd4bbcb11fe71fdd70c9f065763e32e06acab2 WatchSource:0}: Error finding container b32a4ec22229c076a0b1effdb6cd4bbcb11fe71fdd70c9f065763e32e06acab2: Status 404 returned error can't find the container with id b32a4ec22229c076a0b1effdb6cd4bbcb11fe71fdd70c9f065763e32e06acab2
Jul 30 10:22:56.296028 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.296000    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"]
Jul 30 10:22:56.297773 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:22:56.297750    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa57409_b0a0_487f_ab81_77c268f43a41.slice/crio-2370a020f222f71c40463fcbadf86bd5b6ba155b393a013137b052088540bce0 WatchSource:0}: Error finding container 2370a020f222f71c40463fcbadf86bd5b6ba155b393a013137b052088540bce0: Status 404 returned error can't find the container with id 2370a020f222f71c40463fcbadf86bd5b6ba155b393a013137b052088540bce0
Jul 30 10:22:56.423434 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.423349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9" event={"ID":"9aa57409-b0a0-487f-ab81-77c268f43a41","Type":"ContainerStarted","Data":"2370a020f222f71c40463fcbadf86bd5b6ba155b393a013137b052088540bce0"}
Jul 30 10:22:56.424517 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:56.424487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq" event={"ID":"a7e7e564-22db-479f-b1e1-8df98e843010","Type":"ContainerStarted","Data":"b32a4ec22229c076a0b1effdb6cd4bbcb11fe71fdd70c9f065763e32e06acab2"}
Jul 30 10:22:57.842515 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:57.842471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:22:58.437623 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:58.437587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq" event={"ID":"a7e7e564-22db-479f-b1e1-8df98e843010","Type":"ContainerStarted","Data":"a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6"}
Jul 30 10:22:58.437858 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:58.437728    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:22:58.454536 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:58.454487    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq" podStartSLOduration=2.094402994 podStartE2EDuration="3.454469011s" totalImagesPullingTime="1.360066017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:58.452899577 +0000 UTC m=+1996.796963035" watchObservedRunningTime="2026-07-30 10:22:58.454469011 +0000 UTC m=+1996.798532467"
Jul 30 10:22:59.451085 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:59.451042    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9" event={"ID":"9aa57409-b0a0-487f-ab81-77c268f43a41","Type":"ContainerStarted","Data":"aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301"}
Jul 30 10:22:59.467632 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:22:59.467571    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9" podStartSLOduration=1.923365232 podStartE2EDuration="4.467551958s" totalImagesPullingTime="2.544186726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:59.466719751 +0000 UTC m=+1997.810783209" watchObservedRunningTime="2026-07-30 10:22:59.467551958 +0000 UTC m=+1997.811615414"
Jul 30 10:23:00.456946 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:00.456910    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:23:04.456783 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:04.456749    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:23:11.463834 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:11.463794    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:23:20.082967 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.082929    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"]
Jul 30 10:23:20.086638 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.086618    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"
Jul 30 10:23:20.089598 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.089570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:23:20.091664 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.091637    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"]
Jul 30 10:23:20.127488 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.127450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c3832-7cc1-4af2-b8cf-6308253511e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945\" (UID: \"064c3832-7cc1-4af2-b8cf-6308253511e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"
Jul 30 10:23:20.228591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.228559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c3832-7cc1-4af2-b8cf-6308253511e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945\" (UID: \"064c3832-7cc1-4af2-b8cf-6308253511e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"
Jul 30 10:23:20.229202 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.229181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c3832-7cc1-4af2-b8cf-6308253511e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945\" (UID: \"064c3832-7cc1-4af2-b8cf-6308253511e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"
Jul 30 10:23:20.398366 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.398279    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"
Jul 30 10:23:20.532681 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.532654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"]
Jul 30 10:23:20.534745 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:23:20.534716    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064c3832_7cc1_4af2_b8cf_6308253511e6.slice/crio-0c421204a955357caba698ac155bef35f7fee38559fc31429387e84d97d78656 WatchSource:0}: Error finding container 0c421204a955357caba698ac155bef35f7fee38559fc31429387e84d97d78656: Status 404 returned error can't find the container with id 0c421204a955357caba698ac155bef35f7fee38559fc31429387e84d97d78656
Jul 30 10:23:20.553220 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:20.553192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945" event={"ID":"064c3832-7cc1-4af2-b8cf-6308253511e6","Type":"ContainerStarted","Data":"0c421204a955357caba698ac155bef35f7fee38559fc31429387e84d97d78656"}
Jul 30 10:23:21.560429 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:21.560393    2581 generic.go:356] "Generic (PLEG): container finished" podID="064c3832-7cc1-4af2-b8cf-6308253511e6" containerID="65d71aba9459626dedc42c1e0eff7a7e2506e1a3ee100813fe9b8b2e1102eb6c" exitCode=0
Jul 30 10:23:21.560853 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:21.560488    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945" event={"ID":"064c3832-7cc1-4af2-b8cf-6308253511e6","Type":"ContainerDied","Data":"65d71aba9459626dedc42c1e0eff7a7e2506e1a3ee100813fe9b8b2e1102eb6c"}
Jul 30 10:23:22.699095 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:22.699071    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"
Jul 30 10:23:22.750055 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:22.750018    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c3832-7cc1-4af2-b8cf-6308253511e6-maas-api-service-ca\") pod \"064c3832-7cc1-4af2-b8cf-6308253511e6\" (UID: \"064c3832-7cc1-4af2-b8cf-6308253511e6\") "
Jul 30 10:23:22.750366 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:22.750344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064c3832-7cc1-4af2-b8cf-6308253511e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "064c3832-7cc1-4af2-b8cf-6308253511e6" (UID: "064c3832-7cc1-4af2-b8cf-6308253511e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:23:22.851176 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:22.851091    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/064c3832-7cc1-4af2-b8cf-6308253511e6-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:23:23.570804 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:23.570775    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"
Jul 30 10:23:23.570804 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:23.570792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945" event={"ID":"064c3832-7cc1-4af2-b8cf-6308253511e6","Type":"ContainerDied","Data":"0c421204a955357caba698ac155bef35f7fee38559fc31429387e84d97d78656"}
Jul 30 10:23:23.571032 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:23.570855    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c421204a955357caba698ac155bef35f7fee38559fc31429387e84d97d78656"
Jul 30 10:23:25.674595 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.674560    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"]
Jul 30 10:23:25.675094 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.674798    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq" podUID="a7e7e564-22db-479f-b1e1-8df98e843010" containerName="maas-api" containerID="cri-o://a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6" gracePeriod=30
Jul 30 10:23:25.729246 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.729213    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"]
Jul 30 10:23:25.729495 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.729468    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9" podUID="9aa57409-b0a0-487f-ab81-77c268f43a41" containerName="payload-processing" containerID="cri-o://aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301" gracePeriod=30
Jul 30 10:23:25.755007 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.754841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:25.811256 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.811220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:25.859122 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.859089    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"]
Jul 30 10:23:25.869340 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.869304    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4daf5ef5-dt945"]
Jul 30 10:23:25.909436 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.909393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:25.972462 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:25.972439    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:23:26.004959 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.004935    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:23:26.081518 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.081481    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlb2j\" (UniqueName: \"kubernetes.io/projected/a7e7e564-22db-479f-b1e1-8df98e843010-kube-api-access-mlb2j\") pod \"a7e7e564-22db-479f-b1e1-8df98e843010\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") "
Jul 30 10:23:26.081518 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.081523    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e7e564-22db-479f-b1e1-8df98e843010-openshift-service-ca\") pod \"a7e7e564-22db-479f-b1e1-8df98e843010\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") "
Jul 30 10:23:26.081773 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.081546    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls\") pod \"a7e7e564-22db-479f-b1e1-8df98e843010\" (UID: \"a7e7e564-22db-479f-b1e1-8df98e843010\") "
Jul 30 10:23:26.081773 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.081563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aa57409-b0a0-487f-ab81-77c268f43a41-plugins-config-volume\") pod \"9aa57409-b0a0-487f-ab81-77c268f43a41\" (UID: \"9aa57409-b0a0-487f-ab81-77c268f43a41\") "
Jul 30 10:23:26.081773 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.081632    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45jtx\" (UniqueName: \"kubernetes.io/projected/9aa57409-b0a0-487f-ab81-77c268f43a41-kube-api-access-45jtx\") pod \"9aa57409-b0a0-487f-ab81-77c268f43a41\" (UID: \"9aa57409-b0a0-487f-ab81-77c268f43a41\") "
Jul 30 10:23:26.082034 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.081994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa57409-b0a0-487f-ab81-77c268f43a41-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9aa57409-b0a0-487f-ab81-77c268f43a41" (UID: "9aa57409-b0a0-487f-ab81-77c268f43a41"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:23:26.082155 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.082117    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7e7e564-22db-479f-b1e1-8df98e843010-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7e7e564-22db-479f-b1e1-8df98e843010" (UID: "a7e7e564-22db-479f-b1e1-8df98e843010"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:23:26.083810 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.083786    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7e7e564-22db-479f-b1e1-8df98e843010" (UID: "a7e7e564-22db-479f-b1e1-8df98e843010"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:23:26.083810 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.083792    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e7e564-22db-479f-b1e1-8df98e843010-kube-api-access-mlb2j" (OuterVolumeSpecName: "kube-api-access-mlb2j") pod "a7e7e564-22db-479f-b1e1-8df98e843010" (UID: "a7e7e564-22db-479f-b1e1-8df98e843010"). InnerVolumeSpecName "kube-api-access-mlb2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:23:26.083958 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.083882    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa57409-b0a0-487f-ab81-77c268f43a41-kube-api-access-45jtx" (OuterVolumeSpecName: "kube-api-access-45jtx") pod "9aa57409-b0a0-487f-ab81-77c268f43a41" (UID: "9aa57409-b0a0-487f-ab81-77c268f43a41"). InnerVolumeSpecName "kube-api-access-45jtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:23:26.133318 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.133284    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:26.182626 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.182548    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlb2j\" (UniqueName: \"kubernetes.io/projected/a7e7e564-22db-479f-b1e1-8df98e843010-kube-api-access-mlb2j\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:23:26.182626 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.182576    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e7e564-22db-479f-b1e1-8df98e843010-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:23:26.182626 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.182586    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e7e564-22db-479f-b1e1-8df98e843010-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:23:26.182626 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.182596    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aa57409-b0a0-487f-ab81-77c268f43a41-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:23:26.182626 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.182606    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45jtx\" (UniqueName: \"kubernetes.io/projected/9aa57409-b0a0-487f-ab81-77c268f43a41-kube-api-access-45jtx\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:23:26.228038 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.228005    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="064c3832-7cc1-4af2-b8cf-6308253511e6" path="/var/lib/kubelet/pods/064c3832-7cc1-4af2-b8cf-6308253511e6/volumes"
Jul 30 10:23:26.278722 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.278680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:26.514735 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.514647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:26.585015 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.584979    2581 generic.go:356] "Generic (PLEG): container finished" podID="9aa57409-b0a0-487f-ab81-77c268f43a41" containerID="aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301" exitCode=0
Jul 30 10:23:26.585199 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.585025    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"
Jul 30 10:23:26.585199 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.585065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9" event={"ID":"9aa57409-b0a0-487f-ab81-77c268f43a41","Type":"ContainerDied","Data":"aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301"}
Jul 30 10:23:26.585199 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.585123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9" event={"ID":"9aa57409-b0a0-487f-ab81-77c268f43a41","Type":"ContainerDied","Data":"2370a020f222f71c40463fcbadf86bd5b6ba155b393a013137b052088540bce0"}
Jul 30 10:23:26.585199 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.585162    2581 scope.go:117] "RemoveContainer" containerID="aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301"
Jul 30 10:23:26.586797 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.586773    2581 generic.go:356] "Generic (PLEG): container finished" podID="a7e7e564-22db-479f-b1e1-8df98e843010" containerID="a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6" exitCode=0
Jul 30 10:23:26.586951 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.586846    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"
Jul 30 10:23:26.586951 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.586853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq" event={"ID":"a7e7e564-22db-479f-b1e1-8df98e843010","Type":"ContainerDied","Data":"a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6"}
Jul 30 10:23:26.586951 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.586903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq" event={"ID":"a7e7e564-22db-479f-b1e1-8df98e843010","Type":"ContainerDied","Data":"b32a4ec22229c076a0b1effdb6cd4bbcb11fe71fdd70c9f065763e32e06acab2"}
Jul 30 10:23:26.594256 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.594225    2581 scope.go:117] "RemoveContainer" containerID="aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301"
Jul 30 10:23:26.594508 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:23:26.594490    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301\": container with ID starting with aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301 not found: ID does not exist" containerID="aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301"
Jul 30 10:23:26.594593 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.594521    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301"} err="failed to get container status \"aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301\": rpc error: code = NotFound desc = could not find container \"aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301\": container with ID starting with aa2c83a7b6a2bfa5ca9abf4345f556539294ba4884bbfd9ba1c0924cc6f34301 not found: ID does not exist"
Jul 30 10:23:26.594593 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.594545    2581 scope.go:117] "RemoveContainer" containerID="a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6"
Jul 30 10:23:26.603081 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.602960    2581 scope.go:117] "RemoveContainer" containerID="a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6"
Jul 30 10:23:26.603413 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:23:26.603321    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6\": container with ID starting with a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6 not found: ID does not exist" containerID="a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6"
Jul 30 10:23:26.603413 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.603357    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6"} err="failed to get container status \"a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6\": rpc error: code = NotFound desc = could not find container \"a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6\": container with ID starting with a3096e385fbf054561c8a349d4a8bdb8dfc4bd12c1fed6f1e4d3b26d3096cab6 not found: ID does not exist"
Jul 30 10:23:26.604586 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.604566    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"]
Jul 30 10:23:26.608035 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.608014    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4daf5ef5-655f48dbb5-x5npq"]
Jul 30 10:23:26.618698 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.618677    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"]
Jul 30 10:23:26.624149 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.624128    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9"]
Jul 30 10:23:26.853918 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:26.853879    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:27.233368 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:27.233335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:28.227201 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:28.227160    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aa57409-b0a0-487f-ab81-77c268f43a41" path="/var/lib/kubelet/pods/9aa57409-b0a0-487f-ab81-77c268f43a41/volumes"
Jul 30 10:23:28.227733 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:28.227713    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e7e564-22db-479f-b1e1-8df98e843010" path="/var/lib/kubelet/pods/a7e7e564-22db-479f-b1e1-8df98e843010/volumes"
Jul 30 10:23:29.103148 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:29.103113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:30.199075 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199032    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"]
Jul 30 10:23:30.199645 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199625    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aa57409-b0a0-487f-ab81-77c268f43a41" containerName="payload-processing"
Jul 30 10:23:30.199729 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199647    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa57409-b0a0-487f-ab81-77c268f43a41" containerName="payload-processing"
Jul 30 10:23:30.199729 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199686    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e7e564-22db-479f-b1e1-8df98e843010" containerName="maas-api"
Jul 30 10:23:30.199729 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199697    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e7e564-22db-479f-b1e1-8df98e843010" containerName="maas-api"
Jul 30 10:23:30.199729 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199707    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064c3832-7cc1-4af2-b8cf-6308253511e6" containerName="revoke-keys"
Jul 30 10:23:30.199729 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199716    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="064c3832-7cc1-4af2-b8cf-6308253511e6" containerName="revoke-keys"
Jul 30 10:23:30.200000 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199794    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e7e564-22db-479f-b1e1-8df98e843010" containerName="maas-api"
Jul 30 10:23:30.200000 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199811    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="064c3832-7cc1-4af2-b8cf-6308253511e6" containerName="revoke-keys"
Jul 30 10:23:30.200000 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.199838    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aa57409-b0a0-487f-ab81-77c268f43a41" containerName="payload-processing"
Jul 30 10:23:30.204724 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.204702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.206516 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.206491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-237c0540-serving-cert\""
Jul 30 10:23:30.215861 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.215837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"]
Jul 30 10:23:30.318294 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.318262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6083b596-031a-4d10-95d2-95a55774bd6c-maas-api-tls\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.318480 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.318305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swmbt\" (UniqueName: \"kubernetes.io/projected/6083b596-031a-4d10-95d2-95a55774bd6c-kube-api-access-swmbt\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.318480 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.318337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6083b596-031a-4d10-95d2-95a55774bd6c-openshift-service-ca\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.384918 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.384882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:30.419165 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.419127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6083b596-031a-4d10-95d2-95a55774bd6c-maas-api-tls\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.419316 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.419174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swmbt\" (UniqueName: \"kubernetes.io/projected/6083b596-031a-4d10-95d2-95a55774bd6c-kube-api-access-swmbt\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.419316 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.419203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6083b596-031a-4d10-95d2-95a55774bd6c-openshift-service-ca\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.419838 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.419796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6083b596-031a-4d10-95d2-95a55774bd6c-openshift-service-ca\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.421592 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.421573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6083b596-031a-4d10-95d2-95a55774bd6c-maas-api-tls\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.427301 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.427277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swmbt\" (UniqueName: \"kubernetes.io/projected/6083b596-031a-4d10-95d2-95a55774bd6c-kube-api-access-swmbt\") pod \"maas-api-e2e-ait-237c0540-5c756d9656-gx76t\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.488059 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.487968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:30.516433 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.516404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:30.682211 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.682184    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"]
Jul 30 10:23:30.684399 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:23:30.684343    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6083b596_031a_4d10_95d2_95a55774bd6c.slice/crio-219073a0ab9b097679dd2b717aea66d1c331c67b0fbdc13b32c6b6dc83e70999 WatchSource:0}: Error finding container 219073a0ab9b097679dd2b717aea66d1c331c67b0fbdc13b32c6b6dc83e70999: Status 404 returned error can't find the container with id 219073a0ab9b097679dd2b717aea66d1c331c67b0fbdc13b32c6b6dc83e70999
Jul 30 10:23:30.730936 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.730888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:30.826050 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.826011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:23:30.829629 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.829605    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"]
Jul 30 10:23:30.834241 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.834218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:30.836415 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.836390    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-237c0540\""
Jul 30 10:23:30.836541 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.836417    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-237c0540-dockercfg-lfqfs\""
Jul 30 10:23:30.850071 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.850044    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"]
Jul 30 10:23:30.857213 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.857189    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"]
Jul 30 10:23:30.860794 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.860771    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:30.869036 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.869009    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"]
Jul 30 10:23:30.924016 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.923976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jsbq\" (UniqueName: \"kubernetes.io/projected/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-kube-api-access-7jsbq\") pod \"payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx\" (UID: \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:30.924191 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.924066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx\" (UID: \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:30.924191 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.924103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40da9145-390c-4165-ad7f-118106bbb18e-plugins-config-volume\") pod \"payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj\" (UID: \"40da9145-390c-4165-ad7f-118106bbb18e\") " pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:30.924191 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:30.924134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsbpj\" (UniqueName: \"kubernetes.io/projected/40da9145-390c-4165-ad7f-118106bbb18e-kube-api-access-wsbpj\") pod \"payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj\" (UID: \"40da9145-390c-4165-ad7f-118106bbb18e\") " pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:31.025361 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.025323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jsbq\" (UniqueName: \"kubernetes.io/projected/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-kube-api-access-7jsbq\") pod \"payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx\" (UID: \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:31.025563 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.025380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx\" (UID: \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:31.025563 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.025409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40da9145-390c-4165-ad7f-118106bbb18e-plugins-config-volume\") pod \"payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj\" (UID: \"40da9145-390c-4165-ad7f-118106bbb18e\") " pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:31.025563 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.025448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsbpj\" (UniqueName: \"kubernetes.io/projected/40da9145-390c-4165-ad7f-118106bbb18e-kube-api-access-wsbpj\") pod \"payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj\" (UID: \"40da9145-390c-4165-ad7f-118106bbb18e\") " pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:31.026093 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.026073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx\" (UID: \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:31.026132 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.026119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40da9145-390c-4165-ad7f-118106bbb18e-plugins-config-volume\") pod \"payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj\" (UID: \"40da9145-390c-4165-ad7f-118106bbb18e\") " pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:31.032897 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.032873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jsbq\" (UniqueName: \"kubernetes.io/projected/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-kube-api-access-7jsbq\") pod \"payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx\" (UID: \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:31.033000 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.032927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsbpj\" (UniqueName: \"kubernetes.io/projected/40da9145-390c-4165-ad7f-118106bbb18e-kube-api-access-wsbpj\") pod \"payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj\" (UID: \"40da9145-390c-4165-ad7f-118106bbb18e\") " pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:31.144629 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.144543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:31.173767 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.173737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:31.310846 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.310790    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"]
Jul 30 10:23:31.312807 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:23:31.312781    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2af5e03_6f2d_4cb1_a1d0_2912ac896373.slice/crio-82061d51d7f14c959ed6cb338b3dd23772edd73ce499c4f86b72667797e8bfd8 WatchSource:0}: Error finding container 82061d51d7f14c959ed6cb338b3dd23772edd73ce499c4f86b72667797e8bfd8: Status 404 returned error can't find the container with id 82061d51d7f14c959ed6cb338b3dd23772edd73ce499c4f86b72667797e8bfd8
Jul 30 10:23:31.337684 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.337661    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"]
Jul 30 10:23:31.340764 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:23:31.340734    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40da9145_390c_4165_ad7f_118106bbb18e.slice/crio-aae88ea0a09508e3f97cd8801d140fc0d12d5fdb9d2b23a6452bd8dbaa1aa2c3 WatchSource:0}: Error finding container aae88ea0a09508e3f97cd8801d140fc0d12d5fdb9d2b23a6452bd8dbaa1aa2c3: Status 404 returned error can't find the container with id aae88ea0a09508e3f97cd8801d140fc0d12d5fdb9d2b23a6452bd8dbaa1aa2c3
Jul 30 10:23:31.614397 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.614357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx" event={"ID":"f2af5e03-6f2d-4cb1-a1d0-2912ac896373","Type":"ContainerStarted","Data":"abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3"}
Jul 30 10:23:31.614588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.614417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx" event={"ID":"f2af5e03-6f2d-4cb1-a1d0-2912ac896373","Type":"ContainerStarted","Data":"82061d51d7f14c959ed6cb338b3dd23772edd73ce499c4f86b72667797e8bfd8"}
Jul 30 10:23:31.614588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.614445    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:31.616001 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.615975    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj" event={"ID":"40da9145-390c-4165-ad7f-118106bbb18e","Type":"ContainerStarted","Data":"2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081"}
Jul 30 10:23:31.616148 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.616017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj" event={"ID":"40da9145-390c-4165-ad7f-118106bbb18e","Type":"ContainerStarted","Data":"aae88ea0a09508e3f97cd8801d140fc0d12d5fdb9d2b23a6452bd8dbaa1aa2c3"}
Jul 30 10:23:31.616148 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.616087    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:31.617604 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.617577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t" event={"ID":"6083b596-031a-4d10-95d2-95a55774bd6c","Type":"ContainerStarted","Data":"7f3bc0c0857c554aea7894d17e96b2ae31e7af3658bdbaa3329d5c498a3c7ad4"}
Jul 30 10:23:31.617710 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.617626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t" event={"ID":"6083b596-031a-4d10-95d2-95a55774bd6c","Type":"ContainerStarted","Data":"219073a0ab9b097679dd2b717aea66d1c331c67b0fbdc13b32c6b6dc83e70999"}
Jul 30 10:23:31.617710 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.617651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:31.630097 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.630050    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx" podStartSLOduration=1.630034553 podStartE2EDuration="1.630034553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:23:31.62835224 +0000 UTC m=+2029.972415697" watchObservedRunningTime="2026-07-30 10:23:31.630034553 +0000 UTC m=+2029.974098008"
Jul 30 10:23:31.644234 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.644185    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj" podStartSLOduration=1.644164173 podStartE2EDuration="1.644164173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:23:31.641322236 +0000 UTC m=+2029.985385694" watchObservedRunningTime="2026-07-30 10:23:31.644164173 +0000 UTC m=+2029.988227630"
Jul 30 10:23:31.656424 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:31.656374    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t" podStartSLOduration=1.154312841 podStartE2EDuration="1.656358124s" totalImagesPullingTime="502.045283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:23:31.655177218 +0000 UTC m=+2029.999240674" watchObservedRunningTime="2026-07-30 10:23:31.656358124 +0000 UTC m=+2030.000421599"
Jul 30 10:23:37.626929 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:37.626899    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:23:42.623655 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:42.623604    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:23:42.624131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:42.623843    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:23:54.963160 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:54.963122    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"]
Jul 30 10:23:54.976317 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:54.976286    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"]
Jul 30 10:23:54.976499 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:54.976404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"
Jul 30 10:23:54.978639 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:54.978605    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:23:55.148300 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:55.148264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/084a993d-8ffb-468b-8f08-d0deda7cacc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-237c0540-jb4rf\" (UID: \"084a993d-8ffb-468b-8f08-d0deda7cacc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"
Jul 30 10:23:55.249752 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:55.249657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/084a993d-8ffb-468b-8f08-d0deda7cacc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-237c0540-jb4rf\" (UID: \"084a993d-8ffb-468b-8f08-d0deda7cacc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"
Jul 30 10:23:55.250358 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:55.250337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/084a993d-8ffb-468b-8f08-d0deda7cacc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-237c0540-jb4rf\" (UID: \"084a993d-8ffb-468b-8f08-d0deda7cacc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"
Jul 30 10:23:55.287461 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:55.287425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"
Jul 30 10:23:55.421990 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:55.421964    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"]
Jul 30 10:23:55.424429 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:23:55.424400    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084a993d_8ffb_468b_8f08_d0deda7cacc0.slice/crio-bf587f2ad73964943a84f94ede39ff3893ead041c49ccf8f7c284b474ebde4b7 WatchSource:0}: Error finding container bf587f2ad73964943a84f94ede39ff3893ead041c49ccf8f7c284b474ebde4b7: Status 404 returned error can't find the container with id bf587f2ad73964943a84f94ede39ff3893ead041c49ccf8f7c284b474ebde4b7
Jul 30 10:23:55.748511 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:55.748479    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf" event={"ID":"084a993d-8ffb-468b-8f08-d0deda7cacc0","Type":"ContainerStarted","Data":"bf587f2ad73964943a84f94ede39ff3893ead041c49ccf8f7c284b474ebde4b7"}
Jul 30 10:23:56.754306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:56.754268    2581 generic.go:356] "Generic (PLEG): container finished" podID="084a993d-8ffb-468b-8f08-d0deda7cacc0" containerID="6438908e284d9f45a69ed89612221f260ef4e7c060168fed4c06a0f4cd061cac" exitCode=0
Jul 30 10:23:56.754679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:56.754360    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf" event={"ID":"084a993d-8ffb-468b-8f08-d0deda7cacc0","Type":"ContainerDied","Data":"6438908e284d9f45a69ed89612221f260ef4e7c060168fed4c06a0f4cd061cac"}
Jul 30 10:23:57.892493 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:57.892467    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"
Jul 30 10:23:57.980131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:57.980090    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/084a993d-8ffb-468b-8f08-d0deda7cacc0-maas-api-service-ca\") pod \"084a993d-8ffb-468b-8f08-d0deda7cacc0\" (UID: \"084a993d-8ffb-468b-8f08-d0deda7cacc0\") "
Jul 30 10:23:57.980453 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:57.980430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084a993d-8ffb-468b-8f08-d0deda7cacc0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "084a993d-8ffb-468b-8f08-d0deda7cacc0" (UID: "084a993d-8ffb-468b-8f08-d0deda7cacc0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:23:58.081439 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:58.081403    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/084a993d-8ffb-468b-8f08-d0deda7cacc0-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:23:58.765285 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:58.765256    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"
Jul 30 10:23:58.765285 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:58.765272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf" event={"ID":"084a993d-8ffb-468b-8f08-d0deda7cacc0","Type":"ContainerDied","Data":"bf587f2ad73964943a84f94ede39ff3893ead041c49ccf8f7c284b474ebde4b7"}
Jul 30 10:23:58.765513 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:23:58.765318    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf587f2ad73964943a84f94ede39ff3893ead041c49ccf8f7c284b474ebde4b7"
Jul 30 10:24:00.639662 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.639627    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"]
Jul 30 10:24:00.640152 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.639901    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t" podUID="6083b596-031a-4d10-95d2-95a55774bd6c" containerName="maas-api" containerID="cri-o://7f3bc0c0857c554aea7894d17e96b2ae31e7af3658bdbaa3329d5c498a3c7ad4" gracePeriod=30
Jul 30 10:24:00.675773 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.675737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:00.693232 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.693201    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"]
Jul 30 10:24:00.693478 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.693450    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj" podUID="40da9145-390c-4165-ad7f-118106bbb18e" containerName="payload-processing" containerID="cri-o://2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081" gracePeriod=30
Jul 30 10:24:00.701580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.701553    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"]
Jul 30 10:24:00.702332 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.701779    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx" podUID="f2af5e03-6f2d-4cb1-a1d0-2912ac896373" containerName="payload-pre-processing" containerID="cri-o://abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3" gracePeriod=30
Jul 30 10:24:00.775699 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.775638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:00.776756 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.776731    2581 generic.go:356] "Generic (PLEG): container finished" podID="6083b596-031a-4d10-95d2-95a55774bd6c" containerID="7f3bc0c0857c554aea7894d17e96b2ae31e7af3658bdbaa3329d5c498a3c7ad4" exitCode=0
Jul 30 10:24:00.776878 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.776803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t" event={"ID":"6083b596-031a-4d10-95d2-95a55774bd6c","Type":"ContainerDied","Data":"7f3bc0c0857c554aea7894d17e96b2ae31e7af3658bdbaa3329d5c498a3c7ad4"}
Jul 30 10:24:00.830084 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.830037    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"]
Jul 30 10:24:00.837080 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.837047    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-237c0540-jb4rf"]
Jul 30 10:24:00.842319 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.842287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:00.980736 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.980711    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:24:00.984268 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.984245    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:24:00.991855 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:00.991812    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:24:01.114117 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114078    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-plugins-config-volume\") pod \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\" (UID: \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\") "
Jul 30 10:24:01.114117 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6083b596-031a-4d10-95d2-95a55774bd6c-openshift-service-ca\") pod \"6083b596-031a-4d10-95d2-95a55774bd6c\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") "
Jul 30 10:24:01.114363 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114173    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swmbt\" (UniqueName: \"kubernetes.io/projected/6083b596-031a-4d10-95d2-95a55774bd6c-kube-api-access-swmbt\") pod \"6083b596-031a-4d10-95d2-95a55774bd6c\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") "
Jul 30 10:24:01.114363 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114230    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6083b596-031a-4d10-95d2-95a55774bd6c-maas-api-tls\") pod \"6083b596-031a-4d10-95d2-95a55774bd6c\" (UID: \"6083b596-031a-4d10-95d2-95a55774bd6c\") "
Jul 30 10:24:01.114363 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114340    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jsbq\" (UniqueName: \"kubernetes.io/projected/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-kube-api-access-7jsbq\") pod \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\" (UID: \"f2af5e03-6f2d-4cb1-a1d0-2912ac896373\") "
Jul 30 10:24:01.114479 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsbpj\" (UniqueName: \"kubernetes.io/projected/40da9145-390c-4165-ad7f-118106bbb18e-kube-api-access-wsbpj\") pod \"40da9145-390c-4165-ad7f-118106bbb18e\" (UID: \"40da9145-390c-4165-ad7f-118106bbb18e\") "
Jul 30 10:24:01.114479 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114446    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40da9145-390c-4165-ad7f-118106bbb18e-plugins-config-volume\") pod \"40da9145-390c-4165-ad7f-118106bbb18e\" (UID: \"40da9145-390c-4165-ad7f-118106bbb18e\") "
Jul 30 10:24:01.114564 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114528    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2af5e03-6f2d-4cb1-a1d0-2912ac896373" (UID: "f2af5e03-6f2d-4cb1-a1d0-2912ac896373"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:24:01.114564 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114525    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6083b596-031a-4d10-95d2-95a55774bd6c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6083b596-031a-4d10-95d2-95a55774bd6c" (UID: "6083b596-031a-4d10-95d2-95a55774bd6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:24:01.114803 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114778    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:01.114803 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114805    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6083b596-031a-4d10-95d2-95a55774bd6c-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:01.115045 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.114952    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40da9145-390c-4165-ad7f-118106bbb18e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40da9145-390c-4165-ad7f-118106bbb18e" (UID: "40da9145-390c-4165-ad7f-118106bbb18e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:24:01.116572 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.116550    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40da9145-390c-4165-ad7f-118106bbb18e-kube-api-access-wsbpj" (OuterVolumeSpecName: "kube-api-access-wsbpj") pod "40da9145-390c-4165-ad7f-118106bbb18e" (UID: "40da9145-390c-4165-ad7f-118106bbb18e"). InnerVolumeSpecName "kube-api-access-wsbpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:24:01.116679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.116579    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-kube-api-access-7jsbq" (OuterVolumeSpecName: "kube-api-access-7jsbq") pod "f2af5e03-6f2d-4cb1-a1d0-2912ac896373" (UID: "f2af5e03-6f2d-4cb1-a1d0-2912ac896373"). InnerVolumeSpecName "kube-api-access-7jsbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:24:01.116809 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.116792    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6083b596-031a-4d10-95d2-95a55774bd6c-kube-api-access-swmbt" (OuterVolumeSpecName: "kube-api-access-swmbt") pod "6083b596-031a-4d10-95d2-95a55774bd6c" (UID: "6083b596-031a-4d10-95d2-95a55774bd6c"). InnerVolumeSpecName "kube-api-access-swmbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:24:01.116903 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.116871    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6083b596-031a-4d10-95d2-95a55774bd6c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6083b596-031a-4d10-95d2-95a55774bd6c" (UID: "6083b596-031a-4d10-95d2-95a55774bd6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:24:01.216327 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.216226    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swmbt\" (UniqueName: \"kubernetes.io/projected/6083b596-031a-4d10-95d2-95a55774bd6c-kube-api-access-swmbt\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:01.216327 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.216271    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6083b596-031a-4d10-95d2-95a55774bd6c-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:01.216327 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.216283    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jsbq\" (UniqueName: \"kubernetes.io/projected/f2af5e03-6f2d-4cb1-a1d0-2912ac896373-kube-api-access-7jsbq\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:01.216327 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.216292    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsbpj\" (UniqueName: \"kubernetes.io/projected/40da9145-390c-4165-ad7f-118106bbb18e-kube-api-access-wsbpj\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:01.216327 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.216301    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40da9145-390c-4165-ad7f-118106bbb18e-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:01.783290 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.783253    2581 generic.go:356] "Generic (PLEG): container finished" podID="f2af5e03-6f2d-4cb1-a1d0-2912ac896373" containerID="abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3" exitCode=0
Jul 30 10:24:01.783772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.783301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"
Jul 30 10:24:01.783772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.783329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx" event={"ID":"f2af5e03-6f2d-4cb1-a1d0-2912ac896373","Type":"ContainerDied","Data":"abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3"}
Jul 30 10:24:01.783772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.783376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx" event={"ID":"f2af5e03-6f2d-4cb1-a1d0-2912ac896373","Type":"ContainerDied","Data":"82061d51d7f14c959ed6cb338b3dd23772edd73ce499c4f86b72667797e8bfd8"}
Jul 30 10:24:01.783772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.783411    2581 scope.go:117] "RemoveContainer" containerID="abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3"
Jul 30 10:24:01.784883 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.784859    2581 generic.go:356] "Generic (PLEG): container finished" podID="40da9145-390c-4165-ad7f-118106bbb18e" containerID="2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081" exitCode=0
Jul 30 10:24:01.784978 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.784906    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"
Jul 30 10:24:01.784978 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.784940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj" event={"ID":"40da9145-390c-4165-ad7f-118106bbb18e","Type":"ContainerDied","Data":"2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081"}
Jul 30 10:24:01.785087 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.784996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj" event={"ID":"40da9145-390c-4165-ad7f-118106bbb18e","Type":"ContainerDied","Data":"aae88ea0a09508e3f97cd8801d140fc0d12d5fdb9d2b23a6452bd8dbaa1aa2c3"}
Jul 30 10:24:01.786361 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.786337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t" event={"ID":"6083b596-031a-4d10-95d2-95a55774bd6c","Type":"ContainerDied","Data":"219073a0ab9b097679dd2b717aea66d1c331c67b0fbdc13b32c6b6dc83e70999"}
Jul 30 10:24:01.786461 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.786376    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"
Jul 30 10:24:01.793549 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.793528    2581 scope.go:117] "RemoveContainer" containerID="abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3"
Jul 30 10:24:01.793911 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:24:01.793884    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3\": container with ID starting with abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3 not found: ID does not exist" containerID="abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3"
Jul 30 10:24:01.794015 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.793922    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3"} err="failed to get container status \"abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3\": rpc error: code = NotFound desc = could not find container \"abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3\": container with ID starting with abb00d94e207dfeeaeb0f79b4e78ff333e58fb9349ff4d7e3e531d3ee3b3edc3 not found: ID does not exist"
Jul 30 10:24:01.794015 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.793943    2581 scope.go:117] "RemoveContainer" containerID="2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081"
Jul 30 10:24:01.803320 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.803299    2581 scope.go:117] "RemoveContainer" containerID="2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081"
Jul 30 10:24:01.803584 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:24:01.803567    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081\": container with ID starting with 2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081 not found: ID does not exist" containerID="2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081"
Jul 30 10:24:01.803641 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.803591    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081"} err="failed to get container status \"2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081\": rpc error: code = NotFound desc = could not find container \"2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081\": container with ID starting with 2a0a17c4b1953ee3578d96eb2732f0f20f2ccdc0e20162ee9eb2238d0bfa2081 not found: ID does not exist"
Jul 30 10:24:01.803641 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.803608    2581 scope.go:117] "RemoveContainer" containerID="7f3bc0c0857c554aea7894d17e96b2ae31e7af3658bdbaa3329d5c498a3c7ad4"
Jul 30 10:24:01.809489 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.809466    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"]
Jul 30 10:24:01.812462 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.812429    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx"]
Jul 30 10:24:01.824758 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.824726    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"]
Jul 30 10:24:01.835093 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.835065    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj"]
Jul 30 10:24:01.852997 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.852963    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"]
Jul 30 10:24:01.856636 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:01.856611    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-237c0540-5c756d9656-gx76t"]
Jul 30 10:24:02.044960 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:02.044871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:02.227636 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:02.227603    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="084a993d-8ffb-468b-8f08-d0deda7cacc0" path="/var/lib/kubelet/pods/084a993d-8ffb-468b-8f08-d0deda7cacc0/volumes"
Jul 30 10:24:02.228111 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:02.228091    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40da9145-390c-4165-ad7f-118106bbb18e" path="/var/lib/kubelet/pods/40da9145-390c-4165-ad7f-118106bbb18e/volumes"
Jul 30 10:24:02.228476 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:02.228462    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6083b596-031a-4d10-95d2-95a55774bd6c" path="/var/lib/kubelet/pods/6083b596-031a-4d10-95d2-95a55774bd6c/volumes"
Jul 30 10:24:02.228783 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:02.228770    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2af5e03-6f2d-4cb1-a1d0-2912ac896373" path="/var/lib/kubelet/pods/f2af5e03-6f2d-4cb1-a1d0-2912ac896373/volumes"
Jul 30 10:24:02.281600 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:02.281569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:02.516065 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:02.516028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:02.812516 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:02.812484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:03.010655 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:03.010615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:03.096695 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:03.096608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:03.154020 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:03.153989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:06.411624 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.411548    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"]
Jul 30 10:24:06.412025 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.411996    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084a993d-8ffb-468b-8f08-d0deda7cacc0" containerName="revoke-keys"
Jul 30 10:24:06.412025 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412023    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="084a993d-8ffb-468b-8f08-d0deda7cacc0" containerName="revoke-keys"
Jul 30 10:24:06.412229 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412050    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2af5e03-6f2d-4cb1-a1d0-2912ac896373" containerName="payload-pre-processing"
Jul 30 10:24:06.412229 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412058    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2af5e03-6f2d-4cb1-a1d0-2912ac896373" containerName="payload-pre-processing"
Jul 30 10:24:06.412229 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412071    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6083b596-031a-4d10-95d2-95a55774bd6c" containerName="maas-api"
Jul 30 10:24:06.412229 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412080    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6083b596-031a-4d10-95d2-95a55774bd6c" containerName="maas-api"
Jul 30 10:24:06.412229 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412090    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40da9145-390c-4165-ad7f-118106bbb18e" containerName="payload-processing"
Jul 30 10:24:06.412229 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412151    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="40da9145-390c-4165-ad7f-118106bbb18e" containerName="payload-processing"
Jul 30 10:24:06.412538 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412287    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="084a993d-8ffb-468b-8f08-d0deda7cacc0" containerName="revoke-keys"
Jul 30 10:24:06.412538 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412306    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2af5e03-6f2d-4cb1-a1d0-2912ac896373" containerName="payload-pre-processing"
Jul 30 10:24:06.412538 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412317    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6083b596-031a-4d10-95d2-95a55774bd6c" containerName="maas-api"
Jul 30 10:24:06.412538 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.412326    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="40da9145-390c-4165-ad7f-118106bbb18e" containerName="payload-processing"
Jul 30 10:24:06.417248 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.417231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:06.419156 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.419133    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f9b729be-serving-cert\""
Jul 30 10:24:06.422912 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.422885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"]
Jul 30 10:24:06.459739 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.459698    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc2s6\" (UniqueName: \"kubernetes.io/projected/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-kube-api-access-fc2s6\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:06.459932 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.459805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-openshift-service-ca\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:06.459932 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.459854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:06.560347 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.560309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-openshift-service-ca\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:06.560347 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.560349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:06.560562 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.560391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc2s6\" (UniqueName: \"kubernetes.io/projected/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-kube-api-access-fc2s6\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:06.560562 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:24:06.560510    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-serving-cert: secret "maas-api-e2e-derive-f9b729be-serving-cert" not found
Jul 30 10:24:06.560631 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:24:06.560574    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls podName:c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4 nodeName:}" failed. No retries permitted until 2026-07-30 10:24:07.060556674 +0000 UTC m=+2065.404620109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls") pod "maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8" (UID: "c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4") : secret "maas-api-e2e-derive-f9b729be-serving-cert" not found
Jul 30 10:24:06.560961 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.560942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-openshift-service-ca\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:06.568566 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:06.568539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc2s6\" (UniqueName: \"kubernetes.io/projected/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-kube-api-access-fc2s6\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:07.022802 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.022758    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"]
Jul 30 10:24:07.026680 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.026656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.028420 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.028399    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f9b729be\""
Jul 30 10:24:07.035012 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.034937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"]
Jul 30 10:24:07.060997 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.060966    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"]
Jul 30 10:24:07.064260 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.064237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:07.064382 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.064365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.064435 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.064388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4kwg\" (UniqueName: \"kubernetes.io/projected/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-kube-api-access-q4kwg\") pod \"payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd\" (UID: \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.064435 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.064422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd\" (UID: \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.066553 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.066534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f9b729be-dockercfg-gmkz2\""
Jul 30 10:24:07.066709 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.066691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls\") pod \"maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:07.073536 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.073503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"]
Jul 30 10:24:07.165528 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.165486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdcsb\" (UniqueName: \"kubernetes.io/projected/1ee7b80c-d971-4efa-a071-ace121c2fee0-kube-api-access-xdcsb\") pod \"payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm\" (UID: \"1ee7b80c-d971-4efa-a071-ace121c2fee0\") " pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.165698 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.165604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee7b80c-d971-4efa-a071-ace121c2fee0-plugins-config-volume\") pod \"payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm\" (UID: \"1ee7b80c-d971-4efa-a071-ace121c2fee0\") " pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.165698 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.165646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kwg\" (UniqueName: \"kubernetes.io/projected/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-kube-api-access-q4kwg\") pod \"payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd\" (UID: \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.165698 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.165688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd\" (UID: \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.166387 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.166361    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd\" (UID: \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.172683 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.172658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4kwg\" (UniqueName: \"kubernetes.io/projected/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-kube-api-access-q4kwg\") pod \"payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd\" (UID: \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.266289 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.266245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee7b80c-d971-4efa-a071-ace121c2fee0-plugins-config-volume\") pod \"payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm\" (UID: \"1ee7b80c-d971-4efa-a071-ace121c2fee0\") " pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.266459 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.266337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdcsb\" (UniqueName: \"kubernetes.io/projected/1ee7b80c-d971-4efa-a071-ace121c2fee0-kube-api-access-xdcsb\") pod \"payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm\" (UID: \"1ee7b80c-d971-4efa-a071-ace121c2fee0\") " pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.267208 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.267185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee7b80c-d971-4efa-a071-ace121c2fee0-plugins-config-volume\") pod \"payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm\" (UID: \"1ee7b80c-d971-4efa-a071-ace121c2fee0\") " pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.273503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.273430    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdcsb\" (UniqueName: \"kubernetes.io/projected/1ee7b80c-d971-4efa-a071-ace121c2fee0-kube-api-access-xdcsb\") pod \"payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm\" (UID: \"1ee7b80c-d971-4efa-a071-ace121c2fee0\") " pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.330482 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.330450    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:07.339802 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.339778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.387256 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.387222    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.495497 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.495312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"]
Jul 30 10:24:07.520643 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.520608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"]
Jul 30 10:24:07.523111 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:24:07.523079    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9719d2_83ce_4f9f_ba07_bc73ef6c1e20.slice/crio-a6da7f68a836f4442c46b1741c4e953d685f870121399fa67a304e8c3ceacfea WatchSource:0}: Error finding container a6da7f68a836f4442c46b1741c4e953d685f870121399fa67a304e8c3ceacfea: Status 404 returned error can't find the container with id a6da7f68a836f4442c46b1741c4e953d685f870121399fa67a304e8c3ceacfea
Jul 30 10:24:07.549583 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.549557    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"]
Jul 30 10:24:07.557011 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:24:07.556982    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee7b80c_d971_4efa_a071_ace121c2fee0.slice/crio-45575c1e9e6e8def55c5c2677ec731237f92a1a51349815fdea2866604558923 WatchSource:0}: Error finding container 45575c1e9e6e8def55c5c2677ec731237f92a1a51349815fdea2866604558923: Status 404 returned error can't find the container with id 45575c1e9e6e8def55c5c2677ec731237f92a1a51349815fdea2866604558923
Jul 30 10:24:07.736879 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.736839    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:07.819629 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.819596    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm" event={"ID":"1ee7b80c-d971-4efa-a071-ace121c2fee0","Type":"ContainerStarted","Data":"dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d"}
Jul 30 10:24:07.819852 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.819648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm" event={"ID":"1ee7b80c-d971-4efa-a071-ace121c2fee0","Type":"ContainerStarted","Data":"45575c1e9e6e8def55c5c2677ec731237f92a1a51349815fdea2866604558923"}
Jul 30 10:24:07.819852 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.819698    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:07.821321 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.821292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd" event={"ID":"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20","Type":"ContainerStarted","Data":"40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066"}
Jul 30 10:24:07.821478 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.821341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd" event={"ID":"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20","Type":"ContainerStarted","Data":"a6da7f68a836f4442c46b1741c4e953d685f870121399fa67a304e8c3ceacfea"}
Jul 30 10:24:07.821478 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.821375    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:07.822470 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.822435    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8" event={"ID":"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4","Type":"ContainerStarted","Data":"87ca6760802f46d83d0eb66ecf58497c653b8a536cf384a9de9730b633a7fc83"}
Jul 30 10:24:07.834744 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.834692    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm" podStartSLOduration=0.834676096 podStartE2EDuration="834.676096ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:24:07.834354547 +0000 UTC m=+2066.178418017" watchObservedRunningTime="2026-07-30 10:24:07.834676096 +0000 UTC m=+2066.178739578"
Jul 30 10:24:07.838342 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.838304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:07.851621 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:07.851575    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd" podStartSLOduration=0.85156019 podStartE2EDuration="851.56019ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:24:07.849765134 +0000 UTC m=+2066.193828610" watchObservedRunningTime="2026-07-30 10:24:07.85156019 +0000 UTC m=+2066.195623688"
Jul 30 10:24:10.838390 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:10.838347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8" event={"ID":"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4","Type":"ContainerStarted","Data":"5edc74b6f16b0f99350dad1b08593d112e9067211e22a405f358dbbf2b8527b5"}
Jul 30 10:24:10.838888 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:10.838482    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:10.854834 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:10.854771    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8" podStartSLOduration=1.806432546 podStartE2EDuration="4.854753422s" totalImagesPullingTime="3.048320876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:24:10.854035809 +0000 UTC m=+2069.198099265" watchObservedRunningTime="2026-07-30 10:24:10.854753422 +0000 UTC m=+2069.198816907"
Jul 30 10:24:16.849391 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:16.849357    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:18.829981 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:18.829951    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:18.830356 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:18.830117    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:30.228730 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.228696    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"]
Jul 30 10:24:30.232473 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.232446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"
Jul 30 10:24:30.234470 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.234445    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:24:30.234837 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.234783    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"]
Jul 30 10:24:30.382128 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.382088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f3577b-0c65-4e95-b121-a1991585f6a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f9b729be-tghv4\" (UID: \"c5f3577b-0c65-4e95-b121-a1991585f6a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"
Jul 30 10:24:30.483273 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.483180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f3577b-0c65-4e95-b121-a1991585f6a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f9b729be-tghv4\" (UID: \"c5f3577b-0c65-4e95-b121-a1991585f6a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"
Jul 30 10:24:30.483873 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.483855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f3577b-0c65-4e95-b121-a1991585f6a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f9b729be-tghv4\" (UID: \"c5f3577b-0c65-4e95-b121-a1991585f6a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"
Jul 30 10:24:30.544706 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.544669    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"
Jul 30 10:24:30.684494 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.684452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"]
Jul 30 10:24:30.686765 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:24:30.686738    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f3577b_0c65_4e95_b121_a1991585f6a7.slice/crio-02b215bc9eae4223a144eda183f074d96973563b9d73498c42ab7f2a41ce90fd WatchSource:0}: Error finding container 02b215bc9eae4223a144eda183f074d96973563b9d73498c42ab7f2a41ce90fd: Status 404 returned error can't find the container with id 02b215bc9eae4223a144eda183f074d96973563b9d73498c42ab7f2a41ce90fd
Jul 30 10:24:30.941714 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.941670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4" event={"ID":"c5f3577b-0c65-4e95-b121-a1991585f6a7","Type":"ContainerStarted","Data":"179ec77c7f19bbe1236dfac4c738e4293b0f87ce53f5820b2bca93f47a46d1fe"}
Jul 30 10:24:30.941953 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.941739    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4" event={"ID":"c5f3577b-0c65-4e95-b121-a1991585f6a7","Type":"ContainerStarted","Data":"02b215bc9eae4223a144eda183f074d96973563b9d73498c42ab7f2a41ce90fd"}
Jul 30 10:24:30.956156 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:30.956102    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4" podStartSLOduration=0.956084665 podStartE2EDuration="956.084665ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:24:30.953737932 +0000 UTC m=+2089.297801388" watchObservedRunningTime="2026-07-30 10:24:30.956084665 +0000 UTC m=+2089.300148121"
Jul 30 10:24:31.950055 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:31.950012    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5f3577b-0c65-4e95-b121-a1991585f6a7" containerID="179ec77c7f19bbe1236dfac4c738e4293b0f87ce53f5820b2bca93f47a46d1fe" exitCode=0
Jul 30 10:24:31.950491 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:31.950101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4" event={"ID":"c5f3577b-0c65-4e95-b121-a1991585f6a7","Type":"ContainerDied","Data":"179ec77c7f19bbe1236dfac4c738e4293b0f87ce53f5820b2bca93f47a46d1fe"}
Jul 30 10:24:33.092921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:33.092887    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"
Jul 30 10:24:33.207381 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:33.207295    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f3577b-0c65-4e95-b121-a1991585f6a7-maas-api-service-ca\") pod \"c5f3577b-0c65-4e95-b121-a1991585f6a7\" (UID: \"c5f3577b-0c65-4e95-b121-a1991585f6a7\") "
Jul 30 10:24:33.207733 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:33.207708    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f3577b-0c65-4e95-b121-a1991585f6a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5f3577b-0c65-4e95-b121-a1991585f6a7" (UID: "c5f3577b-0c65-4e95-b121-a1991585f6a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:24:33.308579 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:33.308536    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f3577b-0c65-4e95-b121-a1991585f6a7-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:33.961087 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:33.961028    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"
Jul 30 10:24:33.961087 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:33.961075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4" event={"ID":"c5f3577b-0c65-4e95-b121-a1991585f6a7","Type":"ContainerDied","Data":"02b215bc9eae4223a144eda183f074d96973563b9d73498c42ab7f2a41ce90fd"}
Jul 30 10:24:33.961302 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:33.961127    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02b215bc9eae4223a144eda183f074d96973563b9d73498c42ab7f2a41ce90fd"
Jul 30 10:24:36.832981 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.832947    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"]
Jul 30 10:24:36.833464 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.833243    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8" podUID="c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" containerName="maas-api" containerID="cri-o://5edc74b6f16b0f99350dad1b08593d112e9067211e22a405f358dbbf2b8527b5" gracePeriod=30
Jul 30 10:24:36.843844 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.843790    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8" podUID="c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.48:8443/health\": dial tcp 10.133.0.48:8443: connect: connection refused"
Jul 30 10:24:36.865054 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.865022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:36.889213 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.889176    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"]
Jul 30 10:24:36.889473 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.889447    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm" podUID="1ee7b80c-d971-4efa-a071-ace121c2fee0" containerName="payload-processing" containerID="cri-o://dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d" gracePeriod=30
Jul 30 10:24:36.899370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.899329    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"]
Jul 30 10:24:36.899736 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.899648    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd" podUID="da9719d2-83ce-4f9f-ba07-bc73ef6c1e20" containerName="payload-pre-processing" containerID="cri-o://40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066" gracePeriod=30
Jul 30 10:24:36.925943 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.925911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:36.977904 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.977863    2581 generic.go:356] "Generic (PLEG): container finished" podID="c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" containerID="5edc74b6f16b0f99350dad1b08593d112e9067211e22a405f358dbbf2b8527b5" exitCode=0
Jul 30 10:24:36.978034 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.977934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8" event={"ID":"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4","Type":"ContainerDied","Data":"5edc74b6f16b0f99350dad1b08593d112e9067211e22a405f358dbbf2b8527b5"}
Jul 30 10:24:36.985842 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:36.985787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:37.022484 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.022428    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"]
Jul 30 10:24:37.025034 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.025004    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f9b729be-tghv4"]
Jul 30 10:24:37.040423 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.040326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:37.166585 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.166556    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:37.197522 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.197486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:37.203181 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.203159    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:37.205957 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.205939    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:37.245827 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.245783    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls\") pod \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") "
Jul 30 10:24:37.246016 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.245852    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc2s6\" (UniqueName: \"kubernetes.io/projected/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-kube-api-access-fc2s6\") pod \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") "
Jul 30 10:24:37.246016 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.245894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-openshift-service-ca\") pod \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\" (UID: \"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4\") "
Jul 30 10:24:37.246251 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.246224    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" (UID: "c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:24:37.247906 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.247878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-kube-api-access-fc2s6" (OuterVolumeSpecName: "kube-api-access-fc2s6") pod "c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" (UID: "c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4"). InnerVolumeSpecName "kube-api-access-fc2s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:24:37.248004 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.247939    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" (UID: "c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:24:37.346646 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.346612    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4kwg\" (UniqueName: \"kubernetes.io/projected/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-kube-api-access-q4kwg\") pod \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\" (UID: \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\") "
Jul 30 10:24:37.346866 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.346653    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-plugins-config-volume\") pod \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\" (UID: \"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20\") "
Jul 30 10:24:37.346866 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.346711    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee7b80c-d971-4efa-a071-ace121c2fee0-plugins-config-volume\") pod \"1ee7b80c-d971-4efa-a071-ace121c2fee0\" (UID: \"1ee7b80c-d971-4efa-a071-ace121c2fee0\") "
Jul 30 10:24:37.347004 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.346865    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdcsb\" (UniqueName: \"kubernetes.io/projected/1ee7b80c-d971-4efa-a071-ace121c2fee0-kube-api-access-xdcsb\") pod \"1ee7b80c-d971-4efa-a071-ace121c2fee0\" (UID: \"1ee7b80c-d971-4efa-a071-ace121c2fee0\") "
Jul 30 10:24:37.347185 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.347153    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da9719d2-83ce-4f9f-ba07-bc73ef6c1e20" (UID: "da9719d2-83ce-4f9f-ba07-bc73ef6c1e20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:24:37.347314 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.347156    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ee7b80c-d971-4efa-a071-ace121c2fee0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ee7b80c-d971-4efa-a071-ace121c2fee0" (UID: "1ee7b80c-d971-4efa-a071-ace121c2fee0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:24:37.347314 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.347281    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:37.347314 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.347305    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:37.347497 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.347319    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc2s6\" (UniqueName: \"kubernetes.io/projected/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-kube-api-access-fc2s6\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:37.347497 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.347334    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:37.348895 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.348826    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-kube-api-access-q4kwg" (OuterVolumeSpecName: "kube-api-access-q4kwg") pod "da9719d2-83ce-4f9f-ba07-bc73ef6c1e20" (UID: "da9719d2-83ce-4f9f-ba07-bc73ef6c1e20"). InnerVolumeSpecName "kube-api-access-q4kwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:24:37.348987 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.348893    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ee7b80c-d971-4efa-a071-ace121c2fee0-kube-api-access-xdcsb" (OuterVolumeSpecName: "kube-api-access-xdcsb") pod "1ee7b80c-d971-4efa-a071-ace121c2fee0" (UID: "1ee7b80c-d971-4efa-a071-ace121c2fee0"). InnerVolumeSpecName "kube-api-access-xdcsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:24:37.423484 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.423448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:37.448635 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.448600    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4kwg\" (UniqueName: \"kubernetes.io/projected/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20-kube-api-access-q4kwg\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:37.448635 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.448628    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee7b80c-d971-4efa-a071-ace121c2fee0-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:37.448635 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.448638    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdcsb\" (UniqueName: \"kubernetes.io/projected/1ee7b80c-d971-4efa-a071-ace121c2fee0-kube-api-access-xdcsb\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:24:37.923134 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.923098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:37.984361 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.984326    2581 generic.go:356] "Generic (PLEG): container finished" podID="1ee7b80c-d971-4efa-a071-ace121c2fee0" containerID="dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d" exitCode=0
Jul 30 10:24:37.984546 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.984377    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"
Jul 30 10:24:37.984546 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.984416    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm" event={"ID":"1ee7b80c-d971-4efa-a071-ace121c2fee0","Type":"ContainerDied","Data":"dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d"}
Jul 30 10:24:37.984546 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.984475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm" event={"ID":"1ee7b80c-d971-4efa-a071-ace121c2fee0","Type":"ContainerDied","Data":"45575c1e9e6e8def55c5c2677ec731237f92a1a51349815fdea2866604558923"}
Jul 30 10:24:37.984546 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.984506    2581 scope.go:117] "RemoveContainer" containerID="dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d"
Jul 30 10:24:37.985830 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.985761    2581 generic.go:356] "Generic (PLEG): container finished" podID="da9719d2-83ce-4f9f-ba07-bc73ef6c1e20" containerID="40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066" exitCode=0
Jul 30 10:24:37.985921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.985850    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd" event={"ID":"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20","Type":"ContainerDied","Data":"40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066"}
Jul 30 10:24:37.985921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.985887    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"
Jul 30 10:24:37.985921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.985906    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd" event={"ID":"da9719d2-83ce-4f9f-ba07-bc73ef6c1e20","Type":"ContainerDied","Data":"a6da7f68a836f4442c46b1741c4e953d685f870121399fa67a304e8c3ceacfea"}
Jul 30 10:24:37.987445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.987425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8" event={"ID":"c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4","Type":"ContainerDied","Data":"87ca6760802f46d83d0eb66ecf58497c653b8a536cf384a9de9730b633a7fc83"}
Jul 30 10:24:37.987548 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.987472    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"
Jul 30 10:24:37.995292 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.995098    2581 scope.go:117] "RemoveContainer" containerID="dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d"
Jul 30 10:24:37.995450 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:24:37.995375    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d\": container with ID starting with dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d not found: ID does not exist" containerID="dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d"
Jul 30 10:24:37.995450 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.995407    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d"} err="failed to get container status \"dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d\": rpc error: code = NotFound desc = could not find container \"dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d\": container with ID starting with dca190c6ef2f309aa125ae9e0d94c11957616ab619b1cebfb9640eb27dfbc65d not found: ID does not exist"
Jul 30 10:24:37.995450 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:37.995431    2581 scope.go:117] "RemoveContainer" containerID="40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066"
Jul 30 10:24:38.003698 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.003674    2581 scope.go:117] "RemoveContainer" containerID="40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066"
Jul 30 10:24:38.003964 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:24:38.003946    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066\": container with ID starting with 40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066 not found: ID does not exist" containerID="40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066"
Jul 30 10:24:38.004037 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.003970    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066"} err="failed to get container status \"40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066\": rpc error: code = NotFound desc = could not find container \"40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066\": container with ID starting with 40b5de6b98d4837d2dbddc3cf95f61f092e7cb752ebf5cb1121f2cb1654b8066 not found: ID does not exist"
Jul 30 10:24:38.004037 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.003986    2581 scope.go:117] "RemoveContainer" containerID="5edc74b6f16b0f99350dad1b08593d112e9067211e22a405f358dbbf2b8527b5"
Jul 30 10:24:38.009853 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.009809    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"]
Jul 30 10:24:38.014067 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.014047    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm"]
Jul 30 10:24:38.027452 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.027427    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"]
Jul 30 10:24:38.032177 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.032155    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b729be-5f6549b4cc-8llz8"]
Jul 30 10:24:38.045844 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.045802    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"]
Jul 30 10:24:38.048213 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.048191    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd"]
Jul 30 10:24:38.227250 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.227157    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ee7b80c-d971-4efa-a071-ace121c2fee0" path="/var/lib/kubelet/pods/1ee7b80c-d971-4efa-a071-ace121c2fee0/volumes"
Jul 30 10:24:38.227651 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.227630    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" path="/var/lib/kubelet/pods/c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4/volumes"
Jul 30 10:24:38.228020 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.228002    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f3577b-0c65-4e95-b121-a1991585f6a7" path="/var/lib/kubelet/pods/c5f3577b-0c65-4e95-b121-a1991585f6a7/volumes"
Jul 30 10:24:38.228383 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:38.228364    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da9719d2-83ce-4f9f-ba07-bc73ef6c1e20" path="/var/lib/kubelet/pods/da9719d2-83ce-4f9f-ba07-bc73ef6c1e20/volumes"
Jul 30 10:24:40.483652 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:40.483615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:40.586004 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:40.585967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:24:42.280568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:42.280540    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:24:42.287296 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:24:42.287275    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:25:00.130396 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:00.130357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:06.455167 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:06.455135    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:06.561276 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:06.561236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:06.656951 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:06.656906    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:06.755182 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:06.755086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:07.229081 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:07.229044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:33.232071 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:33.232028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:39.544879 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:39.544758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:39.648192 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:39.648152    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:40.019048 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:40.019010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:25:55.681868 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:25:55.681808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:01.623906 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:01.623865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:01.724260 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:01.724226    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:12.150643 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:12.150606    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:23.301204 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:23.301169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:28.140006 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:28.139968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:29.946690 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:29.946659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:30.046767 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:30.046726    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:30.147611 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:30.147577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:30.775735 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:30.775682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:30.874384 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:30.874343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:30.974991 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:30.974958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:32.568315 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:32.568281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:38.543084 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:38.543044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:38.603423 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:38.603389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:39.267555 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:39.267519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:45.357179 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:45.357136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:45.452760 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:45.452728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:45.624394 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:45.624298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:45.994328 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:45.994249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:46.154254 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:46.154215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:48.906201 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:48.906153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:49.011606 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:49.011567    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:50.002032 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002002    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"]
Jul 30 10:26:50.002396 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002349    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da9719d2-83ce-4f9f-ba07-bc73ef6c1e20" containerName="payload-pre-processing"
Jul 30 10:26:50.002396 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002359    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="da9719d2-83ce-4f9f-ba07-bc73ef6c1e20" containerName="payload-pre-processing"
Jul 30 10:26:50.002396 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002375    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f3577b-0c65-4e95-b121-a1991585f6a7" containerName="revoke-keys"
Jul 30 10:26:50.002396 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002381    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f3577b-0c65-4e95-b121-a1991585f6a7" containerName="revoke-keys"
Jul 30 10:26:50.002396 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002391    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" containerName="maas-api"
Jul 30 10:26:50.002396 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002398    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" containerName="maas-api"
Jul 30 10:26:50.002591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002410    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee7b80c-d971-4efa-a071-ace121c2fee0" containerName="payload-processing"
Jul 30 10:26:50.002591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002415    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee7b80c-d971-4efa-a071-ace121c2fee0" containerName="payload-processing"
Jul 30 10:26:50.002591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002466    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="da9719d2-83ce-4f9f-ba07-bc73ef6c1e20" containerName="payload-pre-processing"
Jul 30 10:26:50.002591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002475    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ee7b80c-d971-4efa-a071-ace121c2fee0" containerName="payload-processing"
Jul 30 10:26:50.002591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002482    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f3577b-0c65-4e95-b121-a1991585f6a7" containerName="revoke-keys"
Jul 30 10:26:50.002591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.002488    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1b562a2-1dbc-4ac0-b5e2-a5c1676664f4" containerName="maas-api"
Jul 30 10:26:50.005567 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.005546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.007495 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.007472    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-51353e63-serving-cert\""
Jul 30 10:26:50.014699 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.014663    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"]
Jul 30 10:26:50.152377 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.152341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.152552 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.152406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b87c4b2-24ec-47fc-9429-7a7731e6123c-openshift-service-ca\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.152552 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.152474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw775\" (UniqueName: \"kubernetes.io/projected/2b87c4b2-24ec-47fc-9429-7a7731e6123c-kube-api-access-vw775\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.253692 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.253612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.253692 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.253675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b87c4b2-24ec-47fc-9429-7a7731e6123c-openshift-service-ca\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.253920 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.253741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw775\" (UniqueName: \"kubernetes.io/projected/2b87c4b2-24ec-47fc-9429-7a7731e6123c-kube-api-access-vw775\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.253920 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:26:50.253828    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-serving-cert: secret "maas-api-e2e-mt-51353e63-serving-cert" not found
Jul 30 10:26:50.253920 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:26:50.253896    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls podName:2b87c4b2-24ec-47fc-9429-7a7731e6123c nodeName:}" failed. No retries permitted until 2026-07-30 10:26:50.753875601 +0000 UTC m=+2229.097939036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls") pod "maas-api-e2e-mt-51353e63-98d4864bd-p2z5q" (UID: "2b87c4b2-24ec-47fc-9429-7a7731e6123c") : secret "maas-api-e2e-mt-51353e63-serving-cert" not found
Jul 30 10:26:50.254299 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.254281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b87c4b2-24ec-47fc-9429-7a7731e6123c-openshift-service-ca\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.266502 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.266477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw775\" (UniqueName: \"kubernetes.io/projected/2b87c4b2-24ec-47fc-9429-7a7731e6123c-kube-api-access-vw775\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.329689 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.329652    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:50.430579 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.430546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:50.535540 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.535443    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:50.612567 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.612538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:26:50.617006 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.616977    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"]
Jul 30 10:26:50.620471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.620453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:50.622493 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.622473    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-51353e63\""
Jul 30 10:26:50.622591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.622534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-51353e63-dockercfg-mnpdd\""
Jul 30 10:26:50.631318 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.631281    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"]
Jul 30 10:26:50.639983 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.639958    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"]
Jul 30 10:26:50.643314 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.643295    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:50.664618 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.664547    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"]
Jul 30 10:26:50.762083 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.762034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/068d7d42-6540-4205-b780-861f5e59a13c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx\" (UID: \"068d7d42-6540-4205-b780-861f5e59a13c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:50.762282 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.762110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv5fq\" (UniqueName: \"kubernetes.io/projected/068d7d42-6540-4205-b780-861f5e59a13c-kube-api-access-rv5fq\") pod \"payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx\" (UID: \"068d7d42-6540-4205-b780-861f5e59a13c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:50.762282 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.762143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m7lm\" (UniqueName: \"kubernetes.io/projected/b3ddcd58-e419-4442-ab1e-7695ee471d4e-kube-api-access-8m7lm\") pod \"payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf\" (UID: \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:50.762282 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.762179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.762282 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.762211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3ddcd58-e419-4442-ab1e-7695ee471d4e-plugins-config-volume\") pod \"payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf\" (UID: \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:50.764596 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.764568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls\") pod \"maas-api-e2e-mt-51353e63-98d4864bd-p2z5q\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.862779 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.862741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv5fq\" (UniqueName: \"kubernetes.io/projected/068d7d42-6540-4205-b780-861f5e59a13c-kube-api-access-rv5fq\") pod \"payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx\" (UID: \"068d7d42-6540-4205-b780-861f5e59a13c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:50.862779 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.862782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m7lm\" (UniqueName: \"kubernetes.io/projected/b3ddcd58-e419-4442-ab1e-7695ee471d4e-kube-api-access-8m7lm\") pod \"payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf\" (UID: \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:50.863025 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.862841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3ddcd58-e419-4442-ab1e-7695ee471d4e-plugins-config-volume\") pod \"payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf\" (UID: \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:50.863025 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.862876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/068d7d42-6540-4205-b780-861f5e59a13c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx\" (UID: \"068d7d42-6540-4205-b780-861f5e59a13c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:50.863550 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.863531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/068d7d42-6540-4205-b780-861f5e59a13c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx\" (UID: \"068d7d42-6540-4205-b780-861f5e59a13c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:50.863623 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.863603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3ddcd58-e419-4442-ab1e-7695ee471d4e-plugins-config-volume\") pod \"payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf\" (UID: \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:50.869989 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.869960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m7lm\" (UniqueName: \"kubernetes.io/projected/b3ddcd58-e419-4442-ab1e-7695ee471d4e-kube-api-access-8m7lm\") pod \"payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf\" (UID: \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\") " pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:50.870111 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.870009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv5fq\" (UniqueName: \"kubernetes.io/projected/068d7d42-6540-4205-b780-861f5e59a13c-kube-api-access-rv5fq\") pod \"payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx\" (UID: \"068d7d42-6540-4205-b780-861f5e59a13c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:50.916894 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.916862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:50.933160 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.933134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:50.964547 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:50.964513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:51.074046 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.073762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"]
Jul 30 10:26:51.079559 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:26:51.078646    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b87c4b2_24ec_47fc_9429_7a7731e6123c.slice/crio-cee68c19f3f7c3631ce9565aa3db6ae5863d41424aedfb5e18358e80551b2786 WatchSource:0}: Error finding container cee68c19f3f7c3631ce9565aa3db6ae5863d41424aedfb5e18358e80551b2786: Status 404 returned error can't find the container with id cee68c19f3f7c3631ce9565aa3db6ae5863d41424aedfb5e18358e80551b2786
Jul 30 10:26:51.105404 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.105377    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"]
Jul 30 10:26:51.108711 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:26:51.108675    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068d7d42_6540_4205_b780_861f5e59a13c.slice/crio-9287c3c857cb3eee8d3abf783eefa6dfd523cacce2988f65a6a6843523074462 WatchSource:0}: Error finding container 9287c3c857cb3eee8d3abf783eefa6dfd523cacce2988f65a6a6843523074462: Status 404 returned error can't find the container with id 9287c3c857cb3eee8d3abf783eefa6dfd523cacce2988f65a6a6843523074462
Jul 30 10:26:51.132166 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.132145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"]
Jul 30 10:26:51.146139 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:26:51.146096    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ddcd58_e419_4442_ab1e_7695ee471d4e.slice/crio-da01f23b6723c0915b2cde8455360526a2ccf59c9c607e2f076a4861f59dfeba WatchSource:0}: Error finding container da01f23b6723c0915b2cde8455360526a2ccf59c9c607e2f076a4861f59dfeba: Status 404 returned error can't find the container with id da01f23b6723c0915b2cde8455360526a2ccf59c9c607e2f076a4861f59dfeba
Jul 30 10:26:51.641565 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.641529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf" event={"ID":"b3ddcd58-e419-4442-ab1e-7695ee471d4e","Type":"ContainerStarted","Data":"c5fc7ef210bd094af442f420fc7371836a67669f844eb6abafc74732712b1670"}
Jul 30 10:26:51.641732 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.641593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf" event={"ID":"b3ddcd58-e419-4442-ab1e-7695ee471d4e","Type":"ContainerStarted","Data":"da01f23b6723c0915b2cde8455360526a2ccf59c9c607e2f076a4861f59dfeba"}
Jul 30 10:26:51.641732 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.641646    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:26:51.642992 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.642965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q" event={"ID":"2b87c4b2-24ec-47fc-9429-7a7731e6123c","Type":"ContainerStarted","Data":"cee68c19f3f7c3631ce9565aa3db6ae5863d41424aedfb5e18358e80551b2786"}
Jul 30 10:26:51.644563 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.644543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx" event={"ID":"068d7d42-6540-4205-b780-861f5e59a13c","Type":"ContainerStarted","Data":"9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7"}
Jul 30 10:26:51.644665 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.644578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx" event={"ID":"068d7d42-6540-4205-b780-861f5e59a13c","Type":"ContainerStarted","Data":"9287c3c857cb3eee8d3abf783eefa6dfd523cacce2988f65a6a6843523074462"}
Jul 30 10:26:51.644727 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.644675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:26:51.661005 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.660952    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf" podStartSLOduration=1.660933473 podStartE2EDuration="1.660933473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:26:51.658496493 +0000 UTC m=+2230.002559971" watchObservedRunningTime="2026-07-30 10:26:51.660933473 +0000 UTC m=+2230.004996931"
Jul 30 10:26:51.671801 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:51.671747    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx" podStartSLOduration=1.671727958 podStartE2EDuration="1.671727958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:26:51.671296014 +0000 UTC m=+2230.015359471" watchObservedRunningTime="2026-07-30 10:26:51.671727958 +0000 UTC m=+2230.015791421"
Jul 30 10:26:52.651139 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:52.651085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q" event={"ID":"2b87c4b2-24ec-47fc-9429-7a7731e6123c","Type":"ContainerStarted","Data":"7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0"}
Jul 30 10:26:52.651633 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:52.651532    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:26:52.666409 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:52.666363    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q" podStartSLOduration=3.140440333 podStartE2EDuration="3.666347215s" totalImagesPullingTime="525.906882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:26:52.663996302 +0000 UTC m=+2231.008059762" watchObservedRunningTime="2026-07-30 10:26:52.666347215 +0000 UTC m=+2231.010410671"
Jul 30 10:26:59.667746 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:26:59.667712    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:27:02.653011 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:02.652971    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:27:02.653443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:02.653053    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:27:13.971471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:13.971384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:14.675937 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:14.675857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:14.774260 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:14.774220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:15.118541 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:15.118509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:20.760096 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:20.760060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:21.129791 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.129754    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"]
Jul 30 10:27:21.133257 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.133238    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"
Jul 30 10:27:21.135211 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.135186    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:27:21.138667 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.138640    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"]
Jul 30 10:27:21.241860 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.241798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a496e211-8a19-49b4-976b-786985690744-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-51353e63-mbkdq\" (UID: \"a496e211-8a19-49b4-976b-786985690744\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"
Jul 30 10:27:21.277702 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.277655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:21.342615 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.342576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a496e211-8a19-49b4-976b-786985690744-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-51353e63-mbkdq\" (UID: \"a496e211-8a19-49b4-976b-786985690744\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"
Jul 30 10:27:21.343248 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.343227    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a496e211-8a19-49b4-976b-786985690744-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-51353e63-mbkdq\" (UID: \"a496e211-8a19-49b4-976b-786985690744\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"
Jul 30 10:27:21.448245 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.448148    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"
Jul 30 10:27:21.588062 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.588019    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"]
Jul 30 10:27:21.590480 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:27:21.590450    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda496e211_8a19_49b4_976b_786985690744.slice/crio-0b7a4b10002787b6152f3235cafb7da7020dc82e1010a4a87a3a85260adac3d7 WatchSource:0}: Error finding container 0b7a4b10002787b6152f3235cafb7da7020dc82e1010a4a87a3a85260adac3d7: Status 404 returned error can't find the container with id 0b7a4b10002787b6152f3235cafb7da7020dc82e1010a4a87a3a85260adac3d7
Jul 30 10:27:21.800565 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:21.800529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq" event={"ID":"a496e211-8a19-49b4-976b-786985690744","Type":"ContainerStarted","Data":"0b7a4b10002787b6152f3235cafb7da7020dc82e1010a4a87a3a85260adac3d7"}
Jul 30 10:27:22.806490 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:22.806456    2581 generic.go:356] "Generic (PLEG): container finished" podID="a496e211-8a19-49b4-976b-786985690744" containerID="db4e5e5c35d65a90039f6a66569fd26af894a2c3cea8bbd482dcb294457157c4" exitCode=0
Jul 30 10:27:22.806901 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:22.806503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq" event={"ID":"a496e211-8a19-49b4-976b-786985690744","Type":"ContainerDied","Data":"db4e5e5c35d65a90039f6a66569fd26af894a2c3cea8bbd482dcb294457157c4"}
Jul 30 10:27:23.943679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:23.943649    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"
Jul 30 10:27:24.067916 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:24.067803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a496e211-8a19-49b4-976b-786985690744-maas-api-service-ca\") pod \"a496e211-8a19-49b4-976b-786985690744\" (UID: \"a496e211-8a19-49b4-976b-786985690744\") "
Jul 30 10:27:24.068154 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:24.068130    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a496e211-8a19-49b4-976b-786985690744-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a496e211-8a19-49b4-976b-786985690744" (UID: "a496e211-8a19-49b4-976b-786985690744"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:27:24.168619 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:24.168580    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a496e211-8a19-49b4-976b-786985690744-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:27:24.824011 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:24.823974    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"
Jul 30 10:27:24.824201 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:24.823970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq" event={"ID":"a496e211-8a19-49b4-976b-786985690744","Type":"ContainerDied","Data":"0b7a4b10002787b6152f3235cafb7da7020dc82e1010a4a87a3a85260adac3d7"}
Jul 30 10:27:24.824201 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:24.824131    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b7a4b10002787b6152f3235cafb7da7020dc82e1010a4a87a3a85260adac3d7"
Jul 30 10:27:31.507541 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.507508    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"]
Jul 30 10:27:31.510045 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.507719    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q" podUID="2b87c4b2-24ec-47fc-9429-7a7731e6123c" containerName="maas-api" containerID="cri-o://7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0" gracePeriod=30
Jul 30 10:27:31.532493 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.532462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:31.558780 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.558743    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"]
Jul 30 10:27:31.559040 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.559009    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf" podUID="b3ddcd58-e419-4442-ab1e-7695ee471d4e" containerName="payload-processing" containerID="cri-o://c5fc7ef210bd094af442f420fc7371836a67669f844eb6abafc74732712b1670" gracePeriod=30
Jul 30 10:27:31.573290 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.573263    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"]
Jul 30 10:27:31.573681 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.573655    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx" podUID="068d7d42-6540-4205-b780-861f5e59a13c" containerName="payload-pre-processing" containerID="cri-o://9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7" gracePeriod=30
Jul 30 10:27:31.599445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.599403    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:31.654131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.654056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:31.691368 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.691338    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"]
Jul 30 10:27:31.695967 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.695940    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-51353e63-mbkdq"]
Jul 30 10:27:31.710534 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.709671    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:31.849156 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.849129    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:27:31.852010 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.851987    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:27:31.859359 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.859330    2581 generic.go:356] "Generic (PLEG): container finished" podID="068d7d42-6540-4205-b780-861f5e59a13c" containerID="9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7" exitCode=0
Jul 30 10:27:31.859505 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.859372    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"
Jul 30 10:27:31.859505 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.859412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx" event={"ID":"068d7d42-6540-4205-b780-861f5e59a13c","Type":"ContainerDied","Data":"9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7"}
Jul 30 10:27:31.859622 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.859506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx" event={"ID":"068d7d42-6540-4205-b780-861f5e59a13c","Type":"ContainerDied","Data":"9287c3c857cb3eee8d3abf783eefa6dfd523cacce2988f65a6a6843523074462"}
Jul 30 10:27:31.859622 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.859539    2581 scope.go:117] "RemoveContainer" containerID="9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7"
Jul 30 10:27:31.861316 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.861293    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3ddcd58-e419-4442-ab1e-7695ee471d4e" containerID="c5fc7ef210bd094af442f420fc7371836a67669f844eb6abafc74732712b1670" exitCode=0
Jul 30 10:27:31.861429 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.861378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf" event={"ID":"b3ddcd58-e419-4442-ab1e-7695ee471d4e","Type":"ContainerDied","Data":"c5fc7ef210bd094af442f420fc7371836a67669f844eb6abafc74732712b1670"}
Jul 30 10:27:31.862777 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.862754    2581 generic.go:356] "Generic (PLEG): container finished" podID="2b87c4b2-24ec-47fc-9429-7a7731e6123c" containerID="7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0" exitCode=0
Jul 30 10:27:31.862905 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.862800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q" event={"ID":"2b87c4b2-24ec-47fc-9429-7a7731e6123c","Type":"ContainerDied","Data":"7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0"}
Jul 30 10:27:31.862905 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.862829    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"
Jul 30 10:27:31.862905 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.862859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q" event={"ID":"2b87c4b2-24ec-47fc-9429-7a7731e6123c","Type":"ContainerDied","Data":"cee68c19f3f7c3631ce9565aa3db6ae5863d41424aedfb5e18358e80551b2786"}
Jul 30 10:27:31.871673 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.871638    2581 scope.go:117] "RemoveContainer" containerID="9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7"
Jul 30 10:27:31.871966 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:27:31.871940    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7\": container with ID starting with 9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7 not found: ID does not exist" containerID="9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7"
Jul 30 10:27:31.872030 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.871982    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7"} err="failed to get container status \"9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7\": rpc error: code = NotFound desc = could not find container \"9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7\": container with ID starting with 9ed849ea291b9a4875cf8cedea726dd1c2350713e73e2d83b7aea597b3dc2ac7 not found: ID does not exist"
Jul 30 10:27:31.872030 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.872007    2581 scope.go:117] "RemoveContainer" containerID="7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0"
Jul 30 10:27:31.875328 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.875305    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:27:31.881085 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.881063    2581 scope.go:117] "RemoveContainer" containerID="7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0"
Jul 30 10:27:31.881437 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:27:31.881411    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0\": container with ID starting with 7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0 not found: ID does not exist" containerID="7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0"
Jul 30 10:27:31.881548 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.881446    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0"} err="failed to get container status \"7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0\": rpc error: code = NotFound desc = could not find container \"7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0\": container with ID starting with 7ce92821860926f1b40741253400b7d8cb45a033b15356b19b015c9eff906db0 not found: ID does not exist"
Jul 30 10:27:31.938890 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.938856    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw775\" (UniqueName: \"kubernetes.io/projected/2b87c4b2-24ec-47fc-9429-7a7731e6123c-kube-api-access-vw775\") pod \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") "
Jul 30 10:27:31.939083 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.938929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv5fq\" (UniqueName: \"kubernetes.io/projected/068d7d42-6540-4205-b780-861f5e59a13c-kube-api-access-rv5fq\") pod \"068d7d42-6540-4205-b780-861f5e59a13c\" (UID: \"068d7d42-6540-4205-b780-861f5e59a13c\") "
Jul 30 10:27:31.939083 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.939012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls\") pod \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") "
Jul 30 10:27:31.939083 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.939049    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/068d7d42-6540-4205-b780-861f5e59a13c-plugins-config-volume\") pod \"068d7d42-6540-4205-b780-861f5e59a13c\" (UID: \"068d7d42-6540-4205-b780-861f5e59a13c\") "
Jul 30 10:27:31.939083 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.939079    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b87c4b2-24ec-47fc-9429-7a7731e6123c-openshift-service-ca\") pod \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\" (UID: \"2b87c4b2-24ec-47fc-9429-7a7731e6123c\") "
Jul 30 10:27:31.939480 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.939446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/068d7d42-6540-4205-b780-861f5e59a13c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "068d7d42-6540-4205-b780-861f5e59a13c" (UID: "068d7d42-6540-4205-b780-861f5e59a13c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:27:31.939588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.939476    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b87c4b2-24ec-47fc-9429-7a7731e6123c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b87c4b2-24ec-47fc-9429-7a7731e6123c" (UID: "2b87c4b2-24ec-47fc-9429-7a7731e6123c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:27:31.941029 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.941003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068d7d42-6540-4205-b780-861f5e59a13c-kube-api-access-rv5fq" (OuterVolumeSpecName: "kube-api-access-rv5fq") pod "068d7d42-6540-4205-b780-861f5e59a13c" (UID: "068d7d42-6540-4205-b780-861f5e59a13c"). InnerVolumeSpecName "kube-api-access-rv5fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:27:31.941128 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.941034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b87c4b2-24ec-47fc-9429-7a7731e6123c-kube-api-access-vw775" (OuterVolumeSpecName: "kube-api-access-vw775") pod "2b87c4b2-24ec-47fc-9429-7a7731e6123c" (UID: "2b87c4b2-24ec-47fc-9429-7a7731e6123c"). InnerVolumeSpecName "kube-api-access-vw775". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:27:31.941128 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:31.941045    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b87c4b2-24ec-47fc-9429-7a7731e6123c" (UID: "2b87c4b2-24ec-47fc-9429-7a7731e6123c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:27:32.039949 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.039855    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3ddcd58-e419-4442-ab1e-7695ee471d4e-plugins-config-volume\") pod \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\" (UID: \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\") "
Jul 30 10:27:32.039949 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.039935    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m7lm\" (UniqueName: \"kubernetes.io/projected/b3ddcd58-e419-4442-ab1e-7695ee471d4e-kube-api-access-8m7lm\") pod \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\" (UID: \"b3ddcd58-e419-4442-ab1e-7695ee471d4e\") "
Jul 30 10:27:32.040198 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.040173    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3ddcd58-e419-4442-ab1e-7695ee471d4e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3ddcd58-e419-4442-ab1e-7695ee471d4e" (UID: "b3ddcd58-e419-4442-ab1e-7695ee471d4e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:27:32.040198 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.040191    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv5fq\" (UniqueName: \"kubernetes.io/projected/068d7d42-6540-4205-b780-861f5e59a13c-kube-api-access-rv5fq\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:27:32.040303 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.040211    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b87c4b2-24ec-47fc-9429-7a7731e6123c-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:27:32.040303 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.040226    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/068d7d42-6540-4205-b780-861f5e59a13c-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:27:32.040303 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.040241    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b87c4b2-24ec-47fc-9429-7a7731e6123c-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:27:32.040303 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.040255    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw775\" (UniqueName: \"kubernetes.io/projected/2b87c4b2-24ec-47fc-9429-7a7731e6123c-kube-api-access-vw775\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:27:32.041898 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.041878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ddcd58-e419-4442-ab1e-7695ee471d4e-kube-api-access-8m7lm" (OuterVolumeSpecName: "kube-api-access-8m7lm") pod "b3ddcd58-e419-4442-ab1e-7695ee471d4e" (UID: "b3ddcd58-e419-4442-ab1e-7695ee471d4e"). InnerVolumeSpecName "kube-api-access-8m7lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:27:32.085322 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.085288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:32.141550 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.141518    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m7lm\" (UniqueName: \"kubernetes.io/projected/b3ddcd58-e419-4442-ab1e-7695ee471d4e-kube-api-access-8m7lm\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:27:32.141550 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.141547    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3ddcd58-e419-4442-ab1e-7695ee471d4e-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:27:32.181800 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.181769    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"]
Jul 30 10:27:32.187257 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.187228    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx"]
Jul 30 10:27:32.196310 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.196286    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"]
Jul 30 10:27:32.199900 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.199879    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51353e63-98d4864bd-p2z5q"]
Jul 30 10:27:32.227410 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.227375    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="068d7d42-6540-4205-b780-861f5e59a13c" path="/var/lib/kubelet/pods/068d7d42-6540-4205-b780-861f5e59a13c/volumes"
Jul 30 10:27:32.227870 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.227850    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b87c4b2-24ec-47fc-9429-7a7731e6123c" path="/var/lib/kubelet/pods/2b87c4b2-24ec-47fc-9429-7a7731e6123c/volumes"
Jul 30 10:27:32.228208 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.228190    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a496e211-8a19-49b4-976b-786985690744" path="/var/lib/kubelet/pods/a496e211-8a19-49b4-976b-786985690744/volumes"
Jul 30 10:27:32.868766 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.868733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf" event={"ID":"b3ddcd58-e419-4442-ab1e-7695ee471d4e","Type":"ContainerDied","Data":"da01f23b6723c0915b2cde8455360526a2ccf59c9c607e2f076a4861f59dfeba"}
Jul 30 10:27:32.868766 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.868752    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"
Jul 30 10:27:32.869324 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.868799    2581 scope.go:117] "RemoveContainer" containerID="c5fc7ef210bd094af442f420fc7371836a67669f844eb6abafc74732712b1670"
Jul 30 10:27:32.883045 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.883016    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"]
Jul 30 10:27:32.887018 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:32.886993    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf"]
Jul 30 10:27:34.227482 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:34.227445    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3ddcd58-e419-4442-ab1e-7695ee471d4e" path="/var/lib/kubelet/pods/b3ddcd58-e419-4442-ab1e-7695ee471d4e/volumes"
Jul 30 10:27:37.935361 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:37.935329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:38.035014 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:38.034973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:38.195267 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:38.195183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:38.419650 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:38.419615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:38.840832 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:38.840794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:38.948255 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:38.948222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:44.943848 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:44.943795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:45.047398 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:45.047341    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:45.145031 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:45.144971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:45.314318 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:45.314285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:51.333143 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:51.333108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:27:51.430559 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:27:51.430520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:28:15.346288 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:28:15.346239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:28:17.406274 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:28:17.406235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:28:38.921875 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:28:38.921753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:00.100321 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:00.100281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:42.316350 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:42.316320    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:29:42.323754 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:42.323728    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:29:42.482125 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:42.482093    2581 scope.go:117] "RemoveContainer" containerID="65d71aba9459626dedc42c1e0eff7a7e2506e1a3ee100813fe9b8b2e1102eb6c"
Jul 30 10:29:42.490951 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:42.490926    2581 scope.go:117] "RemoveContainer" containerID="577ed59081cabe53f89274886b7f402d266dee323eb2b31a34d60212c0c2d086"
Jul 30 10:29:53.617678 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:53.617624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:54.010463 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:54.010347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:54.264880 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:54.264773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:56.947840 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:56.947778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:57.050966 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:57.050928    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:58.053510 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053474    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"]
Jul 30 10:29:58.053923 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053906    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b87c4b2-24ec-47fc-9429-7a7731e6123c" containerName="maas-api"
Jul 30 10:29:58.053972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053926    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b87c4b2-24ec-47fc-9429-7a7731e6123c" containerName="maas-api"
Jul 30 10:29:58.053972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053938    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a496e211-8a19-49b4-976b-786985690744" containerName="revoke-keys"
Jul 30 10:29:58.053972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053943    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a496e211-8a19-49b4-976b-786985690744" containerName="revoke-keys"
Jul 30 10:29:58.053972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053957    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ddcd58-e419-4442-ab1e-7695ee471d4e" containerName="payload-processing"
Jul 30 10:29:58.053972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053963    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ddcd58-e419-4442-ab1e-7695ee471d4e" containerName="payload-processing"
Jul 30 10:29:58.053972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053973    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068d7d42-6540-4205-b780-861f5e59a13c" containerName="payload-pre-processing"
Jul 30 10:29:58.054269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.053978    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="068d7d42-6540-4205-b780-861f5e59a13c" containerName="payload-pre-processing"
Jul 30 10:29:58.054269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.054032    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b87c4b2-24ec-47fc-9429-7a7731e6123c" containerName="maas-api"
Jul 30 10:29:58.054269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.054044    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="068d7d42-6540-4205-b780-861f5e59a13c" containerName="payload-pre-processing"
Jul 30 10:29:58.054269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.054053    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3ddcd58-e419-4442-ab1e-7695ee471d4e" containerName="payload-processing"
Jul 30 10:29:58.054269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.054061    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a496e211-8a19-49b4-976b-786985690744" containerName="revoke-keys"
Jul 30 10:29:58.057183 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.057158    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.059064 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.059041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2c013e89-serving-cert\""
Jul 30 10:29:58.068686 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.068662    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"]
Jul 30 10:29:58.086508 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.086474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:58.174617 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.174583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06427c8a-245c-4106-933c-704b17b4d407-openshift-service-ca\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.174793 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.174651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.174793 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.174693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwv2p\" (UniqueName: \"kubernetes.io/projected/06427c8a-245c-4106-933c-704b17b4d407-kube-api-access-gwv2p\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.275172 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.275133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.275172 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.275176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwv2p\" (UniqueName: \"kubernetes.io/projected/06427c8a-245c-4106-933c-704b17b4d407-kube-api-access-gwv2p\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.275392 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.275229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06427c8a-245c-4106-933c-704b17b4d407-openshift-service-ca\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.275392 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:29:58.275282    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-serving-cert: secret "maas-api-e2e-mt-2c013e89-serving-cert" not found
Jul 30 10:29:58.275392 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:29:58.275363    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls podName:06427c8a-245c-4106-933c-704b17b4d407 nodeName:}" failed. No retries permitted until 2026-07-30 10:29:58.775345581 +0000 UTC m=+2417.119409015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls") pod "maas-api-e2e-mt-2c013e89-f456dc466-bsxz5" (UID: "06427c8a-245c-4106-933c-704b17b4d407") : secret "maas-api-e2e-mt-2c013e89-serving-cert" not found
Jul 30 10:29:58.275945 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.275930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06427c8a-245c-4106-933c-704b17b4d407-openshift-service-ca\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.286196 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.286166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwv2p\" (UniqueName: \"kubernetes.io/projected/06427c8a-245c-4106-933c-704b17b4d407-kube-api-access-gwv2p\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.583415 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.583382    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:58.683483 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.683449    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:58.721421 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.721384    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"]
Jul 30 10:29:58.724937 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.724915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:58.727313 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.727293    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2c013e89\""
Jul 30 10:29:58.735312 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.735284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"]
Jul 30 10:29:58.742883 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.742857    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"]
Jul 30 10:29:58.746362 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.746339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:58.748362 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.748343    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2c013e89-dockercfg-pv9cz\""
Jul 30 10:29:58.755847 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.755807    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"]
Jul 30 10:29:58.779876 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.779848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.782339 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.782308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls\") pod \"maas-api-e2e-mt-2c013e89-f456dc466-bsxz5\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.881376 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.881279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72tcq\" (UniqueName: \"kubernetes.io/projected/e9a513ef-9db7-4a70-94e4-6dba257cdb12-kube-api-access-72tcq\") pod \"payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j\" (UID: \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\") " pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:58.881376 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.881352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4v2f\" (UniqueName: \"kubernetes.io/projected/7f9444c7-b236-4c84-96cf-c352f0248858-kube-api-access-t4v2f\") pod \"payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk\" (UID: \"7f9444c7-b236-4c84-96cf-c352f0248858\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:58.881571 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.881412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a513ef-9db7-4a70-94e4-6dba257cdb12-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j\" (UID: \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\") " pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:58.881571 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.881461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9444c7-b236-4c84-96cf-c352f0248858-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk\" (UID: \"7f9444c7-b236-4c84-96cf-c352f0248858\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:58.968173 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.968130    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:29:58.982427 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.982395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4v2f\" (UniqueName: \"kubernetes.io/projected/7f9444c7-b236-4c84-96cf-c352f0248858-kube-api-access-t4v2f\") pod \"payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk\" (UID: \"7f9444c7-b236-4c84-96cf-c352f0248858\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:58.982568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.982443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a513ef-9db7-4a70-94e4-6dba257cdb12-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j\" (UID: \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\") " pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:58.982568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.982482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9444c7-b236-4c84-96cf-c352f0248858-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk\" (UID: \"7f9444c7-b236-4c84-96cf-c352f0248858\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:58.982568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.982522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72tcq\" (UniqueName: \"kubernetes.io/projected/e9a513ef-9db7-4a70-94e4-6dba257cdb12-kube-api-access-72tcq\") pod \"payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j\" (UID: \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\") " pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:58.983247 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.983226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9444c7-b236-4c84-96cf-c352f0248858-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk\" (UID: \"7f9444c7-b236-4c84-96cf-c352f0248858\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:58.983334 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.983244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a513ef-9db7-4a70-94e4-6dba257cdb12-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j\" (UID: \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\") " pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:58.994776 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.994740    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4v2f\" (UniqueName: \"kubernetes.io/projected/7f9444c7-b236-4c84-96cf-c352f0248858-kube-api-access-t4v2f\") pod \"payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk\" (UID: \"7f9444c7-b236-4c84-96cf-c352f0248858\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:58.994924 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:58.994835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72tcq\" (UniqueName: \"kubernetes.io/projected/e9a513ef-9db7-4a70-94e4-6dba257cdb12-kube-api-access-72tcq\") pod \"payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j\" (UID: \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\") " pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:59.038031 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.037996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:59.057547 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.057513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:59.120972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.120944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"]
Jul 30 10:29:59.123441 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:29:59.123378    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06427c8a_245c_4106_933c_704b17b4d407.slice/crio-d3b218bcc983413f195fbf686991170668519282ea5bec6b77fd27f16f73f6f4 WatchSource:0}: Error finding container d3b218bcc983413f195fbf686991170668519282ea5bec6b77fd27f16f73f6f4: Status 404 returned error can't find the container with id d3b218bcc983413f195fbf686991170668519282ea5bec6b77fd27f16f73f6f4
Jul 30 10:29:59.125477 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.125236    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:29:59.145434 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.145373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:29:59.196374 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.196342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"]
Jul 30 10:29:59.197995 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:29:59.197960    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9444c7_b236_4c84_96cf_c352f0248858.slice/crio-8d309b1fa74b918a1907c0cecde0fef126652e3491a69dc4b61f26370fb6e344 WatchSource:0}: Error finding container 8d309b1fa74b918a1907c0cecde0fef126652e3491a69dc4b61f26370fb6e344: Status 404 returned error can't find the container with id 8d309b1fa74b918a1907c0cecde0fef126652e3491a69dc4b61f26370fb6e344
Jul 30 10:29:59.224384 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.224360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"]
Jul 30 10:29:59.228990 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:29:59.228967    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a513ef_9db7_4a70_94e4_6dba257cdb12.slice/crio-4f3d149ba04794b6547f3b6524f94a6b2ef6f424f3d435fc0d568a7d0fd8ba0c WatchSource:0}: Error finding container 4f3d149ba04794b6547f3b6524f94a6b2ef6f424f3d435fc0d568a7d0fd8ba0c: Status 404 returned error can't find the container with id 4f3d149ba04794b6547f3b6524f94a6b2ef6f424f3d435fc0d568a7d0fd8ba0c
Jul 30 10:29:59.577734 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.577696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j" event={"ID":"e9a513ef-9db7-4a70-94e4-6dba257cdb12","Type":"ContainerStarted","Data":"deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365"}
Jul 30 10:29:59.577971 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.577761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j" event={"ID":"e9a513ef-9db7-4a70-94e4-6dba257cdb12","Type":"ContainerStarted","Data":"4f3d149ba04794b6547f3b6524f94a6b2ef6f424f3d435fc0d568a7d0fd8ba0c"}
Jul 30 10:29:59.577971 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.577792    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:29:59.579109 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.579084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5" event={"ID":"06427c8a-245c-4106-933c-704b17b4d407","Type":"ContainerStarted","Data":"d3b218bcc983413f195fbf686991170668519282ea5bec6b77fd27f16f73f6f4"}
Jul 30 10:29:59.580660 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.580635    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk" event={"ID":"7f9444c7-b236-4c84-96cf-c352f0248858","Type":"ContainerStarted","Data":"4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e"}
Jul 30 10:29:59.580745 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.580675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk" event={"ID":"7f9444c7-b236-4c84-96cf-c352f0248858","Type":"ContainerStarted","Data":"8d309b1fa74b918a1907c0cecde0fef126652e3491a69dc4b61f26370fb6e344"}
Jul 30 10:29:59.580797 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.580750    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:29:59.597636 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.597581    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j" podStartSLOduration=1.597559513 podStartE2EDuration="1.597559513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:29:59.594836591 +0000 UTC m=+2417.938900039" watchObservedRunningTime="2026-07-30 10:29:59.597559513 +0000 UTC m=+2417.941622970"
Jul 30 10:29:59.614863 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:29:59.614776    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk" podStartSLOduration=1.614759275 podStartE2EDuration="1.614759275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:29:59.613874317 +0000 UTC m=+2417.957937773" watchObservedRunningTime="2026-07-30 10:29:59.614759275 +0000 UTC m=+2417.958822731"
Jul 30 10:30:00.138363 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.138330    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd"]
Jul 30 10:30:00.142064 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.142033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd"
Jul 30 10:30:00.142700 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.142671    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"]
Jul 30 10:30:00.143992 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.143971    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:30:00.146595 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.146571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"
Jul 30 10:30:00.149329 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.149302    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd"]
Jul 30 10:30:00.154125 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.154101    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"]
Jul 30 10:30:00.156266 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.156245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd"
Jul 30 10:30:00.165711 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.165685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"
Jul 30 10:30:00.319187 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.319153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd"]
Jul 30 10:30:00.322735 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:30:00.322707    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf036f477_a4fe_483e_b1b6_18e3775e6382.slice/crio-691b37eef72a5608dcf55185820e632dcdf268fa82fb52a67e9672faf390552c WatchSource:0}: Error finding container 691b37eef72a5608dcf55185820e632dcdf268fa82fb52a67e9672faf390552c: Status 404 returned error can't find the container with id 691b37eef72a5608dcf55185820e632dcdf268fa82fb52a67e9672faf390552c
Jul 30 10:30:00.336360 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.336330    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"]
Jul 30 10:30:00.338355 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:30:00.338319    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode041ec11_c781_4a92_9ce5_53c212fbae52.slice/crio-464fc6e875432bc875c9087b30c36046715f65ec959e0d3fd4ddff1172f6dc48 WatchSource:0}: Error finding container 464fc6e875432bc875c9087b30c36046715f65ec959e0d3fd4ddff1172f6dc48: Status 404 returned error can't find the container with id 464fc6e875432bc875c9087b30c36046715f65ec959e0d3fd4ddff1172f6dc48
Jul 30 10:30:00.588541 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.588505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5" event={"ID":"06427c8a-245c-4106-933c-704b17b4d407","Type":"ContainerStarted","Data":"c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d"}
Jul 30 10:30:00.588734 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.588682    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:30:00.589869 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.589839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" event={"ID":"e041ec11-c781-4a92-9ce5-53c212fbae52","Type":"ContainerStarted","Data":"464fc6e875432bc875c9087b30c36046715f65ec959e0d3fd4ddff1172f6dc48"}
Jul 30 10:30:00.591043 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.591020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd" event={"ID":"f036f477-a4fe-483e-b1b6-18e3775e6382","Type":"ContainerStarted","Data":"691b37eef72a5608dcf55185820e632dcdf268fa82fb52a67e9672faf390552c"}
Jul 30 10:30:00.604081 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:00.604017    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5" podStartSLOduration=2.139255218 podStartE2EDuration="2.603722259s" totalImagesPullingTime="464.467041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:30:00.603226462 +0000 UTC m=+2418.947289921" watchObservedRunningTime="2026-07-30 10:30:00.603722259 +0000 UTC m=+2418.947785715"
Jul 30 10:30:01.598700 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:01.598613    2581 generic.go:356] "Generic (PLEG): container finished" podID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerID="9395e31e3e6a42fc9c47b4031eeec2880a1e77e1e0d48ddb4c401fad61b9dccb" exitCode=7
Jul 30 10:30:01.599186 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:01.598695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" event={"ID":"e041ec11-c781-4a92-9ce5-53c212fbae52","Type":"ContainerDied","Data":"9395e31e3e6a42fc9c47b4031eeec2880a1e77e1e0d48ddb4c401fad61b9dccb"}
Jul 30 10:30:01.599186 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:01.598846    2581 scope.go:117] "RemoveContainer" containerID="9395e31e3e6a42fc9c47b4031eeec2880a1e77e1e0d48ddb4c401fad61b9dccb"
Jul 30 10:30:01.600389 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:01.600366    2581 generic.go:356] "Generic (PLEG): container finished" podID="f036f477-a4fe-483e-b1b6-18e3775e6382" containerID="5ff15705484c3976eb9d47feb1a8ea0d0700d94367514b5653357d90de8a811f" exitCode=0
Jul 30 10:30:01.600489 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:01.600445    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd" event={"ID":"f036f477-a4fe-483e-b1b6-18e3775e6382","Type":"ContainerDied","Data":"5ff15705484c3976eb9d47feb1a8ea0d0700d94367514b5653357d90de8a811f"}
Jul 30 10:30:02.607158 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:02.607111    2581 generic.go:356] "Generic (PLEG): container finished" podID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerID="5beb5d1829c859841759d964c1c4d37bd267dfd205c37a727fd4680bf0fb87b8" exitCode=7
Jul 30 10:30:02.607596 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:02.607196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" event={"ID":"e041ec11-c781-4a92-9ce5-53c212fbae52","Type":"ContainerDied","Data":"5beb5d1829c859841759d964c1c4d37bd267dfd205c37a727fd4680bf0fb87b8"}
Jul 30 10:30:02.607596 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:02.607255    2581 scope.go:117] "RemoveContainer" containerID="9395e31e3e6a42fc9c47b4031eeec2880a1e77e1e0d48ddb4c401fad61b9dccb"
Jul 30 10:30:02.607596 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:02.607435    2581 scope.go:117] "RemoveContainer" containerID="5beb5d1829c859841759d964c1c4d37bd267dfd205c37a727fd4680bf0fb87b8"
Jul 30 10:30:02.608034 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:30:02.607690    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8_odh-ai-gateway-infra(e041ec11-c781-4a92-9ce5-53c212fbae52)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52"
Jul 30 10:30:02.742408 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:02.742383    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd"
Jul 30 10:30:03.619607 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:03.619575    2581 scope.go:117] "RemoveContainer" containerID="5beb5d1829c859841759d964c1c4d37bd267dfd205c37a727fd4680bf0fb87b8"
Jul 30 10:30:03.620088 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:30:03.619780    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8_odh-ai-gateway-infra(e041ec11-c781-4a92-9ce5-53c212fbae52)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52"
Jul 30 10:30:03.620744 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:03.620730    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd"
Jul 30 10:30:03.620849 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:03.620726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756790-hfztd" event={"ID":"f036f477-a4fe-483e-b1b6-18e3775e6382","Type":"ContainerDied","Data":"691b37eef72a5608dcf55185820e632dcdf268fa82fb52a67e9672faf390552c"}
Jul 30 10:30:03.620914 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:03.620901    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="691b37eef72a5608dcf55185820e632dcdf268fa82fb52a67e9672faf390552c"
Jul 30 10:30:06.606411 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:06.606385    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:30:10.593300 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:10.593263    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:30:10.593677 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:10.593335    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:30:16.233323 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:16.233292    2581 scope.go:117] "RemoveContainer" containerID="5beb5d1829c859841759d964c1c4d37bd267dfd205c37a727fd4680bf0fb87b8"
Jul 30 10:30:16.687990 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:16.687956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" event={"ID":"e041ec11-c781-4a92-9ce5-53c212fbae52","Type":"ContainerStarted","Data":"70d5cbb3eacb9e6e42f79fd9a06781a3508d530d114ef56a4fed8e23cba9907f"}
Jul 30 10:30:16.702989 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:16.702938    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" podStartSLOduration=16.702922454 podStartE2EDuration="16.702922454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:30:16.701551338 +0000 UTC m=+2435.045614793" watchObservedRunningTime="2026-07-30 10:30:16.702922454 +0000 UTC m=+2435.046986251"
Jul 30 10:30:17.694382 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:17.694345    2581 generic.go:356] "Generic (PLEG): container finished" podID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerID="70d5cbb3eacb9e6e42f79fd9a06781a3508d530d114ef56a4fed8e23cba9907f" exitCode=0
Jul 30 10:30:17.694776 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:17.694410    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" event={"ID":"e041ec11-c781-4a92-9ce5-53c212fbae52","Type":"ContainerDied","Data":"70d5cbb3eacb9e6e42f79fd9a06781a3508d530d114ef56a4fed8e23cba9907f"}
Jul 30 10:30:17.694776 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:17.694458    2581 scope.go:117] "RemoveContainer" containerID="5beb5d1829c859841759d964c1c4d37bd267dfd205c37a727fd4680bf0fb87b8"
Jul 30 10:30:17.718372 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:17.718342    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"]
Jul 30 10:30:18.833268 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:18.833243    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"
Jul 30 10:30:19.706854 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:19.706803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8" event={"ID":"e041ec11-c781-4a92-9ce5-53c212fbae52","Type":"ContainerDied","Data":"464fc6e875432bc875c9087b30c36046715f65ec959e0d3fd4ddff1172f6dc48"}
Jul 30 10:30:19.706854 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:19.706837    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"
Jul 30 10:30:19.707088 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:19.706871    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="464fc6e875432bc875c9087b30c36046715f65ec959e0d3fd4ddff1172f6dc48"
Jul 30 10:30:19.735774 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:19.735744    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"]
Jul 30 10:30:19.740957 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:19.740932    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2c013e89-29756790-xlzd8"]
Jul 30 10:30:20.227529 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:20.227488    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" path="/var/lib/kubelet/pods/e041ec11-c781-4a92-9ce5-53c212fbae52/volumes"
Jul 30 10:30:21.994925 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:21.994887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:30:35.872882 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:35.872845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:30:42.513769 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:42.513734    2581 scope.go:117] "RemoveContainer" containerID="179ec77c7f19bbe1236dfac4c738e4293b0f87ce53f5820b2bca93f47a46d1fe"
Jul 30 10:30:42.522256 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:42.522233    2581 scope.go:117] "RemoveContainer" containerID="6438908e284d9f45a69ed89612221f260ef4e7c060168fed4c06a0f4cd061cac"
Jul 30 10:30:47.532979 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:30:47.532948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:31:27.642093 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642057    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"]
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642465    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642478    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642493    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f036f477-a4fe-483e-b1b6-18e3775e6382" containerName="cleanup"
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642498    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f036f477-a4fe-483e-b1b6-18e3775e6382" containerName="cleanup"
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642518    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642526    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642585    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f036f477-a4fe-483e-b1b6-18e3775e6382" containerName="cleanup"
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642594    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:31:27.642599 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.642601    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:31:27.645908 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.645890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"
Jul 30 10:31:27.648021 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.647999    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:31:27.653769 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.653402    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"]
Jul 30 10:31:27.799884 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.799842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31081dd5-36fd-4447-be85-193881216a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9\" (UID: \"31081dd5-36fd-4447-be85-193881216a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"
Jul 30 10:31:27.900723 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.900633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31081dd5-36fd-4447-be85-193881216a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9\" (UID: \"31081dd5-36fd-4447-be85-193881216a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"
Jul 30 10:31:27.901303 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.901282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31081dd5-36fd-4447-be85-193881216a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9\" (UID: \"31081dd5-36fd-4447-be85-193881216a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"
Jul 30 10:31:27.958587 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:27.958550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"
Jul 30 10:31:28.096304 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:28.096271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"]
Jul 30 10:31:28.102244 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:31:28.102203    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31081dd5_36fd_4447_be85_193881216a25.slice/crio-ab038bb72bb3449aca7331f3ec5d0570f7e8b2e5f49ed5f7aa5a0d3cd657a51e WatchSource:0}: Error finding container ab038bb72bb3449aca7331f3ec5d0570f7e8b2e5f49ed5f7aa5a0d3cd657a51e: Status 404 returned error can't find the container with id ab038bb72bb3449aca7331f3ec5d0570f7e8b2e5f49ed5f7aa5a0d3cd657a51e
Jul 30 10:31:29.046430 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:29.046396    2581 generic.go:356] "Generic (PLEG): container finished" podID="31081dd5-36fd-4447-be85-193881216a25" containerID="d020898c0f53fd8a901a753bac1a11b7d68cc4dfcecea2752f966c6fd50f5b5b" exitCode=0
Jul 30 10:31:29.046840 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:29.046480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9" event={"ID":"31081dd5-36fd-4447-be85-193881216a25","Type":"ContainerDied","Data":"d020898c0f53fd8a901a753bac1a11b7d68cc4dfcecea2752f966c6fd50f5b5b"}
Jul 30 10:31:29.046840 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:29.046534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9" event={"ID":"31081dd5-36fd-4447-be85-193881216a25","Type":"ContainerStarted","Data":"ab038bb72bb3449aca7331f3ec5d0570f7e8b2e5f49ed5f7aa5a0d3cd657a51e"}
Jul 30 10:31:30.184239 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:30.184213    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"
Jul 30 10:31:30.320028 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:30.319995    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31081dd5-36fd-4447-be85-193881216a25-maas-api-service-ca\") pod \"31081dd5-36fd-4447-be85-193881216a25\" (UID: \"31081dd5-36fd-4447-be85-193881216a25\") "
Jul 30 10:31:30.320369 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:30.320337    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31081dd5-36fd-4447-be85-193881216a25-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31081dd5-36fd-4447-be85-193881216a25" (UID: "31081dd5-36fd-4447-be85-193881216a25"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:31:30.320515 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:30.320448    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31081dd5-36fd-4447-be85-193881216a25-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:31:31.057681 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:31.057652    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"
Jul 30 10:31:31.057899 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:31.057685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9" event={"ID":"31081dd5-36fd-4447-be85-193881216a25","Type":"ContainerDied","Data":"ab038bb72bb3449aca7331f3ec5d0570f7e8b2e5f49ed5f7aa5a0d3cd657a51e"}
Jul 30 10:31:31.057899 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:31.057732    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab038bb72bb3449aca7331f3ec5d0570f7e8b2e5f49ed5f7aa5a0d3cd657a51e"
Jul 30 10:31:37.637606 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.637526    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"]
Jul 30 10:31:37.638114 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.637748    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5" podUID="06427c8a-245c-4106-933c-704b17b4d407" containerName="maas-api" containerID="cri-o://c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d" gracePeriod=30
Jul 30 10:31:37.672535 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.672490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:31:37.696695 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.696654    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"]
Jul 30 10:31:37.696944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.696916    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j" podUID="e9a513ef-9db7-4a70-94e4-6dba257cdb12" containerName="payload-processing" containerID="cri-o://deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365" gracePeriod=30
Jul 30 10:31:37.703432 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.703402    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"]
Jul 30 10:31:37.703686 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.703635    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk" podUID="7f9444c7-b236-4c84-96cf-c352f0248858" containerName="payload-pre-processing" containerID="cri-o://4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e" gracePeriod=30
Jul 30 10:31:37.740505 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.740470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:31:37.802708 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.802671    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:31:37.866114 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.866079    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"]
Jul 30 10:31:37.868965 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.868924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:31:37.870238 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.869944    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2c013e89-6zgn9"]
Jul 30 10:31:37.951433 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.951405    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:31:37.968517 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.968493    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:31:37.992910 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.992877    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls\") pod \"06427c8a-245c-4106-933c-704b17b4d407\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") "
Jul 30 10:31:37.993099 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.992924    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72tcq\" (UniqueName: \"kubernetes.io/projected/e9a513ef-9db7-4a70-94e4-6dba257cdb12-kube-api-access-72tcq\") pod \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\" (UID: \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\") "
Jul 30 10:31:37.993099 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.992957    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwv2p\" (UniqueName: \"kubernetes.io/projected/06427c8a-245c-4106-933c-704b17b4d407-kube-api-access-gwv2p\") pod \"06427c8a-245c-4106-933c-704b17b4d407\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") "
Jul 30 10:31:37.993238 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.993088    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a513ef-9db7-4a70-94e4-6dba257cdb12-plugins-config-volume\") pod \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\" (UID: \"e9a513ef-9db7-4a70-94e4-6dba257cdb12\") "
Jul 30 10:31:37.993238 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.993129    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06427c8a-245c-4106-933c-704b17b4d407-openshift-service-ca\") pod \"06427c8a-245c-4106-933c-704b17b4d407\" (UID: \"06427c8a-245c-4106-933c-704b17b4d407\") "
Jul 30 10:31:37.993520 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.993491    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a513ef-9db7-4a70-94e4-6dba257cdb12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e9a513ef-9db7-4a70-94e4-6dba257cdb12" (UID: "e9a513ef-9db7-4a70-94e4-6dba257cdb12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:31:37.993702 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.993679    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06427c8a-245c-4106-933c-704b17b4d407-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06427c8a-245c-4106-933c-704b17b4d407" (UID: "06427c8a-245c-4106-933c-704b17b4d407"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:31:37.995180 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.995148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06427c8a-245c-4106-933c-704b17b4d407" (UID: "06427c8a-245c-4106-933c-704b17b4d407"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:31:37.995336 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.995313    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06427c8a-245c-4106-933c-704b17b4d407-kube-api-access-gwv2p" (OuterVolumeSpecName: "kube-api-access-gwv2p") pod "06427c8a-245c-4106-933c-704b17b4d407" (UID: "06427c8a-245c-4106-933c-704b17b4d407"). InnerVolumeSpecName "kube-api-access-gwv2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:31:37.995437 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:37.995405    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a513ef-9db7-4a70-94e4-6dba257cdb12-kube-api-access-72tcq" (OuterVolumeSpecName: "kube-api-access-72tcq") pod "e9a513ef-9db7-4a70-94e4-6dba257cdb12" (UID: "e9a513ef-9db7-4a70-94e4-6dba257cdb12"). InnerVolumeSpecName "kube-api-access-72tcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:31:38.005747 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.005723    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:31:38.093888 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.093856    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4v2f\" (UniqueName: \"kubernetes.io/projected/7f9444c7-b236-4c84-96cf-c352f0248858-kube-api-access-t4v2f\") pod \"7f9444c7-b236-4c84-96cf-c352f0248858\" (UID: \"7f9444c7-b236-4c84-96cf-c352f0248858\") "
Jul 30 10:31:38.094101 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.093956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9444c7-b236-4c84-96cf-c352f0248858-plugins-config-volume\") pod \"7f9444c7-b236-4c84-96cf-c352f0248858\" (UID: \"7f9444c7-b236-4c84-96cf-c352f0248858\") "
Jul 30 10:31:38.094204 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.094190    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06427c8a-245c-4106-933c-704b17b4d407-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:31:38.094263 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.094210    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72tcq\" (UniqueName: \"kubernetes.io/projected/e9a513ef-9db7-4a70-94e4-6dba257cdb12-kube-api-access-72tcq\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:31:38.094263 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.094228    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwv2p\" (UniqueName: \"kubernetes.io/projected/06427c8a-245c-4106-933c-704b17b4d407-kube-api-access-gwv2p\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:31:38.094263 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.094241    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a513ef-9db7-4a70-94e4-6dba257cdb12-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:31:38.094263 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.094252    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06427c8a-245c-4106-933c-704b17b4d407-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:31:38.094479 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.094347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f9444c7-b236-4c84-96cf-c352f0248858-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f9444c7-b236-4c84-96cf-c352f0248858" (UID: "7f9444c7-b236-4c84-96cf-c352f0248858"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:31:38.095063 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.095038    2581 generic.go:356] "Generic (PLEG): container finished" podID="06427c8a-245c-4106-933c-704b17b4d407" containerID="c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d" exitCode=0
Jul 30 10:31:38.095191 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.095083    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"
Jul 30 10:31:38.095191 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.095139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5" event={"ID":"06427c8a-245c-4106-933c-704b17b4d407","Type":"ContainerDied","Data":"c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d"}
Jul 30 10:31:38.095306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.095196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5" event={"ID":"06427c8a-245c-4106-933c-704b17b4d407","Type":"ContainerDied","Data":"d3b218bcc983413f195fbf686991170668519282ea5bec6b77fd27f16f73f6f4"}
Jul 30 10:31:38.095306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.095218    2581 scope.go:117] "RemoveContainer" containerID="c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d"
Jul 30 10:31:38.096434 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.096402    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f9444c7-b236-4c84-96cf-c352f0248858-kube-api-access-t4v2f" (OuterVolumeSpecName: "kube-api-access-t4v2f") pod "7f9444c7-b236-4c84-96cf-c352f0248858" (UID: "7f9444c7-b236-4c84-96cf-c352f0248858"). InnerVolumeSpecName "kube-api-access-t4v2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:31:38.096554 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.096531    2581 generic.go:356] "Generic (PLEG): container finished" podID="7f9444c7-b236-4c84-96cf-c352f0248858" containerID="4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e" exitCode=0
Jul 30 10:31:38.096623 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.096566    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"
Jul 30 10:31:38.096698 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.096670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk" event={"ID":"7f9444c7-b236-4c84-96cf-c352f0248858","Type":"ContainerDied","Data":"4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e"}
Jul 30 10:31:38.096794 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.096737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk" event={"ID":"7f9444c7-b236-4c84-96cf-c352f0248858","Type":"ContainerDied","Data":"8d309b1fa74b918a1907c0cecde0fef126652e3491a69dc4b61f26370fb6e344"}
Jul 30 10:31:38.098033 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.097991    2581 generic.go:356] "Generic (PLEG): container finished" podID="e9a513ef-9db7-4a70-94e4-6dba257cdb12" containerID="deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365" exitCode=0
Jul 30 10:31:38.098033 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.098030    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"
Jul 30 10:31:38.098033 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.098035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j" event={"ID":"e9a513ef-9db7-4a70-94e4-6dba257cdb12","Type":"ContainerDied","Data":"deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365"}
Jul 30 10:31:38.098230 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.098070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j" event={"ID":"e9a513ef-9db7-4a70-94e4-6dba257cdb12","Type":"ContainerDied","Data":"4f3d149ba04794b6547f3b6524f94a6b2ef6f424f3d435fc0d568a7d0fd8ba0c"}
Jul 30 10:31:38.106470 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.106442    2581 scope.go:117] "RemoveContainer" containerID="c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d"
Jul 30 10:31:38.106843 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:31:38.106787    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d\": container with ID starting with c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d not found: ID does not exist" containerID="c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d"
Jul 30 10:31:38.106950 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.106845    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d"} err="failed to get container status \"c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d\": rpc error: code = NotFound desc = could not find container \"c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d\": container with ID starting with c1ee6a6740c90008c75188e5e0b16d3793d54eeb4916228676577a31ae52611d not found: ID does not exist"
Jul 30 10:31:38.106950 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.106888    2581 scope.go:117] "RemoveContainer" containerID="4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e"
Jul 30 10:31:38.115411 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.115381    2581 scope.go:117] "RemoveContainer" containerID="4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e"
Jul 30 10:31:38.115694 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:31:38.115674    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e\": container with ID starting with 4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e not found: ID does not exist" containerID="4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e"
Jul 30 10:31:38.115774 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.115705    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e"} err="failed to get container status \"4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e\": rpc error: code = NotFound desc = could not find container \"4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e\": container with ID starting with 4d9b346dc3c356d9be86a7b86ecce0594e85b7102af30eee9388f912fefb168e not found: ID does not exist"
Jul 30 10:31:38.115774 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.115730    2581 scope.go:117] "RemoveContainer" containerID="deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365"
Jul 30 10:31:38.122694 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.122666    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"]
Jul 30 10:31:38.124011 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.123995    2581 scope.go:117] "RemoveContainer" containerID="deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365"
Jul 30 10:31:38.124286 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:31:38.124267    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365\": container with ID starting with deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365 not found: ID does not exist" containerID="deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365"
Jul 30 10:31:38.124337 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.124294    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365"} err="failed to get container status \"deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365\": rpc error: code = NotFound desc = could not find container \"deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365\": container with ID starting with deed156462eccf21284efcb36d4b9ca5b10ee62ae648722373a7d43ad2fe0365 not found: ID does not exist"
Jul 30 10:31:38.129640 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.129615    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c013e89-f456dc466-bsxz5"]
Jul 30 10:31:38.142056 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.142027    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"]
Jul 30 10:31:38.146158 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.146131    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk"]
Jul 30 10:31:38.157267 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.157189    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"]
Jul 30 10:31:38.165329 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.165303    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j"]
Jul 30 10:31:38.194934 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.194885    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4v2f\" (UniqueName: \"kubernetes.io/projected/7f9444c7-b236-4c84-96cf-c352f0248858-kube-api-access-t4v2f\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:31:38.194934 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.194930    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9444c7-b236-4c84-96cf-c352f0248858-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:31:38.228214 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.228182    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06427c8a-245c-4106-933c-704b17b4d407" path="/var/lib/kubelet/pods/06427c8a-245c-4106-933c-704b17b4d407/volumes"
Jul 30 10:31:38.228504 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.228492    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31081dd5-36fd-4447-be85-193881216a25" path="/var/lib/kubelet/pods/31081dd5-36fd-4447-be85-193881216a25/volumes"
Jul 30 10:31:38.228827 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.228802    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f9444c7-b236-4c84-96cf-c352f0248858" path="/var/lib/kubelet/pods/7f9444c7-b236-4c84-96cf-c352f0248858/volumes"
Jul 30 10:31:38.229152 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:38.229139    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a513ef-9db7-4a70-94e4-6dba257cdb12" path="/var/lib/kubelet/pods/e9a513ef-9db7-4a70-94e4-6dba257cdb12/volumes"
Jul 30 10:31:41.250050 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:41.250015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:31:46.274207 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:31:46.274168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:22.859837 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:22.859777    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:24.324837 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:24.324779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:29.149827 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:29.149782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:34.888564 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:34.888529    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:34.945031 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:34.944998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:35.181169 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:35.181083    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:35.442167 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:35.442084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:38.171466 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:38.171427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:57.036962 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:57.036921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:57.130774 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:57.130723    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:57.232954 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:57.232838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:57.895228 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:57.895189    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:57.999071 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:57.999016    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:58.093614 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:58.093569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:32:59.423487 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:32:59.423451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:05.326737 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:05.326654    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:05.424770 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:05.424731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:06.061748 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:06.061713    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:11.610402 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:11.610364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:11.714990 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:11.714951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:11.810489 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:11.810454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:22.348046 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:22.348004    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:26.170759 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:26.170725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:42.574408 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:42.574375    2581 scope.go:117] "RemoveContainer" containerID="db4e5e5c35d65a90039f6a66569fd26af894a2c3cea8bbd482dcb294457157c4"
Jul 30 10:33:43.694311 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:43.694275    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:45.664631 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:45.664594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:50.037835 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:50.037798    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:50.138530 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:50.138495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:50.487380 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:50.487348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:50.736371 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:50.736317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:51.051753 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:51.051718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:53.278052 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:53.278015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:53.376344 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:53.376299    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:54.358201 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358165    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"]
Jul 30 10:33:54.358753 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358733    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06427c8a-245c-4106-933c-704b17b4d407" containerName="maas-api"
Jul 30 10:33:54.358797 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358760    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06427c8a-245c-4106-933c-704b17b4d407" containerName="maas-api"
Jul 30 10:33:54.358797 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358779    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:33:54.358797 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358788    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:33:54.358921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358830    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31081dd5-36fd-4447-be85-193881216a25" containerName="revoke-keys"
Jul 30 10:33:54.358921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358840    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="31081dd5-36fd-4447-be85-193881216a25" containerName="revoke-keys"
Jul 30 10:33:54.358921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358870    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f9444c7-b236-4c84-96cf-c352f0248858" containerName="payload-pre-processing"
Jul 30 10:33:54.358921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358878    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f9444c7-b236-4c84-96cf-c352f0248858" containerName="payload-pre-processing"
Jul 30 10:33:54.358921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358889    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a513ef-9db7-4a70-94e4-6dba257cdb12" containerName="payload-processing"
Jul 30 10:33:54.358921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a513ef-9db7-4a70-94e4-6dba257cdb12" containerName="payload-processing"
Jul 30 10:33:54.359185 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.358992    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06427c8a-245c-4106-933c-704b17b4d407" containerName="maas-api"
Jul 30 10:33:54.359185 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.359007    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a513ef-9db7-4a70-94e4-6dba257cdb12" containerName="payload-processing"
Jul 30 10:33:54.359185 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.359016    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e041ec11-c781-4a92-9ce5-53c212fbae52" containerName="cleanup"
Jul 30 10:33:54.359185 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.359029    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f9444c7-b236-4c84-96cf-c352f0248858" containerName="payload-pre-processing"
Jul 30 10:33:54.359185 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.359038    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="31081dd5-36fd-4447-be85-193881216a25" containerName="revoke-keys"
Jul 30 10:33:54.362524 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.362502    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.364921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.364899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-98c9c7-serving-cert\""
Jul 30 10:33:54.372398 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.372371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"]
Jul 30 10:33:54.395418 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.395382    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:54.472482 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.472438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntrrz\" (UniqueName: \"kubernetes.io/projected/65f9a836-ba4e-44f0-b50b-520234b6216e-kube-api-access-ntrrz\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.472679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.472538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.472679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.472557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65f9a836-ba4e-44f0-b50b-520234b6216e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.573113 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.573073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntrrz\" (UniqueName: \"kubernetes.io/projected/65f9a836-ba4e-44f0-b50b-520234b6216e-kube-api-access-ntrrz\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.573318 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.573245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.573318 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.573284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65f9a836-ba4e-44f0-b50b-520234b6216e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.573466 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:33:54.573362    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-serving-cert: secret "maas-api-e2e-inf-a-98c9c7-serving-cert" not found
Jul 30 10:33:54.573466 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:33:54.573429    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls podName:65f9a836-ba4e-44f0-b50b-520234b6216e nodeName:}" failed. No retries permitted until 2026-07-30 10:33:55.073411404 +0000 UTC m=+2653.417474843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls") pod "maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm" (UID: "65f9a836-ba4e-44f0-b50b-520234b6216e") : secret "maas-api-e2e-inf-a-98c9c7-serving-cert" not found
Jul 30 10:33:54.573978 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.573958    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65f9a836-ba4e-44f0-b50b-520234b6216e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.584593 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.584570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntrrz\" (UniqueName: \"kubernetes.io/projected/65f9a836-ba4e-44f0-b50b-520234b6216e-kube-api-access-ntrrz\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:54.694421 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.694315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:54.883268 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.883233    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:54.986101 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.986012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:33:54.994282 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.994254    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"]
Jul 30 10:33:54.997926 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:54.997908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.000122 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.000101    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-98c9c7\""
Jul 30 10:33:55.000393 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.000378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-98c9c7-dockercfg-xcx85\""
Jul 30 10:33:55.009622 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.009592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"]
Jul 30 10:33:55.026724 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.026694    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"]
Jul 30 10:33:55.030349 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.030320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.040931 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.040907    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"]
Jul 30 10:33:55.078456 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.078417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:55.078456 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.078460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6\" (UID: \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.078684 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.078481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7whtf\" (UniqueName: \"kubernetes.io/projected/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-kube-api-access-7whtf\") pod \"payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6\" (UID: \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.080956 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.080935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls\") pod \"maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:55.180061 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.180019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6\" (UID: \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.180261 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.180070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7whtf\" (UniqueName: \"kubernetes.io/projected/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-kube-api-access-7whtf\") pod \"payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6\" (UID: \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.180336 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.180262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7454x\" (UniqueName: \"kubernetes.io/projected/b325420b-7de2-428d-a99e-fa01832151af-kube-api-access-7454x\") pod \"payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb\" (UID: \"b325420b-7de2-428d-a99e-fa01832151af\") " pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.180401 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.180336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b325420b-7de2-428d-a99e-fa01832151af-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb\" (UID: \"b325420b-7de2-428d-a99e-fa01832151af\") " pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.180767 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.180749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6\" (UID: \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.187416 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.187393    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7whtf\" (UniqueName: \"kubernetes.io/projected/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-kube-api-access-7whtf\") pod \"payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6\" (UID: \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.274512 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.274417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:55.280858 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.280806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7454x\" (UniqueName: \"kubernetes.io/projected/b325420b-7de2-428d-a99e-fa01832151af-kube-api-access-7454x\") pod \"payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb\" (UID: \"b325420b-7de2-428d-a99e-fa01832151af\") " pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.280982 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.280888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b325420b-7de2-428d-a99e-fa01832151af-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb\" (UID: \"b325420b-7de2-428d-a99e-fa01832151af\") " pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.281672 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.281651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b325420b-7de2-428d-a99e-fa01832151af-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb\" (UID: \"b325420b-7de2-428d-a99e-fa01832151af\") " pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.288320 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.288293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7454x\" (UniqueName: \"kubernetes.io/projected/b325420b-7de2-428d-a99e-fa01832151af-kube-api-access-7454x\") pod \"payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb\" (UID: \"b325420b-7de2-428d-a99e-fa01832151af\") " pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.309613 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.309580    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.342034 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.341068    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.430145 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.430093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"]
Jul 30 10:33:55.436704 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:33:55.436674    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f9a836_ba4e_44f0_b50b_520234b6216e.slice/crio-af4a2cee85cc51394b6843c7ec5c8a7aee2ac6c0b62933644bb44887b3d1151e WatchSource:0}: Error finding container af4a2cee85cc51394b6843c7ec5c8a7aee2ac6c0b62933644bb44887b3d1151e: Status 404 returned error can't find the container with id af4a2cee85cc51394b6843c7ec5c8a7aee2ac6c0b62933644bb44887b3d1151e
Jul 30 10:33:55.477294 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.477094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"]
Jul 30 10:33:55.480505 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:33:55.480476    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc73e305_f1e7_44ce_91de_4d6d2a527bf9.slice/crio-2759594ab92dd6ac6eb9b14f42da3dbd79c6f3265dff9aa1b19fd96fb9c6e18a WatchSource:0}: Error finding container 2759594ab92dd6ac6eb9b14f42da3dbd79c6f3265dff9aa1b19fd96fb9c6e18a: Status 404 returned error can't find the container with id 2759594ab92dd6ac6eb9b14f42da3dbd79c6f3265dff9aa1b19fd96fb9c6e18a
Jul 30 10:33:55.504474 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.504451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"]
Jul 30 10:33:55.513045 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:33:55.513010    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb325420b_7de2_428d_a99e_fa01832151af.slice/crio-753a538988880a7fba08f9a0d8ab620382cd6e7de0a098444a85ad8e94e728e2 WatchSource:0}: Error finding container 753a538988880a7fba08f9a0d8ab620382cd6e7de0a098444a85ad8e94e728e2: Status 404 returned error can't find the container with id 753a538988880a7fba08f9a0d8ab620382cd6e7de0a098444a85ad8e94e728e2
Jul 30 10:33:55.755884 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.755845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm" event={"ID":"65f9a836-ba4e-44f0-b50b-520234b6216e","Type":"ContainerStarted","Data":"af4a2cee85cc51394b6843c7ec5c8a7aee2ac6c0b62933644bb44887b3d1151e"}
Jul 30 10:33:55.757966 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.757940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6" event={"ID":"bc73e305-f1e7-44ce-91de-4d6d2a527bf9","Type":"ContainerStarted","Data":"303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11"}
Jul 30 10:33:55.758109 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.757983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6" event={"ID":"bc73e305-f1e7-44ce-91de-4d6d2a527bf9","Type":"ContainerStarted","Data":"2759594ab92dd6ac6eb9b14f42da3dbd79c6f3265dff9aa1b19fd96fb9c6e18a"}
Jul 30 10:33:55.758109 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.758028    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:33:55.763152 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.763122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb" event={"ID":"b325420b-7de2-428d-a99e-fa01832151af","Type":"ContainerStarted","Data":"a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd"}
Jul 30 10:33:55.763312 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.763189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb" event={"ID":"b325420b-7de2-428d-a99e-fa01832151af","Type":"ContainerStarted","Data":"753a538988880a7fba08f9a0d8ab620382cd6e7de0a098444a85ad8e94e728e2"}
Jul 30 10:33:55.763312 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.763299    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:33:55.777798 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.777697    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6" podStartSLOduration=1.777681976 podStartE2EDuration="1.777681976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:33:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:33:55.775547695 +0000 UTC m=+2654.119611151" watchObservedRunningTime="2026-07-30 10:33:55.777681976 +0000 UTC m=+2654.121745478"
Jul 30 10:33:55.791171 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:55.791118    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb" podStartSLOduration=0.791095416 podStartE2EDuration="791.095416ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:33:55.789550698 +0000 UTC m=+2654.133614155" watchObservedRunningTime="2026-07-30 10:33:55.791095416 +0000 UTC m=+2654.135158907"
Jul 30 10:33:56.770204 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:56.770159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm" event={"ID":"65f9a836-ba4e-44f0-b50b-520234b6216e","Type":"ContainerStarted","Data":"53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7"}
Jul 30 10:33:56.770655 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:56.770224    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:33:56.784777 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:33:56.784719    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm" podStartSLOduration=2.300657351 podStartE2EDuration="2.784701119s" totalImagesPullingTime="484.043768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:33:56.783855173 +0000 UTC m=+2655.127918629" watchObservedRunningTime="2026-07-30 10:33:56.784701119 +0000 UTC m=+2655.128764579"
Jul 30 10:34:02.781294 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:02.781261    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:34:06.772016 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:06.771983    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:34:06.772500 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:06.772054    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:34:18.327365 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:18.327329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:18.682552 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:18.682436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:19.017336 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:19.017244    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:19.265423 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:19.265390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:22.531596 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:22.531557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:22.625367 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:22.625331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:23.619681 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.619644    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"]
Jul 30 10:34:23.623590 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.623569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.626082 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.626062    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-fde6bc-serving-cert\""
Jul 30 10:34:23.630006 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.629980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.630113 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.630049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl5kf\" (UniqueName: \"kubernetes.io/projected/a46eb225-805a-4701-8910-0db3bcb98d59-kube-api-access-zl5kf\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.630113 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.630082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46eb225-805a-4701-8910-0db3bcb98d59-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.634656 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.634632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"]
Jul 30 10:34:23.662692 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.662651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:23.730836 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.730791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.731040 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.730877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl5kf\" (UniqueName: \"kubernetes.io/projected/a46eb225-805a-4701-8910-0db3bcb98d59-kube-api-access-zl5kf\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.731040 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.730911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46eb225-805a-4701-8910-0db3bcb98d59-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.731040 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:34:23.731006    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-serving-cert: secret "maas-api-e2e-inf-b-fde6bc-serving-cert" not found
Jul 30 10:34:23.731169 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:34:23.731075    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls podName:a46eb225-805a-4701-8910-0db3bcb98d59 nodeName:}" failed. No retries permitted until 2026-07-30 10:34:24.231057576 +0000 UTC m=+2682.575121028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls") pod "maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9" (UID: "a46eb225-805a-4701-8910-0db3bcb98d59") : secret "maas-api-e2e-inf-b-fde6bc-serving-cert" not found
Jul 30 10:34:23.731494 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.731477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46eb225-805a-4701-8910-0db3bcb98d59-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.739545 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.739522    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl5kf\" (UniqueName: \"kubernetes.io/projected/a46eb225-805a-4701-8910-0db3bcb98d59-kube-api-access-zl5kf\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:23.846149 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:23.846116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:24.135686 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.135653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:24.235004 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.234973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:24.237543 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.237520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls\") pod \"maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:24.241960 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.241935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:24.248403 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.248380    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"]
Jul 30 10:34:24.251997 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.251981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.253954 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.253935    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-fde6bc\""
Jul 30 10:34:24.254051 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.254018    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-fde6bc-dockercfg-z4s55\""
Jul 30 10:34:24.263897 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.263872    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"]
Jul 30 10:34:24.276601 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.276571    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"]
Jul 30 10:34:24.280802 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.280781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.292321 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.292291    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"]
Jul 30 10:34:24.336018 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.335986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbzwz\" (UniqueName: \"kubernetes.io/projected/54f8e3a4-9d06-49a4-b233-7d98935d0f31-kube-api-access-sbzwz\") pod \"payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd\" (UID: \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.336241 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.336027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz\" (UID: \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.336241 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.336076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbqxs\" (UniqueName: \"kubernetes.io/projected/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-kube-api-access-lbqxs\") pod \"payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz\" (UID: \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.336241 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.336132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54f8e3a4-9d06-49a4-b233-7d98935d0f31-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd\" (UID: \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.436879 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.436778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz\" (UID: \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.436879 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.436831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqxs\" (UniqueName: \"kubernetes.io/projected/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-kube-api-access-lbqxs\") pod \"payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz\" (UID: \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.437116 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.436882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54f8e3a4-9d06-49a4-b233-7d98935d0f31-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd\" (UID: \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.437116 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.437003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbzwz\" (UniqueName: \"kubernetes.io/projected/54f8e3a4-9d06-49a4-b233-7d98935d0f31-kube-api-access-sbzwz\") pod \"payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd\" (UID: \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.437580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.437556    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz\" (UID: \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.437661 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.437633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54f8e3a4-9d06-49a4-b233-7d98935d0f31-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd\" (UID: \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.445114 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.445083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbzwz\" (UniqueName: \"kubernetes.io/projected/54f8e3a4-9d06-49a4-b233-7d98935d0f31-kube-api-access-sbzwz\") pod \"payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd\" (UID: \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.445529 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.445508    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqxs\" (UniqueName: \"kubernetes.io/projected/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-kube-api-access-lbqxs\") pod \"payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz\" (UID: \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.535364 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.535331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:24.563628 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.563596    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.593384 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.593351    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.695114 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.695028    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"]
Jul 30 10:34:24.699601 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:34:24.699576    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46eb225_805a_4701_8910_0db3bcb98d59.slice/crio-bc00b3158263f393e72a4d0e1cceb7611b77fa667c7c617ababadb8e8cce366f WatchSource:0}: Error finding container bc00b3158263f393e72a4d0e1cceb7611b77fa667c7c617ababadb8e8cce366f: Status 404 returned error can't find the container with id bc00b3158263f393e72a4d0e1cceb7611b77fa667c7c617ababadb8e8cce366f
Jul 30 10:34:24.734597 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.734568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"]
Jul 30 10:34:24.736072 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:34:24.736034    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b6a84b_0122_4dff_8d3c_95e2cb73efb7.slice/crio-879e843729d67e16e0ebfcadf10a063b0a17992f58714000b923fca706985831 WatchSource:0}: Error finding container 879e843729d67e16e0ebfcadf10a063b0a17992f58714000b923fca706985831: Status 404 returned error can't find the container with id 879e843729d67e16e0ebfcadf10a063b0a17992f58714000b923fca706985831
Jul 30 10:34:24.763498 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.763469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"]
Jul 30 10:34:24.765264 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:34:24.765235    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f8e3a4_9d06_49a4_b233_7d98935d0f31.slice/crio-00d11314d41861f5b7f263290e22440a4cd160140ed7f07b56560bb2244c4725 WatchSource:0}: Error finding container 00d11314d41861f5b7f263290e22440a4cd160140ed7f07b56560bb2244c4725: Status 404 returned error can't find the container with id 00d11314d41861f5b7f263290e22440a4cd160140ed7f07b56560bb2244c4725
Jul 30 10:34:24.909189 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.909151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd" event={"ID":"54f8e3a4-9d06-49a4-b233-7d98935d0f31","Type":"ContainerStarted","Data":"77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9"}
Jul 30 10:34:24.909389 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.909210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd" event={"ID":"54f8e3a4-9d06-49a4-b233-7d98935d0f31","Type":"ContainerStarted","Data":"00d11314d41861f5b7f263290e22440a4cd160140ed7f07b56560bb2244c4725"}
Jul 30 10:34:24.909389 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.909271    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:24.910397 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.910373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9" event={"ID":"a46eb225-805a-4701-8910-0db3bcb98d59","Type":"ContainerStarted","Data":"bc00b3158263f393e72a4d0e1cceb7611b77fa667c7c617ababadb8e8cce366f"}
Jul 30 10:34:24.911840 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.911784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz" event={"ID":"16b6a84b-0122-4dff-8d3c-95e2cb73efb7","Type":"ContainerStarted","Data":"f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2"}
Jul 30 10:34:24.911840 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.911840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz" event={"ID":"16b6a84b-0122-4dff-8d3c-95e2cb73efb7","Type":"ContainerStarted","Data":"879e843729d67e16e0ebfcadf10a063b0a17992f58714000b923fca706985831"}
Jul 30 10:34:24.911990 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.911942    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:24.927234 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.927189    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd" podStartSLOduration=0.927175793 podStartE2EDuration="927.175793ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:34:24.925144678 +0000 UTC m=+2683.269208130" watchObservedRunningTime="2026-07-30 10:34:24.927175793 +0000 UTC m=+2683.271239249"
Jul 30 10:34:24.944385 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:24.944251    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz" podStartSLOduration=0.944230019 podStartE2EDuration="944.230019ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:34:24.941682541 +0000 UTC m=+2683.285745998" watchObservedRunningTime="2026-07-30 10:34:24.944230019 +0000 UTC m=+2683.288293477"
Jul 30 10:34:25.918425 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:25.918384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9" event={"ID":"a46eb225-805a-4701-8910-0db3bcb98d59","Type":"ContainerStarted","Data":"9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2"}
Jul 30 10:34:25.918867 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:25.918563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:25.938270 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:25.938212    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9" podStartSLOduration=2.458599685 podStartE2EDuration="2.938195298s" totalImagesPullingTime="479.595613ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:34:25.936360624 +0000 UTC m=+2684.280424100" watchObservedRunningTime="2026-07-30 10:34:25.938195298 +0000 UTC m=+2684.282258753"
Jul 30 10:34:31.929227 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:31.929197    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:34:35.920654 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:35.920573    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz" podUID="16b6a84b-0122-4dff-8d3c-95e2cb73efb7" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.66:9004: connect: connection refused"
Jul 30 10:34:35.921030 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:35.920859    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:34:42.347738 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:42.347712    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:34:42.356315 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:42.356293    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:34:45.919500 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:45.919465    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:34:47.450206 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:47.450168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:34:52.732368 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:34:52.732323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:35:15.895319 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:35:15.895281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:35:38.197515 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:35:38.197463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:35:49.717276 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:35:49.717222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:03.787506 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:03.787421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:07.360480 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:07.360439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:08.269167 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.269132    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:08.439184 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.439141    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"]
Jul 30 10:36:08.443050 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.443030    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"
Jul 30 10:36:08.445093 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.445074    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:36:08.450029 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.450005    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"]
Jul 30 10:36:08.501048 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.501006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e3c88-c766-4340-951e-226e838037c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf\" (UID: \"a29e3c88-c766-4340-951e-226e838037c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"
Jul 30 10:36:08.602414 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.602376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e3c88-c766-4340-951e-226e838037c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf\" (UID: \"a29e3c88-c766-4340-951e-226e838037c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"
Jul 30 10:36:08.603036 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.603017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e3c88-c766-4340-951e-226e838037c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf\" (UID: \"a29e3c88-c766-4340-951e-226e838037c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"
Jul 30 10:36:08.755481 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.755447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"
Jul 30 10:36:08.885764 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:08.885738    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"]
Jul 30 10:36:08.887895 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:36:08.887865    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29e3c88_c766_4340_951e_226e838037c3.slice/crio-5a4738153f3145a737e03c5bc51f99a19baf6066432a684e78c220568cb37261 WatchSource:0}: Error finding container 5a4738153f3145a737e03c5bc51f99a19baf6066432a684e78c220568cb37261: Status 404 returned error can't find the container with id 5a4738153f3145a737e03c5bc51f99a19baf6066432a684e78c220568cb37261
Jul 30 10:36:09.450014 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:09.449974    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf" event={"ID":"a29e3c88-c766-4340-951e-226e838037c3","Type":"ContainerStarted","Data":"405fca683a975e2cef63dbe2964526dbaa086b1b4099fc4707315b4e009baa78"}
Jul 30 10:36:09.450486 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:09.450031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf" event={"ID":"a29e3c88-c766-4340-951e-226e838037c3","Type":"ContainerStarted","Data":"5a4738153f3145a737e03c5bc51f99a19baf6066432a684e78c220568cb37261"}
Jul 30 10:36:09.465730 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:09.465674    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf" podStartSLOduration=1.465656331 podStartE2EDuration="1.465656331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:36:09.464530702 +0000 UTC m=+2787.808594158" watchObservedRunningTime="2026-07-30 10:36:09.465656331 +0000 UTC m=+2787.809719843"
Jul 30 10:36:10.457258 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:10.457226    2581 generic.go:356] "Generic (PLEG): container finished" podID="a29e3c88-c766-4340-951e-226e838037c3" containerID="405fca683a975e2cef63dbe2964526dbaa086b1b4099fc4707315b4e009baa78" exitCode=0
Jul 30 10:36:10.457648 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:10.457315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf" event={"ID":"a29e3c88-c766-4340-951e-226e838037c3","Type":"ContainerDied","Data":"405fca683a975e2cef63dbe2964526dbaa086b1b4099fc4707315b4e009baa78"}
Jul 30 10:36:11.598094 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:11.598061    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"
Jul 30 10:36:11.733174 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:11.733093    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e3c88-c766-4340-951e-226e838037c3-maas-api-service-ca\") pod \"a29e3c88-c766-4340-951e-226e838037c3\" (UID: \"a29e3c88-c766-4340-951e-226e838037c3\") "
Jul 30 10:36:11.733463 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:11.733441    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a29e3c88-c766-4340-951e-226e838037c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a29e3c88-c766-4340-951e-226e838037c3" (UID: "a29e3c88-c766-4340-951e-226e838037c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:36:11.834726 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:11.834685    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29e3c88-c766-4340-951e-226e838037c3-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:12.469315 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:12.469284    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"
Jul 30 10:36:12.469480 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:12.469313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf" event={"ID":"a29e3c88-c766-4340-951e-226e838037c3","Type":"ContainerDied","Data":"5a4738153f3145a737e03c5bc51f99a19baf6066432a684e78c220568cb37261"}
Jul 30 10:36:12.469480 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:12.469364    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a4738153f3145a737e03c5bc51f99a19baf6066432a684e78c220568cb37261"
Jul 30 10:36:18.855782 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:18.855748    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"]
Jul 30 10:36:18.856215 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:18.855980    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm" podUID="65f9a836-ba4e-44f0-b50b-520234b6216e" containerName="maas-api" containerID="cri-o://53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7" gracePeriod=30
Jul 30 10:36:18.888645 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:18.888611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:18.916015 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:18.915983    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"]
Jul 30 10:36:18.916227 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:18.916202    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb" podUID="b325420b-7de2-428d-a99e-fa01832151af" containerName="payload-processing" containerID="cri-o://a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd" gracePeriod=30
Jul 30 10:36:18.923353 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:18.923311    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"]
Jul 30 10:36:18.923571 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:18.923528    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6" podUID="bc73e305-f1e7-44ce-91de-4d6d2a527bf9" containerName="payload-pre-processing" containerID="cri-o://303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11" gracePeriod=30
Jul 30 10:36:18.994784 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:18.993828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:18.998213 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:36:18.998181    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc73e305_f1e7_44ce_91de_4d6d2a527bf9.slice/crio-303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc73e305_f1e7_44ce_91de_4d6d2a527bf9.slice/crio-conmon-303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 10:36:19.098782 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.098741    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"]
Jul 30 10:36:19.100573 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.100545    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c9c7-rmwcf"]
Jul 30 10:36:19.220835 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.220787    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:36:19.223694 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.223670    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:36:19.297718 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.297657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:19.304358 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.304329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b325420b-7de2-428d-a99e-fa01832151af-plugins-config-volume\") pod \"b325420b-7de2-428d-a99e-fa01832151af\" (UID: \"b325420b-7de2-428d-a99e-fa01832151af\") "
Jul 30 10:36:19.304503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.304381    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7whtf\" (UniqueName: \"kubernetes.io/projected/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-kube-api-access-7whtf\") pod \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\" (UID: \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\") "
Jul 30 10:36:19.304503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.304410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7454x\" (UniqueName: \"kubernetes.io/projected/b325420b-7de2-428d-a99e-fa01832151af-kube-api-access-7454x\") pod \"b325420b-7de2-428d-a99e-fa01832151af\" (UID: \"b325420b-7de2-428d-a99e-fa01832151af\") "
Jul 30 10:36:19.304503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.304432    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-plugins-config-volume\") pod \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\" (UID: \"bc73e305-f1e7-44ce-91de-4d6d2a527bf9\") "
Jul 30 10:36:19.304914 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.304764    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b325420b-7de2-428d-a99e-fa01832151af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b325420b-7de2-428d-a99e-fa01832151af" (UID: "b325420b-7de2-428d-a99e-fa01832151af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:36:19.305027 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.304961    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc73e305-f1e7-44ce-91de-4d6d2a527bf9" (UID: "bc73e305-f1e7-44ce-91de-4d6d2a527bf9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:36:19.306580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.306554    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b325420b-7de2-428d-a99e-fa01832151af-kube-api-access-7454x" (OuterVolumeSpecName: "kube-api-access-7454x") pod "b325420b-7de2-428d-a99e-fa01832151af" (UID: "b325420b-7de2-428d-a99e-fa01832151af"). InnerVolumeSpecName "kube-api-access-7454x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:36:19.306673 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.306607    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-kube-api-access-7whtf" (OuterVolumeSpecName: "kube-api-access-7whtf") pod "bc73e305-f1e7-44ce-91de-4d6d2a527bf9" (UID: "bc73e305-f1e7-44ce-91de-4d6d2a527bf9"). InnerVolumeSpecName "kube-api-access-7whtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:36:19.323301 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.323277    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:36:19.405701 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.405609    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntrrz\" (UniqueName: \"kubernetes.io/projected/65f9a836-ba4e-44f0-b50b-520234b6216e-kube-api-access-ntrrz\") pod \"65f9a836-ba4e-44f0-b50b-520234b6216e\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") "
Jul 30 10:36:19.405701 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.405673    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls\") pod \"65f9a836-ba4e-44f0-b50b-520234b6216e\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") "
Jul 30 10:36:19.405701 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.405705    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65f9a836-ba4e-44f0-b50b-520234b6216e-openshift-service-ca\") pod \"65f9a836-ba4e-44f0-b50b-520234b6216e\" (UID: \"65f9a836-ba4e-44f0-b50b-520234b6216e\") "
Jul 30 10:36:19.406022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.405962    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b325420b-7de2-428d-a99e-fa01832151af-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:19.406022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.405975    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7whtf\" (UniqueName: \"kubernetes.io/projected/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-kube-api-access-7whtf\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:19.406022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.405984    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7454x\" (UniqueName: \"kubernetes.io/projected/b325420b-7de2-428d-a99e-fa01832151af-kube-api-access-7454x\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:19.406022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.405993    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc73e305-f1e7-44ce-91de-4d6d2a527bf9-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:19.406197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.406092    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65f9a836-ba4e-44f0-b50b-520234b6216e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65f9a836-ba4e-44f0-b50b-520234b6216e" (UID: "65f9a836-ba4e-44f0-b50b-520234b6216e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:36:19.407611 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.407590    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f9a836-ba4e-44f0-b50b-520234b6216e-kube-api-access-ntrrz" (OuterVolumeSpecName: "kube-api-access-ntrrz") pod "65f9a836-ba4e-44f0-b50b-520234b6216e" (UID: "65f9a836-ba4e-44f0-b50b-520234b6216e"). InnerVolumeSpecName "kube-api-access-ntrrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:36:19.407667 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.407605    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65f9a836-ba4e-44f0-b50b-520234b6216e" (UID: "65f9a836-ba4e-44f0-b50b-520234b6216e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:36:19.483085 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.483046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:19.506435 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.506400    2581 generic.go:356] "Generic (PLEG): container finished" podID="b325420b-7de2-428d-a99e-fa01832151af" containerID="a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd" exitCode=0
Jul 30 10:36:19.506605 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.506435    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb" event={"ID":"b325420b-7de2-428d-a99e-fa01832151af","Type":"ContainerDied","Data":"a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd"}
Jul 30 10:36:19.506605 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.506416    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65f9a836-ba4e-44f0-b50b-520234b6216e-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:19.506605 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.506443    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"
Jul 30 10:36:19.506605 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.506494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb" event={"ID":"b325420b-7de2-428d-a99e-fa01832151af","Type":"ContainerDied","Data":"753a538988880a7fba08f9a0d8ab620382cd6e7de0a098444a85ad8e94e728e2"}
Jul 30 10:36:19.506605 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.506501    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65f9a836-ba4e-44f0-b50b-520234b6216e-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:19.506605 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.506517    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntrrz\" (UniqueName: \"kubernetes.io/projected/65f9a836-ba4e-44f0-b50b-520234b6216e-kube-api-access-ntrrz\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:19.506605 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.506526    2581 scope.go:117] "RemoveContainer" containerID="a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd"
Jul 30 10:36:19.507995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.507974    2581 generic.go:356] "Generic (PLEG): container finished" podID="65f9a836-ba4e-44f0-b50b-520234b6216e" containerID="53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7" exitCode=0
Jul 30 10:36:19.508097 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.508018    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"
Jul 30 10:36:19.508097 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.508060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm" event={"ID":"65f9a836-ba4e-44f0-b50b-520234b6216e","Type":"ContainerDied","Data":"53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7"}
Jul 30 10:36:19.508195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.508113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm" event={"ID":"65f9a836-ba4e-44f0-b50b-520234b6216e","Type":"ContainerDied","Data":"af4a2cee85cc51394b6843c7ec5c8a7aee2ac6c0b62933644bb44887b3d1151e"}
Jul 30 10:36:19.509661 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.509619    2581 generic.go:356] "Generic (PLEG): container finished" podID="bc73e305-f1e7-44ce-91de-4d6d2a527bf9" containerID="303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11" exitCode=0
Jul 30 10:36:19.509661 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.509650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6" event={"ID":"bc73e305-f1e7-44ce-91de-4d6d2a527bf9","Type":"ContainerDied","Data":"303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11"}
Jul 30 10:36:19.509920 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.509673    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"
Jul 30 10:36:19.509920 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.509692    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6" event={"ID":"bc73e305-f1e7-44ce-91de-4d6d2a527bf9","Type":"ContainerDied","Data":"2759594ab92dd6ac6eb9b14f42da3dbd79c6f3265dff9aa1b19fd96fb9c6e18a"}
Jul 30 10:36:19.517379 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.517361    2581 scope.go:117] "RemoveContainer" containerID="a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd"
Jul 30 10:36:19.517686 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:36:19.517664    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd\": container with ID starting with a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd not found: ID does not exist" containerID="a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd"
Jul 30 10:36:19.517774 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.517696    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd"} err="failed to get container status \"a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd\": rpc error: code = NotFound desc = could not find container \"a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd\": container with ID starting with a9a5a7cbf3c5fd8838b2f131de6c1c844cf23afa7dc2e72345a28779033378dd not found: ID does not exist"
Jul 30 10:36:19.517774 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.517719    2581 scope.go:117] "RemoveContainer" containerID="53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7"
Jul 30 10:36:19.525700 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.525680    2581 scope.go:117] "RemoveContainer" containerID="53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7"
Jul 30 10:36:19.525991 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:36:19.525968    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7\": container with ID starting with 53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7 not found: ID does not exist" containerID="53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7"
Jul 30 10:36:19.526041 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.525997    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7"} err="failed to get container status \"53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7\": rpc error: code = NotFound desc = could not find container \"53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7\": container with ID starting with 53def281935a801f947bd04e7a2ceea86938049dc45f2e85cd45079da076a5d7 not found: ID does not exist"
Jul 30 10:36:19.526041 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.526018    2581 scope.go:117] "RemoveContainer" containerID="303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11"
Jul 30 10:36:19.529183 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.529163    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"]
Jul 30 10:36:19.534297 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.534270    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb"]
Jul 30 10:36:19.534972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.534950    2581 scope.go:117] "RemoveContainer" containerID="303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11"
Jul 30 10:36:19.535251 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:36:19.535232    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11\": container with ID starting with 303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11 not found: ID does not exist" containerID="303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11"
Jul 30 10:36:19.535316 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.535258    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11"} err="failed to get container status \"303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11\": rpc error: code = NotFound desc = could not find container \"303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11\": container with ID starting with 303c9af1447b61b6a87ade0f2a65065e0be1e3726801fa25a4de05f2828a7a11 not found: ID does not exist"
Jul 30 10:36:19.542181 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.542157    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"]
Jul 30 10:36:19.544580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.544559    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6"]
Jul 30 10:36:19.554965 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.554934    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"]
Jul 30 10:36:19.560895 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:19.560872    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98c9c7-6fdf74d884-vvdnm"]
Jul 30 10:36:20.227900 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:20.227803    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65f9a836-ba4e-44f0-b50b-520234b6216e" path="/var/lib/kubelet/pods/65f9a836-ba4e-44f0-b50b-520234b6216e/volumes"
Jul 30 10:36:20.228244 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:20.228162    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a29e3c88-c766-4340-951e-226e838037c3" path="/var/lib/kubelet/pods/a29e3c88-c766-4340-951e-226e838037c3/volumes"
Jul 30 10:36:20.228465 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:20.228452    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b325420b-7de2-428d-a99e-fa01832151af" path="/var/lib/kubelet/pods/b325420b-7de2-428d-a99e-fa01832151af/volumes"
Jul 30 10:36:20.228758 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:20.228746    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc73e305-f1e7-44ce-91de-4d6d2a527bf9" path="/var/lib/kubelet/pods/bc73e305-f1e7-44ce-91de-4d6d2a527bf9/volumes"
Jul 30 10:36:25.461575 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:25.461533    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:25.827861 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:25.827806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:25.923242 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:25.923211    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:26.022230 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.022199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:26.117607 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.117520    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"]
Jul 30 10:36:26.118021 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118002    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b325420b-7de2-428d-a99e-fa01832151af" containerName="payload-processing"
Jul 30 10:36:26.118135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118022    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b325420b-7de2-428d-a99e-fa01832151af" containerName="payload-processing"
Jul 30 10:36:26.118135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118037    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f9a836-ba4e-44f0-b50b-520234b6216e" containerName="maas-api"
Jul 30 10:36:26.118135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118046    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f9a836-ba4e-44f0-b50b-520234b6216e" containerName="maas-api"
Jul 30 10:36:26.118135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118055    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29e3c88-c766-4340-951e-226e838037c3" containerName="revoke-keys"
Jul 30 10:36:26.118135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118062    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29e3c88-c766-4340-951e-226e838037c3" containerName="revoke-keys"
Jul 30 10:36:26.118135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118077    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc73e305-f1e7-44ce-91de-4d6d2a527bf9" containerName="payload-pre-processing"
Jul 30 10:36:26.118135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118085    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc73e305-f1e7-44ce-91de-4d6d2a527bf9" containerName="payload-pre-processing"
Jul 30 10:36:26.118529 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118181    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29e3c88-c766-4340-951e-226e838037c3" containerName="revoke-keys"
Jul 30 10:36:26.118529 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118198    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b325420b-7de2-428d-a99e-fa01832151af" containerName="payload-processing"
Jul 30 10:36:26.118529 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118208    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="65f9a836-ba4e-44f0-b50b-520234b6216e" containerName="maas-api"
Jul 30 10:36:26.118529 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.118218    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc73e305-f1e7-44ce-91de-4d6d2a527bf9" containerName="payload-pre-processing"
Jul 30 10:36:26.121455 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.121433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"
Jul 30 10:36:26.123854 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.123834    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:36:26.129097 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.129009    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"]
Jul 30 10:36:26.270733 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.270696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2838a42a-c08b-44ed-a8c8-cd5528a90833-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6\" (UID: \"2838a42a-c08b-44ed-a8c8-cd5528a90833\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"
Jul 30 10:36:26.372033 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.371916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2838a42a-c08b-44ed-a8c8-cd5528a90833-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6\" (UID: \"2838a42a-c08b-44ed-a8c8-cd5528a90833\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"
Jul 30 10:36:26.372610 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.372590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2838a42a-c08b-44ed-a8c8-cd5528a90833-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6\" (UID: \"2838a42a-c08b-44ed-a8c8-cd5528a90833\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"
Jul 30 10:36:26.432926 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.432888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"
Jul 30 10:36:26.569438 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:26.569410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"]
Jul 30 10:36:26.571867 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:36:26.571843    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2838a42a_c08b_44ed_a8c8_cd5528a90833.slice/crio-99daab0d8a5681cd096d8bf55f0f15087432ac2220e7b2b662c5979cfbc32668 WatchSource:0}: Error finding container 99daab0d8a5681cd096d8bf55f0f15087432ac2220e7b2b662c5979cfbc32668: Status 404 returned error can't find the container with id 99daab0d8a5681cd096d8bf55f0f15087432ac2220e7b2b662c5979cfbc32668
Jul 30 10:36:27.555092 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:27.555054    2581 generic.go:356] "Generic (PLEG): container finished" podID="2838a42a-c08b-44ed-a8c8-cd5528a90833" containerID="b411c1d1543a875159e0c76b78945f527946e4d79f1f5d0b38176bdb303f00fa" exitCode=0
Jul 30 10:36:27.555265 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:27.555146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6" event={"ID":"2838a42a-c08b-44ed-a8c8-cd5528a90833","Type":"ContainerDied","Data":"b411c1d1543a875159e0c76b78945f527946e4d79f1f5d0b38176bdb303f00fa"}
Jul 30 10:36:27.555265 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:27.555210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6" event={"ID":"2838a42a-c08b-44ed-a8c8-cd5528a90833","Type":"ContainerStarted","Data":"99daab0d8a5681cd096d8bf55f0f15087432ac2220e7b2b662c5979cfbc32668"}
Jul 30 10:36:28.709347 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:28.709325    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"
Jul 30 10:36:28.896407 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:28.896304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2838a42a-c08b-44ed-a8c8-cd5528a90833-maas-api-service-ca\") pod \"2838a42a-c08b-44ed-a8c8-cd5528a90833\" (UID: \"2838a42a-c08b-44ed-a8c8-cd5528a90833\") "
Jul 30 10:36:28.896728 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:28.896697    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2838a42a-c08b-44ed-a8c8-cd5528a90833-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2838a42a-c08b-44ed-a8c8-cd5528a90833" (UID: "2838a42a-c08b-44ed-a8c8-cd5528a90833"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:36:28.997380 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:28.997332    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2838a42a-c08b-44ed-a8c8-cd5528a90833-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:29.566420 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:29.566388    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"
Jul 30 10:36:29.566582 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:29.566417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6" event={"ID":"2838a42a-c08b-44ed-a8c8-cd5528a90833","Type":"ContainerDied","Data":"99daab0d8a5681cd096d8bf55f0f15087432ac2220e7b2b662c5979cfbc32668"}
Jul 30 10:36:29.566582 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:29.566470    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99daab0d8a5681cd096d8bf55f0f15087432ac2220e7b2b662c5979cfbc32668"
Jul 30 10:36:33.959831 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:33.959784    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:34.091612 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:34.091579    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:36.566857 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.566809    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"]
Jul 30 10:36:36.567276 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.567064    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9" podUID="a46eb225-805a-4701-8910-0db3bcb98d59" containerName="maas-api" containerID="cri-o://9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2" gracePeriod=30
Jul 30 10:36:36.591698 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.591658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:36.616049 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.616012    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"]
Jul 30 10:36:36.616328 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.616277    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd" podUID="54f8e3a4-9d06-49a4-b233-7d98935d0f31" containerName="payload-processing" containerID="cri-o://77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9" gracePeriod=30
Jul 30 10:36:36.621426 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.621019    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"]
Jul 30 10:36:36.621426 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.621287    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz" podUID="16b6a84b-0122-4dff-8d3c-95e2cb73efb7" containerName="payload-pre-processing" containerID="cri-o://f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2" gracePeriod=30
Jul 30 10:36:36.660164 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.660128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:36.756201 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.756162    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"]
Jul 30 10:36:36.760154 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.760117    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:36.761039 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.761012    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fde6bc-9lpq6"]
Jul 30 10:36:36.861372 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.861331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:36.882795 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.882756    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:36:36.903040 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.903019    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:36:36.910227 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.910204    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:36:36.968469 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.968441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls\") pod \"a46eb225-805a-4701-8910-0db3bcb98d59\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") "
Jul 30 10:36:36.968469 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.968474    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbzwz\" (UniqueName: \"kubernetes.io/projected/54f8e3a4-9d06-49a4-b233-7d98935d0f31-kube-api-access-sbzwz\") pod \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\" (UID: \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\") "
Jul 30 10:36:36.968719 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.968493    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-plugins-config-volume\") pod \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\" (UID: \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\") "
Jul 30 10:36:36.968719 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.968514    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46eb225-805a-4701-8910-0db3bcb98d59-openshift-service-ca\") pod \"a46eb225-805a-4701-8910-0db3bcb98d59\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") "
Jul 30 10:36:36.968719 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.968575    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbqxs\" (UniqueName: \"kubernetes.io/projected/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-kube-api-access-lbqxs\") pod \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\" (UID: \"16b6a84b-0122-4dff-8d3c-95e2cb73efb7\") "
Jul 30 10:36:36.968719 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.968597    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54f8e3a4-9d06-49a4-b233-7d98935d0f31-plugins-config-volume\") pod \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\" (UID: \"54f8e3a4-9d06-49a4-b233-7d98935d0f31\") "
Jul 30 10:36:36.968719 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.968661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl5kf\" (UniqueName: \"kubernetes.io/projected/a46eb225-805a-4701-8910-0db3bcb98d59-kube-api-access-zl5kf\") pod \"a46eb225-805a-4701-8910-0db3bcb98d59\" (UID: \"a46eb225-805a-4701-8910-0db3bcb98d59\") "
Jul 30 10:36:36.969168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.968938    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46eb225-805a-4701-8910-0db3bcb98d59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a46eb225-805a-4701-8910-0db3bcb98d59" (UID: "a46eb225-805a-4701-8910-0db3bcb98d59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:36:36.969168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.969148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54f8e3a4-9d06-49a4-b233-7d98935d0f31-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54f8e3a4-9d06-49a4-b233-7d98935d0f31" (UID: "54f8e3a4-9d06-49a4-b233-7d98935d0f31"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:36:36.969344 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.969185    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "16b6a84b-0122-4dff-8d3c-95e2cb73efb7" (UID: "16b6a84b-0122-4dff-8d3c-95e2cb73efb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:36:36.970658 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.970631    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a46eb225-805a-4701-8910-0db3bcb98d59" (UID: "a46eb225-805a-4701-8910-0db3bcb98d59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:36:36.970915 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.970890    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46eb225-805a-4701-8910-0db3bcb98d59-kube-api-access-zl5kf" (OuterVolumeSpecName: "kube-api-access-zl5kf") pod "a46eb225-805a-4701-8910-0db3bcb98d59" (UID: "a46eb225-805a-4701-8910-0db3bcb98d59"). InnerVolumeSpecName "kube-api-access-zl5kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:36:36.970915 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.970906    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-kube-api-access-lbqxs" (OuterVolumeSpecName: "kube-api-access-lbqxs") pod "16b6a84b-0122-4dff-8d3c-95e2cb73efb7" (UID: "16b6a84b-0122-4dff-8d3c-95e2cb73efb7"). InnerVolumeSpecName "kube-api-access-lbqxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:36:36.971058 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:36.971029    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f8e3a4-9d06-49a4-b233-7d98935d0f31-kube-api-access-sbzwz" (OuterVolumeSpecName: "kube-api-access-sbzwz") pod "54f8e3a4-9d06-49a4-b233-7d98935d0f31" (UID: "54f8e3a4-9d06-49a4-b233-7d98935d0f31"). InnerVolumeSpecName "kube-api-access-sbzwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:36:37.070123 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.070084    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbqxs\" (UniqueName: \"kubernetes.io/projected/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-kube-api-access-lbqxs\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:37.070123 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.070120    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54f8e3a4-9d06-49a4-b233-7d98935d0f31-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:37.070123 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.070129    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl5kf\" (UniqueName: \"kubernetes.io/projected/a46eb225-805a-4701-8910-0db3bcb98d59-kube-api-access-zl5kf\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:37.070374 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.070139    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46eb225-805a-4701-8910-0db3bcb98d59-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:37.070374 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.070149    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbzwz\" (UniqueName: \"kubernetes.io/projected/54f8e3a4-9d06-49a4-b233-7d98935d0f31-kube-api-access-sbzwz\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:37.070374 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.070159    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b6a84b-0122-4dff-8d3c-95e2cb73efb7-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:37.070374 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.070171    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46eb225-805a-4701-8910-0db3bcb98d59-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:36:37.177876 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.177769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:37.614443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.614407    2581 generic.go:356] "Generic (PLEG): container finished" podID="16b6a84b-0122-4dff-8d3c-95e2cb73efb7" containerID="f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2" exitCode=0
Jul 30 10:36:37.614926 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.614457    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"
Jul 30 10:36:37.614926 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.614457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz" event={"ID":"16b6a84b-0122-4dff-8d3c-95e2cb73efb7","Type":"ContainerDied","Data":"f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2"}
Jul 30 10:36:37.614926 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.614525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz" event={"ID":"16b6a84b-0122-4dff-8d3c-95e2cb73efb7","Type":"ContainerDied","Data":"879e843729d67e16e0ebfcadf10a063b0a17992f58714000b923fca706985831"}
Jul 30 10:36:37.614926 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.614561    2581 scope.go:117] "RemoveContainer" containerID="f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2"
Jul 30 10:36:37.616001 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.615979    2581 generic.go:356] "Generic (PLEG): container finished" podID="54f8e3a4-9d06-49a4-b233-7d98935d0f31" containerID="77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9" exitCode=0
Jul 30 10:36:37.616064 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.616018    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"
Jul 30 10:36:37.616131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.616060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd" event={"ID":"54f8e3a4-9d06-49a4-b233-7d98935d0f31","Type":"ContainerDied","Data":"77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9"}
Jul 30 10:36:37.616131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.616117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd" event={"ID":"54f8e3a4-9d06-49a4-b233-7d98935d0f31","Type":"ContainerDied","Data":"00d11314d41861f5b7f263290e22440a4cd160140ed7f07b56560bb2244c4725"}
Jul 30 10:36:37.617711 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.617671    2581 generic.go:356] "Generic (PLEG): container finished" podID="a46eb225-805a-4701-8910-0db3bcb98d59" containerID="9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2" exitCode=0
Jul 30 10:36:37.617858 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.617716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9" event={"ID":"a46eb225-805a-4701-8910-0db3bcb98d59","Type":"ContainerDied","Data":"9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2"}
Jul 30 10:36:37.617858 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.617733    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"
Jul 30 10:36:37.617858 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.617762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9" event={"ID":"a46eb225-805a-4701-8910-0db3bcb98d59","Type":"ContainerDied","Data":"bc00b3158263f393e72a4d0e1cceb7611b77fa667c7c617ababadb8e8cce366f"}
Jul 30 10:36:37.624978 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.624955    2581 scope.go:117] "RemoveContainer" containerID="f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2"
Jul 30 10:36:37.625321 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:36:37.625294    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2\": container with ID starting with f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2 not found: ID does not exist" containerID="f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2"
Jul 30 10:36:37.625401 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.625335    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2"} err="failed to get container status \"f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2\": rpc error: code = NotFound desc = could not find container \"f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2\": container with ID starting with f3fcc2073c29e98c0ba3191eb0e39407f55a0a81c15a58ff1cdde7a119c2bda2 not found: ID does not exist"
Jul 30 10:36:37.625401 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.625359    2581 scope.go:117] "RemoveContainer" containerID="77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9"
Jul 30 10:36:37.635869 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.635848    2581 scope.go:117] "RemoveContainer" containerID="77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9"
Jul 30 10:36:37.636220 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:36:37.636198    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9\": container with ID starting with 77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9 not found: ID does not exist" containerID="77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9"
Jul 30 10:36:37.636302 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.636225    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9"} err="failed to get container status \"77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9\": rpc error: code = NotFound desc = could not find container \"77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9\": container with ID starting with 77fca16de5e1c4558f904af4b4ecb0373890069fbf7239ec26fd00d641a077e9 not found: ID does not exist"
Jul 30 10:36:37.636302 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.636243    2581 scope.go:117] "RemoveContainer" containerID="9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2"
Jul 30 10:36:37.642650 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.642623    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"]
Jul 30 10:36:37.645183 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.645157    2581 scope.go:117] "RemoveContainer" containerID="9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2"
Jul 30 10:36:37.645517 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:36:37.645497    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2\": container with ID starting with 9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2 not found: ID does not exist" containerID="9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2"
Jul 30 10:36:37.645593 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.645530    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2"} err="failed to get container status \"9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2\": rpc error: code = NotFound desc = could not find container \"9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2\": container with ID starting with 9697f145de8dc89fb6f3f72539ef5988aa97cd902d42fdcfb80dfdb3e58464b2 not found: ID does not exist"
Jul 30 10:36:37.646701 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.646681    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd"]
Jul 30 10:36:37.657224 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.657193    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"]
Jul 30 10:36:37.665150 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.665117    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fde6bc-fbbcd5778-qtjx9"]
Jul 30 10:36:37.675068 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.675038    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"]
Jul 30 10:36:37.680411 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:37.680381    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz"]
Jul 30 10:36:38.228604 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:38.228574    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16b6a84b-0122-4dff-8d3c-95e2cb73efb7" path="/var/lib/kubelet/pods/16b6a84b-0122-4dff-8d3c-95e2cb73efb7/volumes"
Jul 30 10:36:38.228938 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:38.228924    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2838a42a-c08b-44ed-a8c8-cd5528a90833" path="/var/lib/kubelet/pods/2838a42a-c08b-44ed-a8c8-cd5528a90833/volumes"
Jul 30 10:36:38.229243 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:38.229232    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54f8e3a4-9d06-49a4-b233-7d98935d0f31" path="/var/lib/kubelet/pods/54f8e3a4-9d06-49a4-b233-7d98935d0f31/volumes"
Jul 30 10:36:38.229592 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:38.229581    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46eb225-805a-4701-8910-0db3bcb98d59" path="/var/lib/kubelet/pods/a46eb225-805a-4701-8910-0db3bcb98d59/volumes"
Jul 30 10:36:42.608709 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:42.608678    2581 scope.go:117] "RemoveContainer" containerID="70d5cbb3eacb9e6e42f79fd9a06781a3508d530d114ef56a4fed8e23cba9907f"
Jul 30 10:36:42.971122 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:42.971034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:43.037433 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:43.037401    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:43.248791 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:43.248708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:43.481728 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:43.481692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:43.867889 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:43.867770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:44.205956 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:44.205870    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:44.328363 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:44.328330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:47.330254 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:47.330219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:47.428617 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:47.428578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:48.506125 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506090    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"]
Jul 30 10:36:48.506633 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506615    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2838a42a-c08b-44ed-a8c8-cd5528a90833" containerName="revoke-keys"
Jul 30 10:36:48.506679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506637    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2838a42a-c08b-44ed-a8c8-cd5528a90833" containerName="revoke-keys"
Jul 30 10:36:48.506679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506650    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46eb225-805a-4701-8910-0db3bcb98d59" containerName="maas-api"
Jul 30 10:36:48.506679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506660    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46eb225-805a-4701-8910-0db3bcb98d59" containerName="maas-api"
Jul 30 10:36:48.506772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506699    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b6a84b-0122-4dff-8d3c-95e2cb73efb7" containerName="payload-pre-processing"
Jul 30 10:36:48.506772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506708    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b6a84b-0122-4dff-8d3c-95e2cb73efb7" containerName="payload-pre-processing"
Jul 30 10:36:48.506772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506724    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54f8e3a4-9d06-49a4-b233-7d98935d0f31" containerName="payload-processing"
Jul 30 10:36:48.506772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506734    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="54f8e3a4-9d06-49a4-b233-7d98935d0f31" containerName="payload-processing"
Jul 30 10:36:48.506913 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506812    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="54f8e3a4-9d06-49a4-b233-7d98935d0f31" containerName="payload-processing"
Jul 30 10:36:48.506913 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506847    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46eb225-805a-4701-8910-0db3bcb98d59" containerName="maas-api"
Jul 30 10:36:48.506913 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506857    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="16b6a84b-0122-4dff-8d3c-95e2cb73efb7" containerName="payload-pre-processing"
Jul 30 10:36:48.506913 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.506870    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2838a42a-c08b-44ed-a8c8-cd5528a90833" containerName="revoke-keys"
Jul 30 10:36:48.512055 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.512033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.514196 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.514177    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b89f96-serving-cert\""
Jul 30 10:36:48.524225 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.524197    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"]
Jul 30 10:36:48.551240 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.551212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:48.573494 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.573453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fc73df-df50-4517-898f-75f2b3c62f49-maas-api-tls\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.573494 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.573496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fc73df-df50-4517-898f-75f2b3c62f49-openshift-service-ca\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.573736 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.573573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzx8n\" (UniqueName: \"kubernetes.io/projected/84fc73df-df50-4517-898f-75f2b3c62f49-kube-api-access-kzx8n\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.654068 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.654034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:48.674399 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.674356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fc73df-df50-4517-898f-75f2b3c62f49-maas-api-tls\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.674592 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.674407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fc73df-df50-4517-898f-75f2b3c62f49-openshift-service-ca\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.674592 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.674453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzx8n\" (UniqueName: \"kubernetes.io/projected/84fc73df-df50-4517-898f-75f2b3c62f49-kube-api-access-kzx8n\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.675147 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.675116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fc73df-df50-4517-898f-75f2b3c62f49-openshift-service-ca\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.676971 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.676949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fc73df-df50-4517-898f-75f2b3c62f49-maas-api-tls\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.688027 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.688001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzx8n\" (UniqueName: \"kubernetes.io/projected/84fc73df-df50-4517-898f-75f2b3c62f49-kube-api-access-kzx8n\") pod \"maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.823881 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.823849    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:48.985263 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.985235    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"]
Jul 30 10:36:48.987254 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:36:48.987227    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fc73df_df50_4517_898f_75f2b3c62f49.slice/crio-9d7c6a6ac51b3ee044c215792afddb688353fa16d37cb2d7be04c958c1a3e4bd WatchSource:0}: Error finding container 9d7c6a6ac51b3ee044c215792afddb688353fa16d37cb2d7be04c958c1a3e4bd: Status 404 returned error can't find the container with id 9d7c6a6ac51b3ee044c215792afddb688353fa16d37cb2d7be04c958c1a3e4bd
Jul 30 10:36:48.988785 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:48.988763    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:36:49.197190 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.197099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:49.292457 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.292424    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:36:49.364308 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.364271    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"]
Jul 30 10:36:49.369393 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.369363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:49.373394 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.373369    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b89f96\""
Jul 30 10:36:49.373547 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.373398    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-b89f96-dockercfg-brq7p\""
Jul 30 10:36:49.383990 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.383963    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"]
Jul 30 10:36:49.420975 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.420940    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"]
Jul 30 10:36:49.424198 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.424178    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:49.435060 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.435037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"]
Jul 30 10:36:49.482121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.482031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qlz4\" (UniqueName: \"kubernetes.io/projected/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-kube-api-access-8qlz4\") pod \"payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl\" (UID: \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:49.482121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.482087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2\" (UID: \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\") " pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:49.482347 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.482187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl\" (UID: \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:49.482347 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.482243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvgph\" (UniqueName: \"kubernetes.io/projected/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-kube-api-access-fvgph\") pod \"payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2\" (UID: \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\") " pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:49.582954 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.582918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvgph\" (UniqueName: \"kubernetes.io/projected/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-kube-api-access-fvgph\") pod \"payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2\" (UID: \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\") " pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:49.583365 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.582986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qlz4\" (UniqueName: \"kubernetes.io/projected/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-kube-api-access-8qlz4\") pod \"payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl\" (UID: \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:49.583365 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.583025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2\" (UID: \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\") " pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:49.583365 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.583064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl\" (UID: \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:49.583845 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.583795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl\" (UID: \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:49.583931 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.583800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2\" (UID: \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\") " pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:49.592465 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.592433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvgph\" (UniqueName: \"kubernetes.io/projected/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-kube-api-access-fvgph\") pod \"payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2\" (UID: \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\") " pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:49.592592 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.592482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qlz4\" (UniqueName: \"kubernetes.io/projected/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-kube-api-access-8qlz4\") pod \"payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl\" (UID: \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:49.678342 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.678304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx" event={"ID":"84fc73df-df50-4517-898f-75f2b3c62f49","Type":"ContainerStarted","Data":"9d7c6a6ac51b3ee044c215792afddb688353fa16d37cb2d7be04c958c1a3e4bd"}
Jul 30 10:36:49.680556 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.680528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:49.735065 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.734989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:49.846943 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.846900    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"]
Jul 30 10:36:49.847440 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:36:49.847397    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ead2378_4cfe_4e45_ba23_815f7d2db5cd.slice/crio-415fabf4783e417c54df8f6bb30ff29ef8a2fb75ff8345a803debc37f2286812 WatchSource:0}: Error finding container 415fabf4783e417c54df8f6bb30ff29ef8a2fb75ff8345a803debc37f2286812: Status 404 returned error can't find the container with id 415fabf4783e417c54df8f6bb30ff29ef8a2fb75ff8345a803debc37f2286812
Jul 30 10:36:49.897037 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:49.897012    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"]
Jul 30 10:36:49.901517 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:36:49.901484    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb7d380_0b49_4c7b_b71f_c4bbf1b9d5be.slice/crio-e8e06daf6decde0b2a4c4fc5968456e67e4704b2038161afee07afecc81f2a41 WatchSource:0}: Error finding container e8e06daf6decde0b2a4c4fc5968456e67e4704b2038161afee07afecc81f2a41: Status 404 returned error can't find the container with id e8e06daf6decde0b2a4c4fc5968456e67e4704b2038161afee07afecc81f2a41
Jul 30 10:36:50.686948 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.686888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl" event={"ID":"3ead2378-4cfe-4e45-ba23-815f7d2db5cd","Type":"ContainerStarted","Data":"d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881"}
Jul 30 10:36:50.687445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.686975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:36:50.687445 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.687001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl" event={"ID":"3ead2378-4cfe-4e45-ba23-815f7d2db5cd","Type":"ContainerStarted","Data":"415fabf4783e417c54df8f6bb30ff29ef8a2fb75ff8345a803debc37f2286812"}
Jul 30 10:36:50.688796 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.688752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2" event={"ID":"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be","Type":"ContainerStarted","Data":"b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe"}
Jul 30 10:36:50.688927 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.688835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2" event={"ID":"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be","Type":"ContainerStarted","Data":"e8e06daf6decde0b2a4c4fc5968456e67e4704b2038161afee07afecc81f2a41"}
Jul 30 10:36:50.688927 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.688871    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:36:50.690247 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.690228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx" event={"ID":"84fc73df-df50-4517-898f-75f2b3c62f49","Type":"ContainerStarted","Data":"f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558"}
Jul 30 10:36:50.690375 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.690359    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:36:50.703553 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.703505    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl" podStartSLOduration=1.7034889930000001 podStartE2EDuration="1.703488993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:36:50.702382863 +0000 UTC m=+2829.046446526" watchObservedRunningTime="2026-07-30 10:36:50.703488993 +0000 UTC m=+2829.047552448"
Jul 30 10:36:50.718143 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.718076    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx" podStartSLOduration=1.979912025 podStartE2EDuration="2.71805333s" totalImagesPullingTime="738.141305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:36:50.71734497 +0000 UTC m=+2829.061408426" watchObservedRunningTime="2026-07-30 10:36:50.71805333 +0000 UTC m=+2829.062116789"
Jul 30 10:36:50.732425 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:50.732365    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2" podStartSLOduration=1.7323360490000002 podStartE2EDuration="1.732336049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:36:50.732098776 +0000 UTC m=+2829.076162234" watchObservedRunningTime="2026-07-30 10:36:50.732336049 +0000 UTC m=+2829.076399506"
Jul 30 10:36:56.701269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:36:56.701235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:37:01.697598 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:01.697560    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:37:01.698002 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:01.697640    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:37:12.313627 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:12.313584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:12.812577 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:12.812545    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:13.136269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:13.136181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:13.337790 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:13.337757    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:16.718992 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:16.718953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:16.817628 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:16.817586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:17.600664 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.600631    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"]
Jul 30 10:37:17.605495 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.605469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.607574 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.607547    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-220161-serving-cert\""
Jul 30 10:37:17.613106 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.613080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"]
Jul 30 10:37:17.643866 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.643796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:17.646705 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.646675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.646875 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.646772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-openshift-service-ca\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.646875 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.646802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnhkq\" (UniqueName: \"kubernetes.io/projected/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-kube-api-access-pnhkq\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.747591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.747541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-openshift-service-ca\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.747591 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.747594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnhkq\" (UniqueName: \"kubernetes.io/projected/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-kube-api-access-pnhkq\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.748178 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.747678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.748178 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:37:17.747848    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-220161-serving-cert: secret "maas-api-e2e-api-b-220161-serving-cert" not found
Jul 30 10:37:17.748178 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:37:17.747920    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls podName:e4800b3e-231b-45e1-901b-b6e3d24ce0f5 nodeName:}" failed. No retries permitted until 2026-07-30 10:37:18.247903684 +0000 UTC m=+2856.591967118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls") pod "maas-api-e2e-api-b-220161-5f9577876c-gbc9h" (UID: "e4800b3e-231b-45e1-901b-b6e3d24ce0f5") : secret "maas-api-e2e-api-b-220161-serving-cert" not found
Jul 30 10:37:17.748292 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.748253    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-openshift-service-ca\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.757060 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.757035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnhkq\" (UniqueName: \"kubernetes.io/projected/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-kube-api-access-pnhkq\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:17.928942 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:17.928838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:18.146285 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.146252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:18.253386 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.253287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:18.255900 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.255875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls\") pod \"maas-api-e2e-api-b-220161-5f9577876c-gbc9h\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:18.276912 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.276876    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"]
Jul 30 10:37:18.280526 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.280508    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.283416 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.283396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-220161-dockercfg-l49bk\""
Jul 30 10:37:18.283770 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.283754    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-220161\""
Jul 30 10:37:18.292284 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.292258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"]
Jul 30 10:37:18.333954 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.333925    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"]
Jul 30 10:37:18.337309 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.337292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:18.352205 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.352176    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"]
Jul 30 10:37:18.354124 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.354100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-plugins-config-volume\") pod \"payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh\" (UID: \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\") " pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.354249 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.354150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46hw\" (UniqueName: \"kubernetes.io/projected/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-kube-api-access-s46hw\") pod \"payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh\" (UID: \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\") " pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.354249 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.354235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlz2k\" (UniqueName: \"kubernetes.io/projected/03eba7c6-f34d-497c-a157-6949fc882e18-kube-api-access-xlz2k\") pod \"payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w\" (UID: \"03eba7c6-f34d-497c-a157-6949fc882e18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:18.354369 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.354291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03eba7c6-f34d-497c-a157-6949fc882e18-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w\" (UID: \"03eba7c6-f34d-497c-a157-6949fc882e18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:18.455697 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.455658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlz2k\" (UniqueName: \"kubernetes.io/projected/03eba7c6-f34d-497c-a157-6949fc882e18-kube-api-access-xlz2k\") pod \"payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w\" (UID: \"03eba7c6-f34d-497c-a157-6949fc882e18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:18.455921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.455729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03eba7c6-f34d-497c-a157-6949fc882e18-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w\" (UID: \"03eba7c6-f34d-497c-a157-6949fc882e18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:18.455921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.455839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-plugins-config-volume\") pod \"payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh\" (UID: \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\") " pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.455921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.455889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s46hw\" (UniqueName: \"kubernetes.io/projected/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-kube-api-access-s46hw\") pod \"payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh\" (UID: \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\") " pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.456491 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.456472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03eba7c6-f34d-497c-a157-6949fc882e18-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w\" (UID: \"03eba7c6-f34d-497c-a157-6949fc882e18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:18.456739 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.456714    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-plugins-config-volume\") pod \"payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh\" (UID: \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\") " pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.463992 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.463959    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46hw\" (UniqueName: \"kubernetes.io/projected/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-kube-api-access-s46hw\") pod \"payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh\" (UID: \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\") " pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.463992 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.463963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlz2k\" (UniqueName: \"kubernetes.io/projected/03eba7c6-f34d-497c-a157-6949fc882e18-kube-api-access-xlz2k\") pod \"payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w\" (UID: \"03eba7c6-f34d-497c-a157-6949fc882e18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:18.518914 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.518794    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:18.591478 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.591441    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.647253 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.647225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:18.653669 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.653222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:18.670161 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.670127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"]
Jul 30 10:37:18.671312 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:37:18.671274    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4800b3e_231b_45e1_901b_b6e3d24ce0f5.slice/crio-f9a4c1adb0000e4be0926f1ea3d99f74fa74a85510766a7aad0811ac383a7814 WatchSource:0}: Error finding container f9a4c1adb0000e4be0926f1ea3d99f74fa74a85510766a7aad0811ac383a7814: Status 404 returned error can't find the container with id f9a4c1adb0000e4be0926f1ea3d99f74fa74a85510766a7aad0811ac383a7814
Jul 30 10:37:18.744332 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.744300    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"]
Jul 30 10:37:18.745559 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:37:18.745530    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5b5b6e_4de5_47af_9d6e_8a5a55955258.slice/crio-d2151e4efbb3d7b66611c284e20200aace0a277806420095ba8366943a3dcea6 WatchSource:0}: Error finding container d2151e4efbb3d7b66611c284e20200aace0a277806420095ba8366943a3dcea6: Status 404 returned error can't find the container with id d2151e4efbb3d7b66611c284e20200aace0a277806420095ba8366943a3dcea6
Jul 30 10:37:18.804989 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.804961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"]
Jul 30 10:37:18.806280 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:37:18.806256    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03eba7c6_f34d_497c_a157_6949fc882e18.slice/crio-0df42c3066928afad2c6e5a687513f16026aadb7100774c9b12af2af5f2ef882 WatchSource:0}: Error finding container 0df42c3066928afad2c6e5a687513f16026aadb7100774c9b12af2af5f2ef882: Status 404 returned error can't find the container with id 0df42c3066928afad2c6e5a687513f16026aadb7100774c9b12af2af5f2ef882
Jul 30 10:37:18.829979 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.829945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w" event={"ID":"03eba7c6-f34d-497c-a157-6949fc882e18","Type":"ContainerStarted","Data":"0df42c3066928afad2c6e5a687513f16026aadb7100774c9b12af2af5f2ef882"}
Jul 30 10:37:18.831896 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.831844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh" event={"ID":"7b5b5b6e-4de5-47af-9d6e-8a5a55955258","Type":"ContainerStarted","Data":"7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34"}
Jul 30 10:37:18.832058 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.831910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh" event={"ID":"7b5b5b6e-4de5-47af-9d6e-8a5a55955258","Type":"ContainerStarted","Data":"d2151e4efbb3d7b66611c284e20200aace0a277806420095ba8366943a3dcea6"}
Jul 30 10:37:18.832058 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.831965    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:18.833346 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.833316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h" event={"ID":"e4800b3e-231b-45e1-901b-b6e3d24ce0f5","Type":"ContainerStarted","Data":"f9a4c1adb0000e4be0926f1ea3d99f74fa74a85510766a7aad0811ac383a7814"}
Jul 30 10:37:18.850056 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:18.850004    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh" podStartSLOduration=0.849989129 podStartE2EDuration="849.989129ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:37:18.847926115 +0000 UTC m=+2857.191989576" watchObservedRunningTime="2026-07-30 10:37:18.849989129 +0000 UTC m=+2857.194052621"
Jul 30 10:37:19.841560 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:19.841523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w" event={"ID":"03eba7c6-f34d-497c-a157-6949fc882e18","Type":"ContainerStarted","Data":"7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d"}
Jul 30 10:37:19.842059 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:19.841591    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:19.843240 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:19.843216    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h" event={"ID":"e4800b3e-231b-45e1-901b-b6e3d24ce0f5","Type":"ContainerStarted","Data":"d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31"}
Jul 30 10:37:19.843364 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:19.843343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:19.856266 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:19.856214    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w" podStartSLOduration=1.856199103 podStartE2EDuration="1.856199103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:37:19.855459317 +0000 UTC m=+2858.199522773" watchObservedRunningTime="2026-07-30 10:37:19.856199103 +0000 UTC m=+2858.200262559"
Jul 30 10:37:19.878623 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:19.874573    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h" podStartSLOduration=2.5442409599999998 podStartE2EDuration="2.874552515s" totalImagesPullingTime="330.311555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:37:19.869978368 +0000 UTC m=+2858.214041824" watchObservedRunningTime="2026-07-30 10:37:19.874552515 +0000 UTC m=+2858.218615975"
Jul 30 10:37:25.853307 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:25.853274    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:37:29.845304 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:29.845268    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:37:30.850790 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:30.850760    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:37:41.575014 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:41.574980    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:42.649753 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:42.649720    2581 scope.go:117] "RemoveContainer" containerID="d020898c0f53fd8a901a753bac1a11b7d68cc4dfcecea2752f966c6fd50f5b5b"
Jul 30 10:37:55.780093 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:55.780026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:37:55.842333 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:37:55.842299    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:00.268710 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.268369    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"]
Jul 30 10:38:00.269518 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.269482    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx" podUID="84fc73df-df50-4517-898f-75f2b3c62f49" containerName="maas-api" containerID="cri-o://f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558" gracePeriod=30
Jul 30 10:38:00.297671 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.297629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:00.324931 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.324896    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"]
Jul 30 10:38:00.325226 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.325197    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2" podUID="3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be" containerName="payload-processing" containerID="cri-o://b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe" gracePeriod=30
Jul 30 10:38:00.337485 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.337449    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"]
Jul 30 10:38:00.338051 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.337999    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl" podUID="3ead2378-4cfe-4e45-ba23-815f7d2db5cd" containerName="payload-pre-processing" containerID="cri-o://d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881" gracePeriod=30
Jul 30 10:38:00.375413 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.375381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:00.443215 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.443178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:00.507413 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.507361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:00.627443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.627421    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:38:00.630643 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.630625    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:38:00.633977 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.633960    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:38:00.756732 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.756696    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qlz4\" (UniqueName: \"kubernetes.io/projected/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-kube-api-access-8qlz4\") pod \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\" (UID: \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\") "
Jul 30 10:38:00.756732 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.756735    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvgph\" (UniqueName: \"kubernetes.io/projected/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-kube-api-access-fvgph\") pod \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\" (UID: \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\") "
Jul 30 10:38:00.756995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.756799    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fc73df-df50-4517-898f-75f2b3c62f49-openshift-service-ca\") pod \"84fc73df-df50-4517-898f-75f2b3c62f49\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") "
Jul 30 10:38:00.756995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.756863    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-plugins-config-volume\") pod \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\" (UID: \"3ead2378-4cfe-4e45-ba23-815f7d2db5cd\") "
Jul 30 10:38:00.756995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.756909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fc73df-df50-4517-898f-75f2b3c62f49-maas-api-tls\") pod \"84fc73df-df50-4517-898f-75f2b3c62f49\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") "
Jul 30 10:38:00.756995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.756939    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzx8n\" (UniqueName: \"kubernetes.io/projected/84fc73df-df50-4517-898f-75f2b3c62f49-kube-api-access-kzx8n\") pod \"84fc73df-df50-4517-898f-75f2b3c62f49\" (UID: \"84fc73df-df50-4517-898f-75f2b3c62f49\") "
Jul 30 10:38:00.756995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.756992    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-plugins-config-volume\") pod \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\" (UID: \"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be\") "
Jul 30 10:38:00.757200 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.757171    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84fc73df-df50-4517-898f-75f2b3c62f49-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84fc73df-df50-4517-898f-75f2b3c62f49" (UID: "84fc73df-df50-4517-898f-75f2b3c62f49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:38:00.757322 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.757279    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ead2378-4cfe-4e45-ba23-815f7d2db5cd" (UID: "3ead2378-4cfe-4e45-ba23-815f7d2db5cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:38:00.757322 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.757290    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fc73df-df50-4517-898f-75f2b3c62f49-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:00.757522 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.757504    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be" (UID: "3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:38:00.759528 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.759498    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84fc73df-df50-4517-898f-75f2b3c62f49-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84fc73df-df50-4517-898f-75f2b3c62f49" (UID: "84fc73df-df50-4517-898f-75f2b3c62f49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:38:00.759613 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.759563    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-kube-api-access-8qlz4" (OuterVolumeSpecName: "kube-api-access-8qlz4") pod "3ead2378-4cfe-4e45-ba23-815f7d2db5cd" (UID: "3ead2378-4cfe-4e45-ba23-815f7d2db5cd"). InnerVolumeSpecName "kube-api-access-8qlz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:38:00.759613 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.759569    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-kube-api-access-fvgph" (OuterVolumeSpecName: "kube-api-access-fvgph") pod "3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be" (UID: "3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be"). InnerVolumeSpecName "kube-api-access-fvgph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:38:00.759613 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.759588    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84fc73df-df50-4517-898f-75f2b3c62f49-kube-api-access-kzx8n" (OuterVolumeSpecName: "kube-api-access-kzx8n") pod "84fc73df-df50-4517-898f-75f2b3c62f49" (UID: "84fc73df-df50-4517-898f-75f2b3c62f49"). InnerVolumeSpecName "kube-api-access-kzx8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:38:00.858568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.858494    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:00.858568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.858521    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fc73df-df50-4517-898f-75f2b3c62f49-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:00.858568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.858531    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzx8n\" (UniqueName: \"kubernetes.io/projected/84fc73df-df50-4517-898f-75f2b3c62f49-kube-api-access-kzx8n\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:00.858568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.858540    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:00.858568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.858549    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qlz4\" (UniqueName: \"kubernetes.io/projected/3ead2378-4cfe-4e45-ba23-815f7d2db5cd-kube-api-access-8qlz4\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:00.858568 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.858557    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvgph\" (UniqueName: \"kubernetes.io/projected/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be-kube-api-access-fvgph\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:00.894308 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:00.894277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:01.050017 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.049981    2581 generic.go:356] "Generic (PLEG): container finished" podID="3ead2378-4cfe-4e45-ba23-815f7d2db5cd" containerID="d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881" exitCode=0
Jul 30 10:38:01.050210 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.050026    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"
Jul 30 10:38:01.050210 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.050074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl" event={"ID":"3ead2378-4cfe-4e45-ba23-815f7d2db5cd","Type":"ContainerDied","Data":"d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881"}
Jul 30 10:38:01.050210 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.050127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl" event={"ID":"3ead2378-4cfe-4e45-ba23-815f7d2db5cd","Type":"ContainerDied","Data":"415fabf4783e417c54df8f6bb30ff29ef8a2fb75ff8345a803debc37f2286812"}
Jul 30 10:38:01.050210 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.050155    2581 scope.go:117] "RemoveContainer" containerID="d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881"
Jul 30 10:38:01.051418 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.051392    2581 generic.go:356] "Generic (PLEG): container finished" podID="3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be" containerID="b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe" exitCode=0
Jul 30 10:38:01.051543 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.051423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2" event={"ID":"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be","Type":"ContainerDied","Data":"b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe"}
Jul 30 10:38:01.051543 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.051443    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"
Jul 30 10:38:01.051543 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.051465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2" event={"ID":"3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be","Type":"ContainerDied","Data":"e8e06daf6decde0b2a4c4fc5968456e67e4704b2038161afee07afecc81f2a41"}
Jul 30 10:38:01.052840 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.052795    2581 generic.go:356] "Generic (PLEG): container finished" podID="84fc73df-df50-4517-898f-75f2b3c62f49" containerID="f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558" exitCode=0
Jul 30 10:38:01.052932 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.052853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx" event={"ID":"84fc73df-df50-4517-898f-75f2b3c62f49","Type":"ContainerDied","Data":"f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558"}
Jul 30 10:38:01.052932 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.052862    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"
Jul 30 10:38:01.052932 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.052889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx" event={"ID":"84fc73df-df50-4517-898f-75f2b3c62f49","Type":"ContainerDied","Data":"9d7c6a6ac51b3ee044c215792afddb688353fa16d37cb2d7be04c958c1a3e4bd"}
Jul 30 10:38:01.059588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.059548    2581 scope.go:117] "RemoveContainer" containerID="d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881"
Jul 30 10:38:01.059894 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:38:01.059863    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881\": container with ID starting with d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881 not found: ID does not exist" containerID="d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881"
Jul 30 10:38:01.059995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.059905    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881"} err="failed to get container status \"d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881\": rpc error: code = NotFound desc = could not find container \"d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881\": container with ID starting with d088642570e759d665b9b76ebc518ef5bd30836e3b8039f7c413b3c0f775c881 not found: ID does not exist"
Jul 30 10:38:01.059995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.059930    2581 scope.go:117] "RemoveContainer" containerID="b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe"
Jul 30 10:38:01.069626 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.069609    2581 scope.go:117] "RemoveContainer" containerID="b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe"
Jul 30 10:38:01.069904 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:38:01.069885    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe\": container with ID starting with b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe not found: ID does not exist" containerID="b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe"
Jul 30 10:38:01.069964 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.069912    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe"} err="failed to get container status \"b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe\": rpc error: code = NotFound desc = could not find container \"b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe\": container with ID starting with b2ab4bd5c922d77fa3e652ec302e7ce730c2bb615f3a6136695dfbc5277f2cbe not found: ID does not exist"
Jul 30 10:38:01.069964 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.069929    2581 scope.go:117] "RemoveContainer" containerID="f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558"
Jul 30 10:38:01.077831 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.077799    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"]
Jul 30 10:38:01.078627 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.078612    2581 scope.go:117] "RemoveContainer" containerID="f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558"
Jul 30 10:38:01.078908 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:38:01.078890    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558\": container with ID starting with f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558 not found: ID does not exist" containerID="f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558"
Jul 30 10:38:01.078972 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.078915    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558"} err="failed to get container status \"f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558\": rpc error: code = NotFound desc = could not find container \"f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558\": container with ID starting with f77df5ad8fdbc09968cac7d18082e724c9f6fa2fd3b3c2ab617feb80539b9558 not found: ID does not exist"
Jul 30 10:38:01.081997 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.081976    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b89f96-56cc54b9b4-kx2qx"]
Jul 30 10:38:01.090926 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.090904    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"]
Jul 30 10:38:01.092626 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.092603    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl"]
Jul 30 10:38:01.102934 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.102865    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"]
Jul 30 10:38:01.104830 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:01.104798    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2"]
Jul 30 10:38:02.227520 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:02.227490    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be" path="/var/lib/kubelet/pods/3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be/volumes"
Jul 30 10:38:02.227991 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:02.227869    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ead2378-4cfe-4e45-ba23-815f7d2db5cd" path="/var/lib/kubelet/pods/3ead2378-4cfe-4e45-ba23-815f7d2db5cd/volumes"
Jul 30 10:38:02.228215 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:02.228202    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84fc73df-df50-4517-898f-75f2b3c62f49" path="/var/lib/kubelet/pods/84fc73df-df50-4517-898f-75f2b3c62f49/volumes"
Jul 30 10:38:06.651005 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:06.650973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:06.711129 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:06.711091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:07.239731 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:07.239701    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:07.310269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:07.310232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:22.754796 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:22.754761    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"]
Jul 30 10:38:22.755304 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:22.755021    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h" podUID="e4800b3e-231b-45e1-901b-b6e3d24ce0f5" containerName="maas-api" containerID="cri-o://d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31" gracePeriod=30
Jul 30 10:38:22.786330 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:22.786300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:22.874404 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:22.874368    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"]
Jul 30 10:38:22.874719 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:22.874687    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh" podUID="7b5b5b6e-4de5-47af-9d6e-8a5a55955258" containerName="payload-processing" containerID="cri-o://7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34" gracePeriod=30
Jul 30 10:38:22.881020 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:22.880987    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"]
Jul 30 10:38:22.881262 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:22.881238    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w" podUID="03eba7c6-f34d-497c-a157-6949fc882e18" containerName="payload-pre-processing" containerID="cri-o://7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d" gracePeriod=30
Jul 30 10:38:22.911083 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:22.910983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:23.010984 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.010876    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:23.035965 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.035938    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:38:23.133190 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.133168    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:38:23.140797 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.140770    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:38:23.150686 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.150410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls\") pod \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") "
Jul 30 10:38:23.150686 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.150480    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnhkq\" (UniqueName: \"kubernetes.io/projected/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-kube-api-access-pnhkq\") pod \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") "
Jul 30 10:38:23.150686 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.150509    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-openshift-service-ca\") pod \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\" (UID: \"e4800b3e-231b-45e1-901b-b6e3d24ce0f5\") "
Jul 30 10:38:23.151707 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.151663    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4800b3e-231b-45e1-901b-b6e3d24ce0f5" (UID: "e4800b3e-231b-45e1-901b-b6e3d24ce0f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:38:23.153284 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.153251    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4800b3e-231b-45e1-901b-b6e3d24ce0f5" (UID: "e4800b3e-231b-45e1-901b-b6e3d24ce0f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:38:23.153471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.153443    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-kube-api-access-pnhkq" (OuterVolumeSpecName: "kube-api-access-pnhkq") pod "e4800b3e-231b-45e1-901b-b6e3d24ce0f5" (UID: "e4800b3e-231b-45e1-901b-b6e3d24ce0f5"). InnerVolumeSpecName "kube-api-access-pnhkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:38:23.166886 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.166851    2581 generic.go:356] "Generic (PLEG): container finished" podID="03eba7c6-f34d-497c-a157-6949fc882e18" containerID="7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d" exitCode=0
Jul 30 10:38:23.167037 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.166899    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"
Jul 30 10:38:23.167037 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.166945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w" event={"ID":"03eba7c6-f34d-497c-a157-6949fc882e18","Type":"ContainerDied","Data":"7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d"}
Jul 30 10:38:23.167037 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.167013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w" event={"ID":"03eba7c6-f34d-497c-a157-6949fc882e18","Type":"ContainerDied","Data":"0df42c3066928afad2c6e5a687513f16026aadb7100774c9b12af2af5f2ef882"}
Jul 30 10:38:23.167198 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.167047    2581 scope.go:117] "RemoveContainer" containerID="7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d"
Jul 30 10:38:23.168394 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.168373    2581 generic.go:356] "Generic (PLEG): container finished" podID="7b5b5b6e-4de5-47af-9d6e-8a5a55955258" containerID="7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34" exitCode=0
Jul 30 10:38:23.168503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.168404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh" event={"ID":"7b5b5b6e-4de5-47af-9d6e-8a5a55955258","Type":"ContainerDied","Data":"7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34"}
Jul 30 10:38:23.168503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.168418    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"
Jul 30 10:38:23.168503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.168452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh" event={"ID":"7b5b5b6e-4de5-47af-9d6e-8a5a55955258","Type":"ContainerDied","Data":"d2151e4efbb3d7b66611c284e20200aace0a277806420095ba8366943a3dcea6"}
Jul 30 10:38:23.169946 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.169928    2581 generic.go:356] "Generic (PLEG): container finished" podID="e4800b3e-231b-45e1-901b-b6e3d24ce0f5" containerID="d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31" exitCode=0
Jul 30 10:38:23.170054 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.169970    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"
Jul 30 10:38:23.170054 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.169982    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h" event={"ID":"e4800b3e-231b-45e1-901b-b6e3d24ce0f5","Type":"ContainerDied","Data":"d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31"}
Jul 30 10:38:23.170054 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.170026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h" event={"ID":"e4800b3e-231b-45e1-901b-b6e3d24ce0f5","Type":"ContainerDied","Data":"f9a4c1adb0000e4be0926f1ea3d99f74fa74a85510766a7aad0811ac383a7814"}
Jul 30 10:38:23.177588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.177571    2581 scope.go:117] "RemoveContainer" containerID="7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d"
Jul 30 10:38:23.178108 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:38:23.177927    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d\": container with ID starting with 7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d not found: ID does not exist" containerID="7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d"
Jul 30 10:38:23.178108 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.177962    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d"} err="failed to get container status \"7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d\": rpc error: code = NotFound desc = could not find container \"7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d\": container with ID starting with 7645215fd9a3994c1c717e4ad08deeee01f089b06b604edae5934ab30354cb4d not found: ID does not exist"
Jul 30 10:38:23.178108 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.177987    2581 scope.go:117] "RemoveContainer" containerID="7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34"
Jul 30 10:38:23.186580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.186563    2581 scope.go:117] "RemoveContainer" containerID="7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34"
Jul 30 10:38:23.186837 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:38:23.186797    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34\": container with ID starting with 7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34 not found: ID does not exist" containerID="7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34"
Jul 30 10:38:23.186891 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.186850    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34"} err="failed to get container status \"7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34\": rpc error: code = NotFound desc = could not find container \"7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34\": container with ID starting with 7a1589b3c58074435610ccdbfb7138080449f2da213409b80398b7d775826b34 not found: ID does not exist"
Jul 30 10:38:23.186891 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.186872    2581 scope.go:117] "RemoveContainer" containerID="d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31"
Jul 30 10:38:23.190375 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.190354    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"]
Jul 30 10:38:23.194446 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.194424    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-220161-5f9577876c-gbc9h"]
Jul 30 10:38:23.195516 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.195490    2581 scope.go:117] "RemoveContainer" containerID="d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31"
Jul 30 10:38:23.195796 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:38:23.195778    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31\": container with ID starting with d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31 not found: ID does not exist" containerID="d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31"
Jul 30 10:38:23.195861 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.195807    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31"} err="failed to get container status \"d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31\": rpc error: code = NotFound desc = could not find container \"d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31\": container with ID starting with d038380ecaf93712a8de3e106e64c44d82e3d09d54af032842605dbd02ceca31 not found: ID does not exist"
Jul 30 10:38:23.251456 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251427    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s46hw\" (UniqueName: \"kubernetes.io/projected/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-kube-api-access-s46hw\") pod \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\" (UID: \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\") "
Jul 30 10:38:23.251456 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251463    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlz2k\" (UniqueName: \"kubernetes.io/projected/03eba7c6-f34d-497c-a157-6949fc882e18-kube-api-access-xlz2k\") pod \"03eba7c6-f34d-497c-a157-6949fc882e18\" (UID: \"03eba7c6-f34d-497c-a157-6949fc882e18\") "
Jul 30 10:38:23.251681 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251505    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-plugins-config-volume\") pod \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\" (UID: \"7b5b5b6e-4de5-47af-9d6e-8a5a55955258\") "
Jul 30 10:38:23.251681 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251559    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03eba7c6-f34d-497c-a157-6949fc882e18-plugins-config-volume\") pod \"03eba7c6-f34d-497c-a157-6949fc882e18\" (UID: \"03eba7c6-f34d-497c-a157-6949fc882e18\") "
Jul 30 10:38:23.251919 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251893    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:23.252044 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251925    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnhkq\" (UniqueName: \"kubernetes.io/projected/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-kube-api-access-pnhkq\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:23.252044 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251942    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4800b3e-231b-45e1-901b-b6e3d24ce0f5-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:23.252044 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251948    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b5b5b6e-4de5-47af-9d6e-8a5a55955258" (UID: "7b5b5b6e-4de5-47af-9d6e-8a5a55955258"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:38:23.252044 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.251981    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03eba7c6-f34d-497c-a157-6949fc882e18-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03eba7c6-f34d-497c-a157-6949fc882e18" (UID: "03eba7c6-f34d-497c-a157-6949fc882e18"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:38:23.253638 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.253617    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03eba7c6-f34d-497c-a157-6949fc882e18-kube-api-access-xlz2k" (OuterVolumeSpecName: "kube-api-access-xlz2k") pod "03eba7c6-f34d-497c-a157-6949fc882e18" (UID: "03eba7c6-f34d-497c-a157-6949fc882e18"). InnerVolumeSpecName "kube-api-access-xlz2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:38:23.253694 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.253662    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-kube-api-access-s46hw" (OuterVolumeSpecName: "kube-api-access-s46hw") pod "7b5b5b6e-4de5-47af-9d6e-8a5a55955258" (UID: "7b5b5b6e-4de5-47af-9d6e-8a5a55955258"). InnerVolumeSpecName "kube-api-access-s46hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:38:23.343106 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.343072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:23.353118 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.353093    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s46hw\" (UniqueName: \"kubernetes.io/projected/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-kube-api-access-s46hw\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:23.353118 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.353120    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlz2k\" (UniqueName: \"kubernetes.io/projected/03eba7c6-f34d-497c-a157-6949fc882e18-kube-api-access-xlz2k\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:23.353258 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.353130    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5b5b6e-4de5-47af-9d6e-8a5a55955258-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:23.353258 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.353139    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03eba7c6-f34d-497c-a157-6949fc882e18-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:38:23.443728 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.443695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:23.489715 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.489685    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"]
Jul 30 10:38:23.493516 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.493488    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w"]
Jul 30 10:38:23.504370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.504345    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"]
Jul 30 10:38:23.510090 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:23.510069    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh"]
Jul 30 10:38:24.227886 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:24.227847    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03eba7c6-f34d-497c-a157-6949fc882e18" path="/var/lib/kubelet/pods/03eba7c6-f34d-497c-a157-6949fc882e18/volumes"
Jul 30 10:38:24.228386 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:24.228369    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5b5b6e-4de5-47af-9d6e-8a5a55955258" path="/var/lib/kubelet/pods/7b5b5b6e-4de5-47af-9d6e-8a5a55955258/volumes"
Jul 30 10:38:24.228772 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:24.228752    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4800b3e-231b-45e1-901b-b6e3d24ce0f5" path="/var/lib/kubelet/pods/e4800b3e-231b-45e1-901b-b6e3d24ce0f5/volumes"
Jul 30 10:38:29.164412 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:29.164372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:30.896235 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:30.896189    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:32.920329 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:32.920295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:33.018968 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:33.018932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:34.017597 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.017565    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"]
Jul 30 10:38:34.018010 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.017955    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ead2378-4cfe-4e45-ba23-815f7d2db5cd" containerName="payload-pre-processing"
Jul 30 10:38:34.018010 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.017971    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ead2378-4cfe-4e45-ba23-815f7d2db5cd" containerName="payload-pre-processing"
Jul 30 10:38:34.018010 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.017987    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be" containerName="payload-processing"
Jul 30 10:38:34.018010 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.017995    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be" containerName="payload-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018024    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03eba7c6-f34d-497c-a157-6949fc882e18" containerName="payload-pre-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018031    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="03eba7c6-f34d-497c-a157-6949fc882e18" containerName="payload-pre-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018042    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4800b3e-231b-45e1-901b-b6e3d24ce0f5" containerName="maas-api"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018047    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4800b3e-231b-45e1-901b-b6e3d24ce0f5" containerName="maas-api"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018057    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84fc73df-df50-4517-898f-75f2b3c62f49" containerName="maas-api"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018062    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="84fc73df-df50-4517-898f-75f2b3c62f49" containerName="maas-api"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018070    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5b5b6e-4de5-47af-9d6e-8a5a55955258" containerName="payload-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018075    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b5b6e-4de5-47af-9d6e-8a5a55955258" containerName="payload-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018129    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="84fc73df-df50-4517-898f-75f2b3c62f49" containerName="maas-api"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018138    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bb7d380-0b49-4c7b-b71f-c4bbf1b9d5be" containerName="payload-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018145    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5b5b6e-4de5-47af-9d6e-8a5a55955258" containerName="payload-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018150    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ead2378-4cfe-4e45-ba23-815f7d2db5cd" containerName="payload-pre-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018157    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="03eba7c6-f34d-497c-a157-6949fc882e18" containerName="payload-pre-processing"
Jul 30 10:38:34.018195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.018163    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4800b3e-231b-45e1-901b-b6e3d24ce0f5" containerName="maas-api"
Jul 30 10:38:34.023410 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.023392    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.025345 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.025327    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b75946-serving-cert\""
Jul 30 10:38:34.032836 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.032789    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"]
Jul 30 10:38:34.035509 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.035484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:34.153947 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.153914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-maas-api-tls\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.154148 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.153983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.154148 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.154026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsb6l\" (UniqueName: \"kubernetes.io/projected/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-kube-api-access-nsb6l\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.177763 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.177730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:34.254541 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.254506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-maas-api-tls\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.254729 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.254601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.254729 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.254638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsb6l\" (UniqueName: \"kubernetes.io/projected/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-kube-api-access-nsb6l\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.255305 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.255279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.257092 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.257063    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-maas-api-tls\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.262121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.262100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsb6l\" (UniqueName: \"kubernetes.io/projected/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-kube-api-access-nsb6l\") pod \"maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.335298 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.335262    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:34.472502 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.472475    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"]
Jul 30 10:38:34.474847 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:38:34.474794    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a86a4e_cd6b_4425_89fd_15d2ac515fd4.slice/crio-00938fd9e67f72d559ab5a899b67a1782dde4663d318c62bac2636db1d8dbbe6 WatchSource:0}: Error finding container 00938fd9e67f72d559ab5a899b67a1782dde4663d318c62bac2636db1d8dbbe6: Status 404 returned error can't find the container with id 00938fd9e67f72d559ab5a899b67a1782dde4663d318c62bac2636db1d8dbbe6
Jul 30 10:38:34.645150 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.645062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:34.734888 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.734855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:34.752579 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.752543    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"]
Jul 30 10:38:34.757538 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.757511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:34.759730 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.759705    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-b75946\""
Jul 30 10:38:34.765455 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.765427    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"]
Jul 30 10:38:34.768971 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.768949    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"]
Jul 30 10:38:34.769097 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.769073    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:34.771340 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.771319    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-b75946-dockercfg-5cqzw\""
Jul 30 10:38:34.777542 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.777457    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"]
Jul 30 10:38:34.859828 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.859790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l75jf\" (UniqueName: \"kubernetes.io/projected/8a7a0400-c0b3-4938-a818-ee91c4c84c57-kube-api-access-l75jf\") pod \"payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2\" (UID: \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:34.860022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.859890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c\" (UID: \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:34.860022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.859911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7a0400-c0b3-4938-a818-ee91c4c84c57-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2\" (UID: \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:34.860022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.860004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ld85\" (UniqueName: \"kubernetes.io/projected/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-kube-api-access-5ld85\") pod \"payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c\" (UID: \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:34.961407 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.961382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c\" (UID: \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:34.961535 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.961414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7a0400-c0b3-4938-a818-ee91c4c84c57-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2\" (UID: \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:34.961535 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.961471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ld85\" (UniqueName: \"kubernetes.io/projected/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-kube-api-access-5ld85\") pod \"payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c\" (UID: \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:34.961535 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.961499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l75jf\" (UniqueName: \"kubernetes.io/projected/8a7a0400-c0b3-4938-a818-ee91c4c84c57-kube-api-access-l75jf\") pod \"payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2\" (UID: \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:34.962266 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.962240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c\" (UID: \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:34.962306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.962284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7a0400-c0b3-4938-a818-ee91c4c84c57-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2\" (UID: \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:34.968399 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.968371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ld85\" (UniqueName: \"kubernetes.io/projected/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-kube-api-access-5ld85\") pod \"payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c\" (UID: \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:34.968505 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:34.968423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l75jf\" (UniqueName: \"kubernetes.io/projected/8a7a0400-c0b3-4938-a818-ee91c4c84c57-kube-api-access-l75jf\") pod \"payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2\" (UID: \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:35.069389 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.069355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:35.080687 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.080661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:35.216406 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.216153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"]
Jul 30 10:38:35.218682 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:38:35.218655    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7a0400_c0b3_4938_a818_ee91c4c84c57.slice/crio-bac2e8ff77fbe75d0999656902e0d433f5dedf2563ed550a103744042ef62703 WatchSource:0}: Error finding container bac2e8ff77fbe75d0999656902e0d433f5dedf2563ed550a103744042ef62703: Status 404 returned error can't find the container with id bac2e8ff77fbe75d0999656902e0d433f5dedf2563ed550a103744042ef62703
Jul 30 10:38:35.230675 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.230644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2" event={"ID":"8a7a0400-c0b3-4938-a818-ee91c4c84c57","Type":"ContainerStarted","Data":"bac2e8ff77fbe75d0999656902e0d433f5dedf2563ed550a103744042ef62703"}
Jul 30 10:38:35.232357 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.232332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6" event={"ID":"15a86a4e-cd6b-4425-89fd-15d2ac515fd4","Type":"ContainerStarted","Data":"5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb"}
Jul 30 10:38:35.232463 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.232379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6" event={"ID":"15a86a4e-cd6b-4425-89fd-15d2ac515fd4","Type":"ContainerStarted","Data":"00938fd9e67f72d559ab5a899b67a1782dde4663d318c62bac2636db1d8dbbe6"}
Jul 30 10:38:35.232463 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.232426    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:35.244219 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.244200    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"]
Jul 30 10:38:35.250303 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:35.250262    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6" podStartSLOduration=1.823635265 podStartE2EDuration="2.250247638s" totalImagesPullingTime="426.612373ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:38:35.249607637 +0000 UTC m=+2933.593671093" watchObservedRunningTime="2026-07-30 10:38:35.250247638 +0000 UTC m=+2933.594311094"
Jul 30 10:38:35.256219 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:38:35.256195    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21580a0_c075_41b3_bc9a_cd8fb28e1daa.slice/crio-fad5df150218f9fdc159d062c5a507340920310a957b38d663bf9a146d6688f6 WatchSource:0}: Error finding container fad5df150218f9fdc159d062c5a507340920310a957b38d663bf9a146d6688f6: Status 404 returned error can't find the container with id fad5df150218f9fdc159d062c5a507340920310a957b38d663bf9a146d6688f6
Jul 30 10:38:36.239906 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:36.239869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2" event={"ID":"8a7a0400-c0b3-4938-a818-ee91c4c84c57","Type":"ContainerStarted","Data":"aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543"}
Jul 30 10:38:36.240472 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:36.240443    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:36.241810 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:36.241781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c" event={"ID":"e21580a0-c075-41b3-bc9a-cd8fb28e1daa","Type":"ContainerStarted","Data":"b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70"}
Jul 30 10:38:36.241921 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:36.241862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c" event={"ID":"e21580a0-c075-41b3-bc9a-cd8fb28e1daa","Type":"ContainerStarted","Data":"fad5df150218f9fdc159d062c5a507340920310a957b38d663bf9a146d6688f6"}
Jul 30 10:38:36.256956 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:36.256900    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2" podStartSLOduration=2.256880967 podStartE2EDuration="2.256880967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:38:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:38:36.25403316 +0000 UTC m=+2934.598096616" watchObservedRunningTime="2026-07-30 10:38:36.256880967 +0000 UTC m=+2934.600944424"
Jul 30 10:38:37.248557 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:37.248516    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:41.248291 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:41.248259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:38:41.266131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:41.266077    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c" podStartSLOduration=7.266060257 podStartE2EDuration="7.266060257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:38:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:38:36.267382799 +0000 UTC m=+2934.611446258" watchObservedRunningTime="2026-07-30 10:38:41.266060257 +0000 UTC m=+2939.610123712"
Jul 30 10:38:48.259250 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:48.259217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:38:48.259667 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:48.259454    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:38:57.933580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:57.933541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:58.291625 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:58.291536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:38:58.600977 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:38:58.600933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:00.120848 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:00.120793    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:01.129961 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:01.129929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:01.192615 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:01.192586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:02.207487 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.207452    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"]
Jul 30 10:39:02.210627 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.210603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.212780 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.212756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-bdf164-serving-cert\""
Jul 30 10:39:02.227970 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.227948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"]
Jul 30 10:39:02.242552 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.242521    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:02.306174 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.306135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a66887-0b60-44fc-9e83-74679accddd5-maas-api-tls\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.306350 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.306181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a66887-0b60-44fc-9e83-74679accddd5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.306350 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.306247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt8gh\" (UniqueName: \"kubernetes.io/projected/64a66887-0b60-44fc-9e83-74679accddd5-kube-api-access-pt8gh\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.347746 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.347709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:02.407645 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.407612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a66887-0b60-44fc-9e83-74679accddd5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.407645 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.407652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt8gh\" (UniqueName: \"kubernetes.io/projected/64a66887-0b60-44fc-9e83-74679accddd5-kube-api-access-pt8gh\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.407901 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.407731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a66887-0b60-44fc-9e83-74679accddd5-maas-api-tls\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.408391 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.408363    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a66887-0b60-44fc-9e83-74679accddd5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.410136 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.410118    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a66887-0b60-44fc-9e83-74679accddd5-maas-api-tls\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.424151 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.424124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt8gh\" (UniqueName: \"kubernetes.io/projected/64a66887-0b60-44fc-9e83-74679accddd5-kube-api-access-pt8gh\") pod \"maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.522471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.522390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:02.679189 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.679156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"]
Jul 30 10:39:02.681072 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:39:02.681031    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a66887_0b60_44fc_9e83_74679accddd5.slice/crio-a57bc61e4ab87874e8b222b1c6e1611f5417bc86c58e5cd0f83b4255f5a4044c WatchSource:0}: Error finding container a57bc61e4ab87874e8b222b1c6e1611f5417bc86c58e5cd0f83b4255f5a4044c: Status 404 returned error can't find the container with id a57bc61e4ab87874e8b222b1c6e1611f5417bc86c58e5cd0f83b4255f5a4044c
Jul 30 10:39:02.797891 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.797794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:02.901016 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.900977    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"]
Jul 30 10:39:02.903060 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.903029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:02.905994 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.905977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:02.907801 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.907785    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-bdf164\""
Jul 30 10:39:02.912595 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.912569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k\" (UID: \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:02.912864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.912749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s2tq\" (UniqueName: \"kubernetes.io/projected/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-kube-api-access-9s2tq\") pod \"payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k\" (UID: \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:02.917352 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.917330    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"]
Jul 30 10:39:02.945728 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.945697    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"]
Jul 30 10:39:02.949314 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.949288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:02.951391 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.951370    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-bdf164-dockercfg-knvhs\""
Jul 30 10:39:02.962188 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:02.962166    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"]
Jul 30 10:39:03.013981 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.013951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b\" (UID: \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:03.014180 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.014006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk54z\" (UniqueName: \"kubernetes.io/projected/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-kube-api-access-bk54z\") pod \"payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b\" (UID: \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:03.014180 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.014030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2tq\" (UniqueName: \"kubernetes.io/projected/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-kube-api-access-9s2tq\") pod \"payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k\" (UID: \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:03.014180 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.014119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k\" (UID: \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:03.014726 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.014708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k\" (UID: \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:03.024958 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.024931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s2tq\" (UniqueName: \"kubernetes.io/projected/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-kube-api-access-9s2tq\") pod \"payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k\" (UID: \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:03.115135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.115101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk54z\" (UniqueName: \"kubernetes.io/projected/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-kube-api-access-bk54z\") pod \"payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b\" (UID: \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:03.115285 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.115232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b\" (UID: \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:03.115895 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.115876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b\" (UID: \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:03.123210 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.123185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk54z\" (UniqueName: \"kubernetes.io/projected/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-kube-api-access-bk54z\") pod \"payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b\" (UID: \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:03.216748 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.216710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:03.261949 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.261914    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:03.368981 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:39:03.368395    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0ff321_8a29_410f_b0f9_86737fcd1e3d.slice/crio-c8c718196ae2219ad99fd57be0c84b176b919d0abb2f107c4ff9024d15d99c3a WatchSource:0}: Error finding container c8c718196ae2219ad99fd57be0c84b176b919d0abb2f107c4ff9024d15d99c3a: Status 404 returned error can't find the container with id c8c718196ae2219ad99fd57be0c84b176b919d0abb2f107c4ff9024d15d99c3a
Jul 30 10:39:03.368981 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.368689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"]
Jul 30 10:39:03.379927 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.379852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k" event={"ID":"6e0ff321-8a29-410f-b0f9-86737fcd1e3d","Type":"ContainerStarted","Data":"c8c718196ae2219ad99fd57be0c84b176b919d0abb2f107c4ff9024d15d99c3a"}
Jul 30 10:39:03.382101 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.382055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n" event={"ID":"64a66887-0b60-44fc-9e83-74679accddd5","Type":"ContainerStarted","Data":"53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555"}
Jul 30 10:39:03.382225 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.382116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n" event={"ID":"64a66887-0b60-44fc-9e83-74679accddd5","Type":"ContainerStarted","Data":"a57bc61e4ab87874e8b222b1c6e1611f5417bc86c58e5cd0f83b4255f5a4044c"}
Jul 30 10:39:03.382225 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.382215    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:03.401243 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.401196    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n" podStartSLOduration=0.996268425 podStartE2EDuration="1.401175301s" totalImagesPullingTime="404.906876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:39:03.398551133 +0000 UTC m=+2961.742614581" watchObservedRunningTime="2026-07-30 10:39:03.401175301 +0000 UTC m=+2961.745238759"
Jul 30 10:39:03.435978 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:03.435952    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"]
Jul 30 10:39:03.439982 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:39:03.439955    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93cf2f3_6b98_4b7e_9be9_e7f020e8cfad.slice/crio-70bc6cf9b7dfcb764c38727ab8bbadd657a073444b168ad2061d81cccd7e7a7a WatchSource:0}: Error finding container 70bc6cf9b7dfcb764c38727ab8bbadd657a073444b168ad2061d81cccd7e7a7a: Status 404 returned error can't find the container with id 70bc6cf9b7dfcb764c38727ab8bbadd657a073444b168ad2061d81cccd7e7a7a
Jul 30 10:39:04.390364 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:04.390330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b" event={"ID":"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad","Type":"ContainerStarted","Data":"80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6"}
Jul 30 10:39:04.390917 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:04.390387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b" event={"ID":"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad","Type":"ContainerStarted","Data":"70bc6cf9b7dfcb764c38727ab8bbadd657a073444b168ad2061d81cccd7e7a7a"}
Jul 30 10:39:04.390917 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:04.390429    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:04.392077 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:04.392046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k" event={"ID":"6e0ff321-8a29-410f-b0f9-86737fcd1e3d","Type":"ContainerStarted","Data":"b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb"}
Jul 30 10:39:04.392187 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:04.392123    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:04.408220 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:04.408158    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b" podStartSLOduration=2.4081380279999998 podStartE2EDuration="2.408138028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:39:04.407179848 +0000 UTC m=+2962.751243301" watchObservedRunningTime="2026-07-30 10:39:04.408138028 +0000 UTC m=+2962.752201485"
Jul 30 10:39:04.421902 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:04.421857    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k" podStartSLOduration=2.421841481 podStartE2EDuration="2.421841481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:39:04.420935912 +0000 UTC m=+2962.764999367" watchObservedRunningTime="2026-07-30 10:39:04.421841481 +0000 UTC m=+2962.765904937"
Jul 30 10:39:09.397458 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:09.397430    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:39:15.399742 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:15.399714    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:39:15.400247 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:15.399949    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:39:26.175982 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:26.175945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:37.641580 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:37.641547    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:39:42.378935 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:42.378904    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:39:42.388190 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:42.388156    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:39:59.537221 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:39:59.537186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:41:09.965307 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:41:09.965260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:41:34.570664 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:41:34.570626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:41:34.673733 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:41:34.673692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:41:38.834948 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:41:38.834912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:42:42.719910 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:42:42.719875    2581 scope.go:117] "RemoveContainer" containerID="405fca683a975e2cef63dbe2964526dbaa086b1b4099fc4707315b4e009baa78"
Jul 30 10:42:42.728225 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:42:42.728205    2581 scope.go:117] "RemoveContainer" containerID="b411c1d1543a875159e0c76b78945f527946e4d79f1f5d0b38176bdb303f00fa"
Jul 30 10:43:44.349850 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:43:44.349764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:43:51.498300 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:43:51.498261    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:43:53.967916 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:43:53.967883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:44:08.227043 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:44:08.227009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:44:42.409616 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:44:42.409589    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:44:42.418742 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:44:42.418721    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:45:00.143649 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:00.143610    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"]
Jul 30 10:45:00.147190 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:00.147170    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"
Jul 30 10:45:00.149119 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:00.149097    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:45:00.157210 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:00.157175    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"
Jul 30 10:45:00.159697 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:00.159667    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"]
Jul 30 10:45:00.296629 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:00.296598    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"]
Jul 30 10:45:00.299175 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:45:00.299141    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a22757a_e376_4e92_8fcc_0dbba0d93a83.slice/crio-e82744d9311a19d809655cd678a54b0e7c5e58f97a8146905be74580c997d526 WatchSource:0}: Error finding container e82744d9311a19d809655cd678a54b0e7c5e58f97a8146905be74580c997d526: Status 404 returned error can't find the container with id e82744d9311a19d809655cd678a54b0e7c5e58f97a8146905be74580c997d526
Jul 30 10:45:01.171727 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:01.171681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj" event={"ID":"7a22757a-e376-4e92-8fcc-0dbba0d93a83","Type":"ContainerStarted","Data":"d6cfdf17f413baab8af759ff401050a5b5d11f807a459629d19104371e23ff64"}
Jul 30 10:45:01.172221 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:01.171781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj" event={"ID":"7a22757a-e376-4e92-8fcc-0dbba0d93a83","Type":"ContainerStarted","Data":"e82744d9311a19d809655cd678a54b0e7c5e58f97a8146905be74580c997d526"}
Jul 30 10:45:01.188792 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:01.188740    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj" podStartSLOduration=1.188725032 podStartE2EDuration="1.188725032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:45:01.186902984 +0000 UTC m=+3319.530966441" watchObservedRunningTime="2026-07-30 10:45:01.188725032 +0000 UTC m=+3319.532788485"
Jul 30 10:45:02.178204 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:02.178168    2581 generic.go:356] "Generic (PLEG): container finished" podID="7a22757a-e376-4e92-8fcc-0dbba0d93a83" containerID="d6cfdf17f413baab8af759ff401050a5b5d11f807a459629d19104371e23ff64" exitCode=0
Jul 30 10:45:02.178603 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:02.178213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj" event={"ID":"7a22757a-e376-4e92-8fcc-0dbba0d93a83","Type":"ContainerDied","Data":"d6cfdf17f413baab8af759ff401050a5b5d11f807a459629d19104371e23ff64"}
Jul 30 10:45:03.319273 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:03.319246    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"
Jul 30 10:45:04.189927 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:04.189848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj" event={"ID":"7a22757a-e376-4e92-8fcc-0dbba0d93a83","Type":"ContainerDied","Data":"e82744d9311a19d809655cd678a54b0e7c5e58f97a8146905be74580c997d526"}
Jul 30 10:45:04.189927 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:04.189906    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e82744d9311a19d809655cd678a54b0e7c5e58f97a8146905be74580c997d526"
Jul 30 10:45:04.189927 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:04.189863    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"
Jul 30 10:45:05.403009 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:05.402970    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:45:19.362551 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:19.362518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:45:20.235903 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:20.235869    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:45:50.438409 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:45:50.438364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:46:19.415432 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.415401    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"]
Jul 30 10:46:19.415803 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.415781    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a22757a-e376-4e92-8fcc-0dbba0d93a83" containerName="cleanup"
Jul 30 10:46:19.415803 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.415791    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a22757a-e376-4e92-8fcc-0dbba0d93a83" containerName="cleanup"
Jul 30 10:46:19.415937 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.415901    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a22757a-e376-4e92-8fcc-0dbba0d93a83" containerName="cleanup"
Jul 30 10:46:19.419097 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.419070    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.421533 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.421507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bdf164\"/\"kube-root-ca.crt\""
Jul 30 10:46:19.421533 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.421529    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bdf164\"/\"openshift-service-ca.crt\""
Jul 30 10:46:19.421720 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.421508    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bdf164\"/\"sub-test-model-bdf164-kserve-self-signed-certs\""
Jul 30 10:46:19.421720 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.421508    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bdf164\"/\"default-dockercfg-24rlr\""
Jul 30 10:46:19.428362 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.428341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"]
Jul 30 10:46:19.505958 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.505929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:46:19.552776 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.552745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-home\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.552964 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.552844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-dshm\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.552964 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.552879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tmp-dir\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.552964 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.552895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tls-certs\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.552964 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.552911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-model-cache\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.553165 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.553144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hvd9\" (UniqueName: \"kubernetes.io/projected/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-kube-api-access-5hvd9\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-dshm\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tmp-dir\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654576 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tls-certs\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654576 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-model-cache\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654576 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hvd9\" (UniqueName: \"kubernetes.io/projected/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-kube-api-access-5hvd9\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654576 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-home\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654804 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654782    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tmp-dir\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654910 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-home\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.654910 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.654873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-model-cache\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.656702 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.656679    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-dshm\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.656866 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.656848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tls-certs\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.661571 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.661553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hvd9\" (UniqueName: \"kubernetes.io/projected/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-kube-api-access-5hvd9\") pod \"sub-test-model-bdf164-kserve-78cd576697-vps4t\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") " pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.728807 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.728708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:19.861176 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:19.861151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"]
Jul 30 10:46:19.863054 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:46:19.863027    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36a7cb60_9e8d_4b66_bc3f_c478bddeb896.slice/crio-fc04ae7b2f04675ccafac2c368f865a471e3817d4d940cac9020d5a11982b7f5 WatchSource:0}: Error finding container fc04ae7b2f04675ccafac2c368f865a471e3817d4d940cac9020d5a11982b7f5: Status 404 returned error can't find the container with id fc04ae7b2f04675ccafac2c368f865a471e3817d4d940cac9020d5a11982b7f5
Jul 30 10:46:20.563247 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:20.563209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t" event={"ID":"36a7cb60-9e8d-4b66-bc3f-c478bddeb896","Type":"ContainerStarted","Data":"86fde8b10b5e1a92225f4ae535388804ffdd35f7ce230bdae5701f1b1bd281fb"}
Jul 30 10:46:20.563663 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:20.563259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t" event={"ID":"36a7cb60-9e8d-4b66-bc3f-c478bddeb896","Type":"ContainerStarted","Data":"fc04ae7b2f04675ccafac2c368f865a471e3817d4d940cac9020d5a11982b7f5"}
Jul 30 10:46:20.579648 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:20.579595    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t" podStartSLOduration=1.579579015 podStartE2EDuration="1.579579015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:46:20.577869415 +0000 UTC m=+3398.921932862" watchObservedRunningTime="2026-07-30 10:46:20.579579015 +0000 UTC m=+3398.923642471"
Jul 30 10:46:29.729645 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:29.729602    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:29.729645 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:29.729650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:29.742358 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:29.742330    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:46:30.632262 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:46:30.632233    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:48:12.182209 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:12.182129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:48:13.004909 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:13.004873    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"]
Jul 30 10:48:13.026394 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:13.026365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:48:20.699691 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:20.699660    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:48:28.024108 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.024054    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t" podUID="36a7cb60-9e8d-4b66-bc3f-c478bddeb896" containerName="main" containerID="cri-o://86fde8b10b5e1a92225f4ae535388804ffdd35f7ce230bdae5701f1b1bd281fb" gracePeriod=45
Jul 30 10:48:28.205720 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.205687    2581 generic.go:356] "Generic (PLEG): container finished" podID="36a7cb60-9e8d-4b66-bc3f-c478bddeb896" containerID="86fde8b10b5e1a92225f4ae535388804ffdd35f7ce230bdae5701f1b1bd281fb" exitCode=0
Jul 30 10:48:28.205901 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.205761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t" event={"ID":"36a7cb60-9e8d-4b66-bc3f-c478bddeb896","Type":"ContainerDied","Data":"86fde8b10b5e1a92225f4ae535388804ffdd35f7ce230bdae5701f1b1bd281fb"}
Jul 30 10:48:28.279372 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.279302    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:48:28.345909 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.345873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tmp-dir\") pod \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") "
Jul 30 10:48:28.345909 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.345911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tls-certs\") pod \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") "
Jul 30 10:48:28.346168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.345942    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-dshm\") pod \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") "
Jul 30 10:48:28.346168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.345979    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-model-cache\") pod \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") "
Jul 30 10:48:28.346168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.346006    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hvd9\" (UniqueName: \"kubernetes.io/projected/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-kube-api-access-5hvd9\") pod \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") "
Jul 30 10:48:28.346168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.346033    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-home\") pod \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\" (UID: \"36a7cb60-9e8d-4b66-bc3f-c478bddeb896\") "
Jul 30 10:48:28.346375 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.346173    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36a7cb60-9e8d-4b66-bc3f-c478bddeb896" (UID: "36a7cb60-9e8d-4b66-bc3f-c478bddeb896"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:48:28.346375 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.346250    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-model-cache" (OuterVolumeSpecName: "model-cache") pod "36a7cb60-9e8d-4b66-bc3f-c478bddeb896" (UID: "36a7cb60-9e8d-4b66-bc3f-c478bddeb896"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:48:28.346375 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.346341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-home" (OuterVolumeSpecName: "home") pod "36a7cb60-9e8d-4b66-bc3f-c478bddeb896" (UID: "36a7cb60-9e8d-4b66-bc3f-c478bddeb896"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:48:28.346489 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.346427    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-model-cache\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:48:28.346489 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.346440    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-home\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:48:28.346489 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.346449    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tmp-dir\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:48:28.348127 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.348107    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36a7cb60-9e8d-4b66-bc3f-c478bddeb896" (UID: "36a7cb60-9e8d-4b66-bc3f-c478bddeb896"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:48:28.348500 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.348477    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-dshm" (OuterVolumeSpecName: "dshm") pod "36a7cb60-9e8d-4b66-bc3f-c478bddeb896" (UID: "36a7cb60-9e8d-4b66-bc3f-c478bddeb896"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:48:28.348594 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.348502    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-kube-api-access-5hvd9" (OuterVolumeSpecName: "kube-api-access-5hvd9") pod "36a7cb60-9e8d-4b66-bc3f-c478bddeb896" (UID: "36a7cb60-9e8d-4b66-bc3f-c478bddeb896"). InnerVolumeSpecName "kube-api-access-5hvd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:48:28.447217 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.447164    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-tls-certs\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:48:28.447217 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.447209    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-dshm\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:48:28.447217 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:28.447220    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hvd9\" (UniqueName: \"kubernetes.io/projected/36a7cb60-9e8d-4b66-bc3f-c478bddeb896-kube-api-access-5hvd9\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:48:29.211959 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:29.211925    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t" event={"ID":"36a7cb60-9e8d-4b66-bc3f-c478bddeb896","Type":"ContainerDied","Data":"fc04ae7b2f04675ccafac2c368f865a471e3817d4d940cac9020d5a11982b7f5"}
Jul 30 10:48:29.211959 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:29.211958    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"
Jul 30 10:48:29.212482 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:29.211983    2581 scope.go:117] "RemoveContainer" containerID="86fde8b10b5e1a92225f4ae535388804ffdd35f7ce230bdae5701f1b1bd281fb"
Jul 30 10:48:29.234486 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:29.234455    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"]
Jul 30 10:48:29.238736 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:29.238706    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bdf164/sub-test-model-bdf164-kserve-78cd576697-vps4t"]
Jul 30 10:48:30.229170 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:30.229126    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36a7cb60-9e8d-4b66-bc3f-c478bddeb896" path="/var/lib/kubelet/pods/36a7cb60-9e8d-4b66-bc3f-c478bddeb896/volumes"
Jul 30 10:48:46.448362 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:48:46.448315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:49:42.440218 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:49:42.440190    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:49:42.451308 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:49:42.451283    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:50:25.472062 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:25.472032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:27.216081 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.216039    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7468-140667246005168"]
Jul 30 10:50:27.216473 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.216454    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a7cb60-9e8d-4b66-bc3f-c478bddeb896" containerName="main"
Jul 30 10:50:27.216473 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.216466    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a7cb60-9e8d-4b66-bc3f-c478bddeb896" containerName="main"
Jul 30 10:50:27.216552 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.216537    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="36a7cb60-9e8d-4b66-bc3f-c478bddeb896" containerName="main"
Jul 30 10:50:27.219503 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.219487    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667246005168"
Jul 30 10:50:27.221681 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.221655    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-v2xsn\""
Jul 30 10:50:27.225385 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.225364    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667246005168"]
Jul 30 10:50:27.263523 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.263481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dwg5\" (UniqueName: \"kubernetes.io/projected/a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50-kube-api-access-5dwg5\") pod \"test-curl-7468-140667246005168\" (UID: \"a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50\") " pod="opendatahub/test-curl-7468-140667246005168"
Jul 30 10:50:27.364998 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.364955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dwg5\" (UniqueName: \"kubernetes.io/projected/a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50-kube-api-access-5dwg5\") pod \"test-curl-7468-140667246005168\" (UID: \"a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50\") " pod="opendatahub/test-curl-7468-140667246005168"
Jul 30 10:50:27.373012 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.372985    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dwg5\" (UniqueName: \"kubernetes.io/projected/a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50-kube-api-access-5dwg5\") pod \"test-curl-7468-140667246005168\" (UID: \"a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50\") " pod="opendatahub/test-curl-7468-140667246005168"
Jul 30 10:50:27.530150 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.530067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667246005168"
Jul 30 10:50:27.667232 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.667204    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667246005168"]
Jul 30 10:50:27.669390 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:50:27.669362    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda55f77b4_8c7a_4790_bd7c_6c6f38dd4a50.slice/crio-93c7fe35ac9605aae356398fbc6c10b017ec666b59858344b7fe49c9567f52f7 WatchSource:0}: Error finding container 93c7fe35ac9605aae356398fbc6c10b017ec666b59858344b7fe49c9567f52f7: Status 404 returned error can't find the container with id 93c7fe35ac9605aae356398fbc6c10b017ec666b59858344b7fe49c9567f52f7
Jul 30 10:50:27.671008 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.670990    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:50:27.684086 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.684060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:27.786389 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.786309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:27.806648 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:27.806616    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667246005168" event={"ID":"a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50","Type":"ContainerStarted","Data":"93c7fe35ac9605aae356398fbc6c10b017ec666b59858344b7fe49c9567f52f7"}
Jul 30 10:50:28.813265 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:28.813233    2581 generic.go:356] "Generic (PLEG): container finished" podID="a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50" containerID="f270006a2aa576b5f4b5bcab7f0bf696366d13dfa8854187b356161f506cf124" exitCode=0
Jul 30 10:50:28.813669 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:28.813319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667246005168" event={"ID":"a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50","Type":"ContainerDied","Data":"f270006a2aa576b5f4b5bcab7f0bf696366d13dfa8854187b356161f506cf124"}
Jul 30 10:50:29.950507 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:29.950480    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667246005168"
Jul 30 10:50:29.970867 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:29.970836    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7468-140667246005168_a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50/test-curl-7468-140667246005168/0.log"
Jul 30 10:50:29.990408 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:29.990375    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dwg5\" (UniqueName: \"kubernetes.io/projected/a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50-kube-api-access-5dwg5\") pod \"a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50\" (UID: \"a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50\") "
Jul 30 10:50:29.993002 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:29.992961    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50-kube-api-access-5dwg5" (OuterVolumeSpecName: "kube-api-access-5dwg5") pod "a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50" (UID: "a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50"). InnerVolumeSpecName "kube-api-access-5dwg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:50:29.994885 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:29.994858    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7468-140667246005168"]
Jul 30 10:50:29.998909 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:29.998888    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7468-140667246005168"]
Jul 30 10:50:30.091741 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.091653    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dwg5\" (UniqueName: \"kubernetes.io/projected/a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50-kube-api-access-5dwg5\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:50:30.129156 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.129119    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7468-140667246081200"]
Jul 30 10:50:30.129560 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.129546    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50" containerName="test-curl-7468-140667246005168"
Jul 30 10:50:30.129604 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.129562    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50" containerName="test-curl-7468-140667246005168"
Jul 30 10:50:30.129644 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.129637    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50" containerName="test-curl-7468-140667246005168"
Jul 30 10:50:30.132786 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.132769    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667246081200"
Jul 30 10:50:30.137935 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.137906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667246081200"]
Jul 30 10:50:30.192878 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.192807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km6qr\" (UniqueName: \"kubernetes.io/projected/3077703b-723b-44f1-a5c3-cdcd3abfde79-kube-api-access-km6qr\") pod \"test-curl-7468-140667246081200\" (UID: \"3077703b-723b-44f1-a5c3-cdcd3abfde79\") " pod="opendatahub/test-curl-7468-140667246081200"
Jul 30 10:50:30.228215 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.228173    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50" path="/var/lib/kubelet/pods/a55f77b4-8c7a-4790-bd7c-6c6f38dd4a50/volumes"
Jul 30 10:50:30.293635 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.293594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km6qr\" (UniqueName: \"kubernetes.io/projected/3077703b-723b-44f1-a5c3-cdcd3abfde79-kube-api-access-km6qr\") pod \"test-curl-7468-140667246081200\" (UID: \"3077703b-723b-44f1-a5c3-cdcd3abfde79\") " pod="opendatahub/test-curl-7468-140667246081200"
Jul 30 10:50:30.302038 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.302003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km6qr\" (UniqueName: \"kubernetes.io/projected/3077703b-723b-44f1-a5c3-cdcd3abfde79-kube-api-access-km6qr\") pod \"test-curl-7468-140667246081200\" (UID: \"3077703b-723b-44f1-a5c3-cdcd3abfde79\") " pod="opendatahub/test-curl-7468-140667246081200"
Jul 30 10:50:30.443306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.443213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667246081200"
Jul 30 10:50:30.576881 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.576724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667246081200"]
Jul 30 10:50:30.579433 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:50:30.579406    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3077703b_723b_44f1_a5c3_cdcd3abfde79.slice/crio-f4d866d42c47a12c411d96e2d4c66b5c27014379cbde62654b09eec2d4822fa8 WatchSource:0}: Error finding container f4d866d42c47a12c411d96e2d4c66b5c27014379cbde62654b09eec2d4822fa8: Status 404 returned error can't find the container with id f4d866d42c47a12c411d96e2d4c66b5c27014379cbde62654b09eec2d4822fa8
Jul 30 10:50:30.823786 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.823747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667246081200" event={"ID":"3077703b-723b-44f1-a5c3-cdcd3abfde79","Type":"ContainerStarted","Data":"f4d866d42c47a12c411d96e2d4c66b5c27014379cbde62654b09eec2d4822fa8"}
Jul 30 10:50:30.824904 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.824883    2581 scope.go:117] "RemoveContainer" containerID="f270006a2aa576b5f4b5bcab7f0bf696366d13dfa8854187b356161f506cf124"
Jul 30 10:50:30.825012 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:30.824904    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667246005168"
Jul 30 10:50:31.832211 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:31.832172    2581 generic.go:356] "Generic (PLEG): container finished" podID="3077703b-723b-44f1-a5c3-cdcd3abfde79" containerID="e594044ce6ac4c0d22f1a6f99fbf89773665430b3a7f1c4406fdb1f7c7d7a35a" exitCode=0
Jul 30 10:50:31.832646 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:31.832256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667246081200" event={"ID":"3077703b-723b-44f1-a5c3-cdcd3abfde79","Type":"ContainerDied","Data":"e594044ce6ac4c0d22f1a6f99fbf89773665430b3a7f1c4406fdb1f7c7d7a35a"}
Jul 30 10:50:32.971531 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:32.971503    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667246081200"
Jul 30 10:50:32.991202 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:32.991166    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7468-140667246081200_3077703b-723b-44f1-a5c3-cdcd3abfde79/test-curl-7468-140667246081200/0.log"
Jul 30 10:50:33.016478 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.016446    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7468-140667246081200"]
Jul 30 10:50:33.019112 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.019088    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7468-140667246081200"]
Jul 30 10:50:33.022319 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.022295    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km6qr\" (UniqueName: \"kubernetes.io/projected/3077703b-723b-44f1-a5c3-cdcd3abfde79-kube-api-access-km6qr\") pod \"3077703b-723b-44f1-a5c3-cdcd3abfde79\" (UID: \"3077703b-723b-44f1-a5c3-cdcd3abfde79\") "
Jul 30 10:50:33.024369 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.024348    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3077703b-723b-44f1-a5c3-cdcd3abfde79-kube-api-access-km6qr" (OuterVolumeSpecName: "kube-api-access-km6qr") pod "3077703b-723b-44f1-a5c3-cdcd3abfde79" (UID: "3077703b-723b-44f1-a5c3-cdcd3abfde79"). InnerVolumeSpecName "kube-api-access-km6qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:50:33.123172 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.123076    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km6qr\" (UniqueName: \"kubernetes.io/projected/3077703b-723b-44f1-a5c3-cdcd3abfde79-kube-api-access-km6qr\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:50:33.188668 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.188634    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:33.189087 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.189073    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3077703b-723b-44f1-a5c3-cdcd3abfde79" containerName="test-curl-7468-140667246081200"
Jul 30 10:50:33.189150 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.189089    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3077703b-723b-44f1-a5c3-cdcd3abfde79" containerName="test-curl-7468-140667246081200"
Jul 30 10:50:33.189190 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.189167    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3077703b-723b-44f1-a5c3-cdcd3abfde79" containerName="test-curl-7468-140667246081200"
Jul 30 10:50:33.192022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.192006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:33.196659 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.196637    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:33.224029 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.223998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhmn4\" (UniqueName: \"kubernetes.io/projected/ef9779b1-d0c2-4047-9b59-003c1297f3ef-kube-api-access-dhmn4\") pod \"test-curl-7468-140667247359008\" (UID: \"ef9779b1-d0c2-4047-9b59-003c1297f3ef\") " pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:33.325459 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.325416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhmn4\" (UniqueName: \"kubernetes.io/projected/ef9779b1-d0c2-4047-9b59-003c1297f3ef-kube-api-access-dhmn4\") pod \"test-curl-7468-140667247359008\" (UID: \"ef9779b1-d0c2-4047-9b59-003c1297f3ef\") " pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:33.333634 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.333604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhmn4\" (UniqueName: \"kubernetes.io/projected/ef9779b1-d0c2-4047-9b59-003c1297f3ef-kube-api-access-dhmn4\") pod \"test-curl-7468-140667247359008\" (UID: \"ef9779b1-d0c2-4047-9b59-003c1297f3ef\") " pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:33.502985 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.502896    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:33.635072 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.635036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:33.637051 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:50:33.637025    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef9779b1_d0c2_4047_9b59_003c1297f3ef.slice/crio-746533df5ca28d38ebeb3828759f2b05b51a81f4603faeca87be4057c0179877 WatchSource:0}: Error finding container 746533df5ca28d38ebeb3828759f2b05b51a81f4603faeca87be4057c0179877: Status 404 returned error can't find the container with id 746533df5ca28d38ebeb3828759f2b05b51a81f4603faeca87be4057c0179877
Jul 30 10:50:33.850483 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.850454    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4d866d42c47a12c411d96e2d4c66b5c27014379cbde62654b09eec2d4822fa8"
Jul 30 10:50:33.850483 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.850470    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667246081200"
Jul 30 10:50:33.851648 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:33.851609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667247359008" event={"ID":"ef9779b1-d0c2-4047-9b59-003c1297f3ef","Type":"ContainerStarted","Data":"746533df5ca28d38ebeb3828759f2b05b51a81f4603faeca87be4057c0179877"}
Jul 30 10:50:33.864429 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:50:33.864394    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7468-140667246081200\" is forbidden: User \"system:node:ip-10-0-131-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-179.ec2.internal' and this object" podUID="3077703b-723b-44f1-a5c3-cdcd3abfde79" pod="opendatahub/test-curl-7468-140667246081200"
Jul 30 10:50:34.228740 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:34.228663    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3077703b-723b-44f1-a5c3-cdcd3abfde79" path="/var/lib/kubelet/pods/3077703b-723b-44f1-a5c3-cdcd3abfde79/volumes"
Jul 30 10:50:34.857644 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:34.857610    2581 generic.go:356] "Generic (PLEG): container finished" podID="ef9779b1-d0c2-4047-9b59-003c1297f3ef" containerID="51944209e9050cc96b766a57fe9c7070366015bac0c7887a53c689b920e767a3" exitCode=0
Jul 30 10:50:34.857798 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:34.857663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667247359008" event={"ID":"ef9779b1-d0c2-4047-9b59-003c1297f3ef","Type":"ContainerDied","Data":"51944209e9050cc96b766a57fe9c7070366015bac0c7887a53c689b920e767a3"}
Jul 30 10:50:35.993649 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:35.993624    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:36.014555 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.014512    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7468-140667247359008_ef9779b1-d0c2-4047-9b59-003c1297f3ef/test-curl-7468-140667247359008/0.log"
Jul 30 10:50:36.040535 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.040498    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:36.044556 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.044527    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:36.049703 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.049670    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhmn4\" (UniqueName: \"kubernetes.io/projected/ef9779b1-d0c2-4047-9b59-003c1297f3ef-kube-api-access-dhmn4\") pod \"ef9779b1-d0c2-4047-9b59-003c1297f3ef\" (UID: \"ef9779b1-d0c2-4047-9b59-003c1297f3ef\") "
Jul 30 10:50:36.051727 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.051703    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef9779b1-d0c2-4047-9b59-003c1297f3ef-kube-api-access-dhmn4" (OuterVolumeSpecName: "kube-api-access-dhmn4") pod "ef9779b1-d0c2-4047-9b59-003c1297f3ef" (UID: "ef9779b1-d0c2-4047-9b59-003c1297f3ef"). InnerVolumeSpecName "kube-api-access-dhmn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:50:36.150763 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.150674    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhmn4\" (UniqueName: \"kubernetes.io/projected/ef9779b1-d0c2-4047-9b59-003c1297f3ef-kube-api-access-dhmn4\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:50:36.166851 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.166798    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:36.167300 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.167281    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef9779b1-d0c2-4047-9b59-003c1297f3ef" containerName="test-curl-7468-140667247359008"
Jul 30 10:50:36.167396 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.167302    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef9779b1-d0c2-4047-9b59-003c1297f3ef" containerName="test-curl-7468-140667247359008"
Jul 30 10:50:36.167454 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.167433    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef9779b1-d0c2-4047-9b59-003c1297f3ef" containerName="test-curl-7468-140667247359008"
Jul 30 10:50:36.170555 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.170533    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:36.176538 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.176511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:36.228355 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.228322    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef9779b1-d0c2-4047-9b59-003c1297f3ef" path="/var/lib/kubelet/pods/ef9779b1-d0c2-4047-9b59-003c1297f3ef/volumes"
Jul 30 10:50:36.251787 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.251757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m75r9\" (UniqueName: \"kubernetes.io/projected/b760f19d-092a-4c92-ac9e-4a2a59d8e6c7-kube-api-access-m75r9\") pod \"test-curl-7468-140667247359008\" (UID: \"b760f19d-092a-4c92-ac9e-4a2a59d8e6c7\") " pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:36.353018 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.352984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m75r9\" (UniqueName: \"kubernetes.io/projected/b760f19d-092a-4c92-ac9e-4a2a59d8e6c7-kube-api-access-m75r9\") pod \"test-curl-7468-140667247359008\" (UID: \"b760f19d-092a-4c92-ac9e-4a2a59d8e6c7\") " pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:36.361309 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.361272    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m75r9\" (UniqueName: \"kubernetes.io/projected/b760f19d-092a-4c92-ac9e-4a2a59d8e6c7-kube-api-access-m75r9\") pod \"test-curl-7468-140667247359008\" (UID: \"b760f19d-092a-4c92-ac9e-4a2a59d8e6c7\") " pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:36.481796 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.481668    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:36.616766 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.616733    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:36.619102 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:50:36.619070    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb760f19d_092a_4c92_ac9e_4a2a59d8e6c7.slice/crio-a5ac7fb526c05eaeb2365b9820436fc9c7e5aee51cd493b8800745009c58aff1 WatchSource:0}: Error finding container a5ac7fb526c05eaeb2365b9820436fc9c7e5aee51cd493b8800745009c58aff1: Status 404 returned error can't find the container with id a5ac7fb526c05eaeb2365b9820436fc9c7e5aee51cd493b8800745009c58aff1
Jul 30 10:50:36.868895 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.868867    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:36.869086 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.868905    2581 scope.go:117] "RemoveContainer" containerID="51944209e9050cc96b766a57fe9c7070366015bac0c7887a53c689b920e767a3"
Jul 30 10:50:36.870153 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:36.870129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667247359008" event={"ID":"b760f19d-092a-4c92-ac9e-4a2a59d8e6c7","Type":"ContainerStarted","Data":"a5ac7fb526c05eaeb2365b9820436fc9c7e5aee51cd493b8800745009c58aff1"}
Jul 30 10:50:37.877517 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:37.877478    2581 generic.go:356] "Generic (PLEG): container finished" podID="b760f19d-092a-4c92-ac9e-4a2a59d8e6c7" containerID="6971036560d472106991c2f3bd0c8c7a492f7a9c61e79964e0b173190fbe027e" exitCode=0
Jul 30 10:50:37.877995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:37.877564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667247359008" event={"ID":"b760f19d-092a-4c92-ac9e-4a2a59d8e6c7","Type":"ContainerDied","Data":"6971036560d472106991c2f3bd0c8c7a492f7a9c61e79964e0b173190fbe027e"}
Jul 30 10:50:39.021712 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.021684    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:39.041836 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.041798    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7468-140667247359008_b760f19d-092a-4c92-ac9e-4a2a59d8e6c7/test-curl-7468-140667247359008/0.log"
Jul 30 10:50:39.067257 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.067219    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:39.069908 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.069878    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7468-140667247359008"]
Jul 30 10:50:39.078892 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.078863    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m75r9\" (UniqueName: \"kubernetes.io/projected/b760f19d-092a-4c92-ac9e-4a2a59d8e6c7-kube-api-access-m75r9\") pod \"b760f19d-092a-4c92-ac9e-4a2a59d8e6c7\" (UID: \"b760f19d-092a-4c92-ac9e-4a2a59d8e6c7\") "
Jul 30 10:50:39.080950 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.080925    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b760f19d-092a-4c92-ac9e-4a2a59d8e6c7-kube-api-access-m75r9" (OuterVolumeSpecName: "kube-api-access-m75r9") pod "b760f19d-092a-4c92-ac9e-4a2a59d8e6c7" (UID: "b760f19d-092a-4c92-ac9e-4a2a59d8e6c7"). InnerVolumeSpecName "kube-api-access-m75r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:50:39.180671 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.180572    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m75r9\" (UniqueName: \"kubernetes.io/projected/b760f19d-092a-4c92-ac9e-4a2a59d8e6c7-kube-api-access-m75r9\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:50:39.194621 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.194586    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7468-140667247360016"]
Jul 30 10:50:39.195019 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.195005    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b760f19d-092a-4c92-ac9e-4a2a59d8e6c7" containerName="test-curl-7468-140667247359008"
Jul 30 10:50:39.195073 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.195020    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b760f19d-092a-4c92-ac9e-4a2a59d8e6c7" containerName="test-curl-7468-140667247359008"
Jul 30 10:50:39.195114 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.195095    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b760f19d-092a-4c92-ac9e-4a2a59d8e6c7" containerName="test-curl-7468-140667247359008"
Jul 30 10:50:39.198221 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.198200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247360016"
Jul 30 10:50:39.204235 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.204196    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667247360016"]
Jul 30 10:50:39.281758 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.281644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c2tk\" (UniqueName: \"kubernetes.io/projected/2a6b28a6-9533-4867-823f-25454d91b59a-kube-api-access-4c2tk\") pod \"test-curl-7468-140667247360016\" (UID: \"2a6b28a6-9533-4867-823f-25454d91b59a\") " pod="opendatahub/test-curl-7468-140667247360016"
Jul 30 10:50:39.382941 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.382910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c2tk\" (UniqueName: \"kubernetes.io/projected/2a6b28a6-9533-4867-823f-25454d91b59a-kube-api-access-4c2tk\") pod \"test-curl-7468-140667247360016\" (UID: \"2a6b28a6-9533-4867-823f-25454d91b59a\") " pod="opendatahub/test-curl-7468-140667247360016"
Jul 30 10:50:39.391504 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.391469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c2tk\" (UniqueName: \"kubernetes.io/projected/2a6b28a6-9533-4867-823f-25454d91b59a-kube-api-access-4c2tk\") pod \"test-curl-7468-140667247360016\" (UID: \"2a6b28a6-9533-4867-823f-25454d91b59a\") " pod="opendatahub/test-curl-7468-140667247360016"
Jul 30 10:50:39.508439 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.508344    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247360016"
Jul 30 10:50:39.642771 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.642719    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7468-140667247360016"]
Jul 30 10:50:39.645499 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:50:39.645467    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a6b28a6_9533_4867_823f_25454d91b59a.slice/crio-143350a668233d846c97559ab2e0f72e8c932e126b0fa9a927f07838e34fc005 WatchSource:0}: Error finding container 143350a668233d846c97559ab2e0f72e8c932e126b0fa9a927f07838e34fc005: Status 404 returned error can't find the container with id 143350a668233d846c97559ab2e0f72e8c932e126b0fa9a927f07838e34fc005
Jul 30 10:50:39.888872 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.888836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667247360016" event={"ID":"2a6b28a6-9533-4867-823f-25454d91b59a","Type":"ContainerStarted","Data":"143350a668233d846c97559ab2e0f72e8c932e126b0fa9a927f07838e34fc005"}
Jul 30 10:50:39.890144 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.890120    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5ac7fb526c05eaeb2365b9820436fc9c7e5aee51cd493b8800745009c58aff1"
Jul 30 10:50:39.890276 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:39.890184    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:39.900969 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:50:39.900943    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7468-140667247359008\" is forbidden: User \"system:node:ip-10-0-131-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-179.ec2.internal' and this object" podUID="b760f19d-092a-4c92-ac9e-4a2a59d8e6c7" pod="opendatahub/test-curl-7468-140667247359008"
Jul 30 10:50:40.228523 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:40.228437    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b760f19d-092a-4c92-ac9e-4a2a59d8e6c7" path="/var/lib/kubelet/pods/b760f19d-092a-4c92-ac9e-4a2a59d8e6c7/volumes"
Jul 30 10:50:40.898907 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:40.898871    2581 generic.go:356] "Generic (PLEG): container finished" podID="2a6b28a6-9533-4867-823f-25454d91b59a" containerID="0c09270eeb24987c4272ebe780fe8c831d555b799b8328d21056f618f7216212" exitCode=0
Jul 30 10:50:40.899067 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:40.898956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7468-140667247360016" event={"ID":"2a6b28a6-9533-4867-823f-25454d91b59a","Type":"ContainerDied","Data":"0c09270eeb24987c4272ebe780fe8c831d555b799b8328d21056f618f7216212"}
Jul 30 10:50:42.062010 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.061978    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247360016"
Jul 30 10:50:42.082719 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.082686    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7468-140667247360016_2a6b28a6-9533-4867-823f-25454d91b59a/test-curl-7468-140667247360016/0.log"
Jul 30 10:50:42.107422 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.107390    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7468-140667247360016"]
Jul 30 10:50:42.113443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.113411    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7468-140667247360016"]
Jul 30 10:50:42.209551 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.209450    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c2tk\" (UniqueName: \"kubernetes.io/projected/2a6b28a6-9533-4867-823f-25454d91b59a-kube-api-access-4c2tk\") pod \"2a6b28a6-9533-4867-823f-25454d91b59a\" (UID: \"2a6b28a6-9533-4867-823f-25454d91b59a\") "
Jul 30 10:50:42.211619 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.211578    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a6b28a6-9533-4867-823f-25454d91b59a-kube-api-access-4c2tk" (OuterVolumeSpecName: "kube-api-access-4c2tk") pod "2a6b28a6-9533-4867-823f-25454d91b59a" (UID: "2a6b28a6-9533-4867-823f-25454d91b59a"). InnerVolumeSpecName "kube-api-access-4c2tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:50:42.228443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.228416    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a6b28a6-9533-4867-823f-25454d91b59a" path="/var/lib/kubelet/pods/2a6b28a6-9533-4867-823f-25454d91b59a/volumes"
Jul 30 10:50:42.310802 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.310769    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c2tk\" (UniqueName: \"kubernetes.io/projected/2a6b28a6-9533-4867-823f-25454d91b59a-kube-api-access-4c2tk\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:50:42.911464 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.911433    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7468-140667247360016"
Jul 30 10:50:42.911615 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:42.911493    2581 scope.go:117] "RemoveContainer" containerID="0c09270eeb24987c4272ebe780fe8c831d555b799b8328d21056f618f7216212"
Jul 30 10:50:45.259739 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:45.259707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:45.590269 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:45.590228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:46.344229 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:46.344198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:51.534481 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:51.534446    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:51.665494 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:51.665454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:52.621006 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.620965    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"]
Jul 30 10:50:52.621617 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.621600    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6b28a6-9533-4867-823f-25454d91b59a" containerName="test-curl-7468-140667247360016"
Jul 30 10:50:52.621672 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.621620    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6b28a6-9533-4867-823f-25454d91b59a" containerName="test-curl-7468-140667247360016"
Jul 30 10:50:52.621759 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.621747    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a6b28a6-9533-4867-823f-25454d91b59a" containerName="test-curl-7468-140667247360016"
Jul 30 10:50:52.626860 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.626811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.628784 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.628765    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-78eb1c-serving-cert\""
Jul 30 10:50:52.635042 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.634795    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"]
Jul 30 10:50:52.660049 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.660008    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:52.704038 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.703997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t967q\" (UniqueName: \"kubernetes.io/projected/78c43cd4-3709-4d96-bf10-05ad2898b0bf-kube-api-access-t967q\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.704189 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.704116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c43cd4-3709-4d96-bf10-05ad2898b0bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.704189 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.704139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c43cd4-3709-4d96-bf10-05ad2898b0bf-maas-api-tls\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.805493 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.805460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c43cd4-3709-4d96-bf10-05ad2898b0bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.805493 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.805494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c43cd4-3709-4d96-bf10-05ad2898b0bf-maas-api-tls\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.805705 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.805547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t967q\" (UniqueName: \"kubernetes.io/projected/78c43cd4-3709-4d96-bf10-05ad2898b0bf-kube-api-access-t967q\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.806264 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.806243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c43cd4-3709-4d96-bf10-05ad2898b0bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.807991 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.807970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c43cd4-3709-4d96-bf10-05ad2898b0bf-maas-api-tls\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.813064 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.813036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t967q\" (UniqueName: \"kubernetes.io/projected/78c43cd4-3709-4d96-bf10-05ad2898b0bf-kube-api-access-t967q\") pod \"maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:52.819035 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.819009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:52.939735 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:52.939646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:53.075220 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.075191    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"]
Jul 30 10:50:53.078014 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:50:53.077984    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c43cd4_3709_4d96_bf10_05ad2898b0bf.slice/crio-5e57b09626e5196f2ca3c4f2bd783c057bf2a71e0036ad085f400d15fb0cceae WatchSource:0}: Error finding container 5e57b09626e5196f2ca3c4f2bd783c057bf2a71e0036ad085f400d15fb0cceae: Status 404 returned error can't find the container with id 5e57b09626e5196f2ca3c4f2bd783c057bf2a71e0036ad085f400d15fb0cceae
Jul 30 10:50:53.257467 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.257389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:53.355742 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.355713    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:50:53.397750 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.397707    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"]
Jul 30 10:50:53.402636 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.402612    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.406279 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.406258    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-78eb1c\""
Jul 30 10:50:53.406400 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.406299    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-78eb1c-dockercfg-b7b5s\""
Jul 30 10:50:53.415122 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.415096    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"]
Jul 30 10:50:53.511686 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.511610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8bm4\" (UniqueName: \"kubernetes.io/projected/466f2450-8ea9-4479-9c1f-2daa789bfbc0-kube-api-access-j8bm4\") pod \"payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh\" (UID: \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.511686 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.511656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/466f2450-8ea9-4479-9c1f-2daa789bfbc0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh\" (UID: \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.613195 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.613158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8bm4\" (UniqueName: \"kubernetes.io/projected/466f2450-8ea9-4479-9c1f-2daa789bfbc0-kube-api-access-j8bm4\") pod \"payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh\" (UID: \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.613388 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.613213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/466f2450-8ea9-4479-9c1f-2daa789bfbc0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh\" (UID: \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.614012 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.613992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/466f2450-8ea9-4479-9c1f-2daa789bfbc0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh\" (UID: \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.621606 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.621584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8bm4\" (UniqueName: \"kubernetes.io/projected/466f2450-8ea9-4479-9c1f-2daa789bfbc0-kube-api-access-j8bm4\") pod \"payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh\" (UID: \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.713579 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.713552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.861454 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.861411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"]
Jul 30 10:50:53.863794 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:50:53.863754    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466f2450_8ea9_4479_9c1f_2daa789bfbc0.slice/crio-4941e894633eb31506565513dfde5abd4bd63afe45539362e06a4df86818b6b8 WatchSource:0}: Error finding container 4941e894633eb31506565513dfde5abd4bd63afe45539362e06a4df86818b6b8: Status 404 returned error can't find the container with id 4941e894633eb31506565513dfde5abd4bd63afe45539362e06a4df86818b6b8
Jul 30 10:50:53.969584 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.969549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh" event={"ID":"466f2450-8ea9-4479-9c1f-2daa789bfbc0","Type":"ContainerStarted","Data":"c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607"}
Jul 30 10:50:53.969773 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.969618    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:50:53.969773 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.969646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh" event={"ID":"466f2450-8ea9-4479-9c1f-2daa789bfbc0","Type":"ContainerStarted","Data":"4941e894633eb31506565513dfde5abd4bd63afe45539362e06a4df86818b6b8"}
Jul 30 10:50:53.971451 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.971425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b" event={"ID":"78c43cd4-3709-4d96-bf10-05ad2898b0bf","Type":"ContainerStarted","Data":"b0c42922992ae18287386fce10fcd60c8307acdee1c771417ca5aa67d06a1db2"}
Jul 30 10:50:53.971560 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.971475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b" event={"ID":"78c43cd4-3709-4d96-bf10-05ad2898b0bf","Type":"ContainerStarted","Data":"5e57b09626e5196f2ca3c4f2bd783c057bf2a71e0036ad085f400d15fb0cceae"}
Jul 30 10:50:53.971560 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.971526    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:50:53.986250 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:53.986184    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh" podStartSLOduration=0.986162815 podStartE2EDuration="986.162815ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:50:53.984803067 +0000 UTC m=+3672.328866754" watchObservedRunningTime="2026-07-30 10:50:53.986162815 +0000 UTC m=+3672.330226272"
Jul 30 10:50:54.003362 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:54.003309    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b" podStartSLOduration=1.422254197 podStartE2EDuration="2.003292651s" totalImagesPullingTime="581.038454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:50:54.000832727 +0000 UTC m=+3672.344896205" watchObservedRunningTime="2026-07-30 10:50:54.003292651 +0000 UTC m=+3672.347356150"
Jul 30 10:50:59.981692 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:50:59.981661    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:51:04.979188 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:04.979100    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:51:16.546355 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:16.546320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:17.257052 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:17.257010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:19.072365 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:19.072332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:19.127567 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:19.127540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:20.657086 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:20.657051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:20.792519 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:20.792488    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:21.741131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.741095    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"]
Jul 30 10:51:21.746710 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.746681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.753793 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.753633    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-2aadf4-serving-cert\""
Jul 30 10:51:21.758548 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.758521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"]
Jul 30 10:51:21.788663 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.788629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:21.873832 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.873787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e242e2-5cb8-4582-a791-526d2600bc67-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.874004 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.873853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dgc2\" (UniqueName: \"kubernetes.io/projected/e8e242e2-5cb8-4582-a791-526d2600bc67-kube-api-access-5dgc2\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.874004 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.873897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e242e2-5cb8-4582-a791-526d2600bc67-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.975252 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.975220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e242e2-5cb8-4582-a791-526d2600bc67-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.975252 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.975257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dgc2\" (UniqueName: \"kubernetes.io/projected/e8e242e2-5cb8-4582-a791-526d2600bc67-kube-api-access-5dgc2\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.975457 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.975278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e242e2-5cb8-4582-a791-526d2600bc67-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.975880 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.975850    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e242e2-5cb8-4582-a791-526d2600bc67-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.977678 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.977660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e242e2-5cb8-4582-a791-526d2600bc67-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:21.985627 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:21.985600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dgc2\" (UniqueName: \"kubernetes.io/projected/e8e242e2-5cb8-4582-a791-526d2600bc67-kube-api-access-5dgc2\") pod \"maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:22.058218 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:22.058193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:22.198199 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:22.198161    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"]
Jul 30 10:51:22.199558 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:51:22.199529    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e242e2_5cb8_4582_a791_526d2600bc67.slice/crio-106e705919f946e81c0924bb7323c2f06c3887f38f635f048df579d54c5f3b70 WatchSource:0}: Error finding container 106e705919f946e81c0924bb7323c2f06c3887f38f635f048df579d54c5f3b70: Status 404 returned error can't find the container with id 106e705919f946e81c0924bb7323c2f06c3887f38f635f048df579d54c5f3b70
Jul 30 10:51:23.121335 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:23.121300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm" event={"ID":"e8e242e2-5cb8-4582-a791-526d2600bc67","Type":"ContainerStarted","Data":"7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a"}
Jul 30 10:51:23.121756 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:23.121351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm" event={"ID":"e8e242e2-5cb8-4582-a791-526d2600bc67","Type":"ContainerStarted","Data":"106e705919f946e81c0924bb7323c2f06c3887f38f635f048df579d54c5f3b70"}
Jul 30 10:51:23.121756 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:23.121391    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:23.138944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:23.138889    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm" podStartSLOduration=1.799638575 podStartE2EDuration="2.138872379s" totalImagesPullingTime="339.233804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:51:23.136561728 +0000 UTC m=+3701.480625185" watchObservedRunningTime="2026-07-30 10:51:23.138872379 +0000 UTC m=+3701.482935840"
Jul 30 10:51:23.460180 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:23.460096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:23.520735 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:23.520699    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:51:29.131527 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:29.131496    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:51:45.661034 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:51:45.660988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:05.751919 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:05.751884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:12.046165 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:12.046130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:53.135326 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:53.135296    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh_466f2450-8ea9-4479-9c1f-2daa789bfbc0/payload-processing/0.log"
Jul 30 10:52:53.677275 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:53.677242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:54.013249 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:54.013159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:54.244355 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:54.244322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:56.928018 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:56.927983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:57.026997 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:57.026963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:58.189174 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.189140    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"]
Jul 30 10:52:58.192679 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.192658    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.194614 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.194597    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-8cd2f5-serving-cert\""
Jul 30 10:52:58.201793 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.201764    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"]
Jul 30 10:52:58.221168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.221140    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:58.283107 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.283058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65286a3-952e-4ac9-8d95-f05abef5c7fb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.283306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.283145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.283306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.283265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4zww\" (UniqueName: \"kubernetes.io/projected/f65286a3-952e-4ac9-8d95-f05abef5c7fb-kube-api-access-d4zww\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.384239 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.384202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4zww\" (UniqueName: \"kubernetes.io/projected/f65286a3-952e-4ac9-8d95-f05abef5c7fb-kube-api-access-d4zww\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.384239 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.384245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65286a3-952e-4ac9-8d95-f05abef5c7fb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.384489 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.384319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.384586 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:52:58.384562    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-serving-cert: secret "maas-api-e2e-ipp-cleanup-8cd2f5-serving-cert" not found
Jul 30 10:52:58.384664 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:52:58.384652    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls podName:f65286a3-952e-4ac9-8d95-f05abef5c7fb nodeName:}" failed. No retries permitted until 2026-07-30 10:52:58.884628037 +0000 UTC m=+3797.228691487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc" (UID: "f65286a3-952e-4ac9-8d95-f05abef5c7fb") : secret "maas-api-e2e-ipp-cleanup-8cd2f5-serving-cert" not found
Jul 30 10:52:58.385026 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.385003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65286a3-952e-4ac9-8d95-f05abef5c7fb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.392903 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.392876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4zww\" (UniqueName: \"kubernetes.io/projected/f65286a3-952e-4ac9-8d95-f05abef5c7fb-kube-api-access-d4zww\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.449433 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.449346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:58.796468 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.796385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:58.889984 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.889944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.892364 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.892338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:58.895095 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.895073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:52:58.907026 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.906998    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"]
Jul 30 10:52:58.910940 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.910918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:58.912995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.912974    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-8cd2f5-dockercfg-mc5qt\""
Jul 30 10:52:58.913086 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.913022    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-8cd2f5\""
Jul 30 10:52:58.916877 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.916806    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"]
Jul 30 10:52:58.921545 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.921508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"]
Jul 30 10:52:58.921680 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.921620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:58.928958 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.928928    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"]
Jul 30 10:52:58.990997 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.990958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vwfx\" (UniqueName: \"kubernetes.io/projected/afc0b315-b596-444e-b2ac-cee268956cd3-kube-api-access-9vwfx\") pod \"payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg\" (UID: \"afc0b315-b596-444e-b2ac-cee268956cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:58.991181 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.991013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq4pc\" (UniqueName: \"kubernetes.io/projected/828b7ebb-d009-483b-b9cc-6eab42e886e4-kube-api-access-xq4pc\") pod \"payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd\" (UID: \"828b7ebb-d009-483b-b9cc-6eab42e886e4\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:58.991181 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.991063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/828b7ebb-d009-483b-b9cc-6eab42e886e4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd\" (UID: \"828b7ebb-d009-483b-b9cc-6eab42e886e4\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:58.991181 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:58.991107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afc0b315-b596-444e-b2ac-cee268956cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg\" (UID: \"afc0b315-b596-444e-b2ac-cee268956cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:59.091648 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.091609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vwfx\" (UniqueName: \"kubernetes.io/projected/afc0b315-b596-444e-b2ac-cee268956cd3-kube-api-access-9vwfx\") pod \"payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg\" (UID: \"afc0b315-b596-444e-b2ac-cee268956cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:59.091884 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.091660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq4pc\" (UniqueName: \"kubernetes.io/projected/828b7ebb-d009-483b-b9cc-6eab42e886e4-kube-api-access-xq4pc\") pod \"payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd\" (UID: \"828b7ebb-d009-483b-b9cc-6eab42e886e4\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:59.091884 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.091692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/828b7ebb-d009-483b-b9cc-6eab42e886e4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd\" (UID: \"828b7ebb-d009-483b-b9cc-6eab42e886e4\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:59.091884 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.091733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afc0b315-b596-444e-b2ac-cee268956cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg\" (UID: \"afc0b315-b596-444e-b2ac-cee268956cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:59.092530 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.092504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/828b7ebb-d009-483b-b9cc-6eab42e886e4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd\" (UID: \"828b7ebb-d009-483b-b9cc-6eab42e886e4\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:59.092625 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.092506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afc0b315-b596-444e-b2ac-cee268956cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg\" (UID: \"afc0b315-b596-444e-b2ac-cee268956cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:59.100142 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.100108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq4pc\" (UniqueName: \"kubernetes.io/projected/828b7ebb-d009-483b-b9cc-6eab42e886e4-kube-api-access-xq4pc\") pod \"payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd\" (UID: \"828b7ebb-d009-483b-b9cc-6eab42e886e4\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:59.100329 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.100306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vwfx\" (UniqueName: \"kubernetes.io/projected/afc0b315-b596-444e-b2ac-cee268956cd3-kube-api-access-9vwfx\") pod \"payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg\" (UID: \"afc0b315-b596-444e-b2ac-cee268956cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:59.104976 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.104953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:52:59.223740 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.223707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:59.234967 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.234938    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:59.249085 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.249053    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"]
Jul 30 10:52:59.249586 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:52:59.249555    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65286a3_952e_4ac9_8d95_f05abef5c7fb.slice/crio-fde3b46dc6aa43526eebcdc2815a3064ba2df14502046c82968a366184ec5663 WatchSource:0}: Error finding container fde3b46dc6aa43526eebcdc2815a3064ba2df14502046c82968a366184ec5663: Status 404 returned error can't find the container with id fde3b46dc6aa43526eebcdc2815a3064ba2df14502046c82968a366184ec5663
Jul 30 10:52:59.385074 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.385037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"]
Jul 30 10:52:59.387125 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:52:59.387094    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc0b315_b596_444e_b2ac_cee268956cd3.slice/crio-82c5e365411e3b2c9827e8b11b7dc32e68ef4ebfa07c695295dc5092570bf18e WatchSource:0}: Error finding container 82c5e365411e3b2c9827e8b11b7dc32e68ef4ebfa07c695295dc5092570bf18e: Status 404 returned error can't find the container with id 82c5e365411e3b2c9827e8b11b7dc32e68ef4ebfa07c695295dc5092570bf18e
Jul 30 10:52:59.409321 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.409283    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"]
Jul 30 10:52:59.411995 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:52:59.411962    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828b7ebb_d009_483b_b9cc_6eab42e886e4.slice/crio-8eef41bf3ff90930fbb95fd2b72e54173579b366ee33f27526f5cecf990b1071 WatchSource:0}: Error finding container 8eef41bf3ff90930fbb95fd2b72e54173579b366ee33f27526f5cecf990b1071: Status 404 returned error can't find the container with id 8eef41bf3ff90930fbb95fd2b72e54173579b366ee33f27526f5cecf990b1071
Jul 30 10:52:59.613877 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.613763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd" event={"ID":"828b7ebb-d009-483b-b9cc-6eab42e886e4","Type":"ContainerStarted","Data":"1ee62029deb90144324803059fce18a74a246ec27b32690b1381e0806872b5c0"}
Jul 30 10:52:59.614044 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.613955    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:52:59.614044 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.613997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd" event={"ID":"828b7ebb-d009-483b-b9cc-6eab42e886e4","Type":"ContainerStarted","Data":"8eef41bf3ff90930fbb95fd2b72e54173579b366ee33f27526f5cecf990b1071"}
Jul 30 10:52:59.615244 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.615221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg" event={"ID":"afc0b315-b596-444e-b2ac-cee268956cd3","Type":"ContainerStarted","Data":"5f1bb4346c476f3f7bdb47772892eb5530e5073bee2308be4cc38512f8664676"}
Jul 30 10:52:59.615368 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.615266    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:52:59.615368 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.615282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg" event={"ID":"afc0b315-b596-444e-b2ac-cee268956cd3","Type":"ContainerStarted","Data":"82c5e365411e3b2c9827e8b11b7dc32e68ef4ebfa07c695295dc5092570bf18e"}
Jul 30 10:52:59.616440 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.616415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc" event={"ID":"f65286a3-952e-4ac9-8d95-f05abef5c7fb","Type":"ContainerStarted","Data":"fde3b46dc6aa43526eebcdc2815a3064ba2df14502046c82968a366184ec5663"}
Jul 30 10:52:59.629423 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.629376    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd" podStartSLOduration=1.629360235 podStartE2EDuration="1.629360235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:52:59.626896015 +0000 UTC m=+3797.970959474" watchObservedRunningTime="2026-07-30 10:52:59.629360235 +0000 UTC m=+3797.973423731"
Jul 30 10:52:59.646352 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:52:59.646297    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg" podStartSLOduration=1.646275392 podStartE2EDuration="1.646275392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:52:59.643365288 +0000 UTC m=+3797.987428745" watchObservedRunningTime="2026-07-30 10:52:59.646275392 +0000 UTC m=+3797.990339055"
Jul 30 10:53:02.633468 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:02.633428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc" event={"ID":"f65286a3-952e-4ac9-8d95-f05abef5c7fb","Type":"ContainerStarted","Data":"e38d00a97015ab030e27399415337bce1276e4b593b8db369c38fda0201966d7"}
Jul 30 10:53:02.633890 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:02.633570    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:53:02.652319 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:02.652258    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc" podStartSLOduration=1.4649062050000001 podStartE2EDuration="4.652236142s" totalImagesPullingTime="3.187329937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:53:02.649878526 +0000 UTC m=+3800.993942004" watchObservedRunningTime="2026-07-30 10:53:02.652236142 +0000 UTC m=+3800.996299599"
Jul 30 10:53:08.643995 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:08.643958    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:53:10.623696 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:10.623661    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:53:10.624108 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:10.623812    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:53:21.965746 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:21.965682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:28.561520 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.561487    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"]
Jul 30 10:53:28.562125 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.561766    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc" podUID="f65286a3-952e-4ac9-8d95-f05abef5c7fb" containerName="maas-api" containerID="cri-o://e38d00a97015ab030e27399415337bce1276e4b593b8db369c38fda0201966d7" gracePeriod=30
Jul 30 10:53:28.586180 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.586151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:28.614953 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.614911    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"]
Jul 30 10:53:28.615162 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.615140    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd" podUID="828b7ebb-d009-483b-b9cc-6eab42e886e4" containerName="payload-processing" containerID="cri-o://1ee62029deb90144324803059fce18a74a246ec27b32690b1381e0806872b5c0" gracePeriod=30
Jul 30 10:53:28.621994 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.621953    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"]
Jul 30 10:53:28.622278 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.622186    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg" podUID="afc0b315-b596-444e-b2ac-cee268956cd3" containerName="payload-pre-processing" containerID="cri-o://5f1bb4346c476f3f7bdb47772892eb5530e5073bee2308be4cc38512f8664676" gracePeriod=30
Jul 30 10:53:28.638901 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.638764    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc" podUID="f65286a3-952e-4ac9-8d95-f05abef5c7fb" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.92:8443/health\": dial tcp 10.133.0.92:8443: connect: connection refused"
Jul 30 10:53:28.775669 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.775624    2581 generic.go:356] "Generic (PLEG): container finished" podID="afc0b315-b596-444e-b2ac-cee268956cd3" containerID="5f1bb4346c476f3f7bdb47772892eb5530e5073bee2308be4cc38512f8664676" exitCode=0
Jul 30 10:53:28.775896 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.775712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg" event={"ID":"afc0b315-b596-444e-b2ac-cee268956cd3","Type":"ContainerDied","Data":"5f1bb4346c476f3f7bdb47772892eb5530e5073bee2308be4cc38512f8664676"}
Jul 30 10:53:28.777563 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.777536    2581 generic.go:356] "Generic (PLEG): container finished" podID="f65286a3-952e-4ac9-8d95-f05abef5c7fb" containerID="e38d00a97015ab030e27399415337bce1276e4b593b8db369c38fda0201966d7" exitCode=0
Jul 30 10:53:28.777702 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.777617    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc" event={"ID":"f65286a3-952e-4ac9-8d95-f05abef5c7fb","Type":"ContainerDied","Data":"e38d00a97015ab030e27399415337bce1276e4b593b8db369c38fda0201966d7"}
Jul 30 10:53:28.779941 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.779855    2581 generic.go:356] "Generic (PLEG): container finished" podID="828b7ebb-d009-483b-b9cc-6eab42e886e4" containerID="1ee62029deb90144324803059fce18a74a246ec27b32690b1381e0806872b5c0" exitCode=0
Jul 30 10:53:28.780055 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.779947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd" event={"ID":"828b7ebb-d009-483b-b9cc-6eab42e886e4","Type":"ContainerDied","Data":"1ee62029deb90144324803059fce18a74a246ec27b32690b1381e0806872b5c0"}
Jul 30 10:53:28.877541 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.877515    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:53:28.913414 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.913385    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:53:28.940666 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.940638    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:53:28.990654 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.990623    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/828b7ebb-d009-483b-b9cc-6eab42e886e4-plugins-config-volume\") pod \"828b7ebb-d009-483b-b9cc-6eab42e886e4\" (UID: \"828b7ebb-d009-483b-b9cc-6eab42e886e4\") "
Jul 30 10:53:28.990864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.990699    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq4pc\" (UniqueName: \"kubernetes.io/projected/828b7ebb-d009-483b-b9cc-6eab42e886e4-kube-api-access-xq4pc\") pod \"828b7ebb-d009-483b-b9cc-6eab42e886e4\" (UID: \"828b7ebb-d009-483b-b9cc-6eab42e886e4\") "
Jul 30 10:53:28.990864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.990718    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afc0b315-b596-444e-b2ac-cee268956cd3-plugins-config-volume\") pod \"afc0b315-b596-444e-b2ac-cee268956cd3\" (UID: \"afc0b315-b596-444e-b2ac-cee268956cd3\") "
Jul 30 10:53:28.990864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.990761    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65286a3-952e-4ac9-8d95-f05abef5c7fb-openshift-service-ca\") pod \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") "
Jul 30 10:53:28.990864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.990783    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vwfx\" (UniqueName: \"kubernetes.io/projected/afc0b315-b596-444e-b2ac-cee268956cd3-kube-api-access-9vwfx\") pod \"afc0b315-b596-444e-b2ac-cee268956cd3\" (UID: \"afc0b315-b596-444e-b2ac-cee268956cd3\") "
Jul 30 10:53:28.990864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.990803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4zww\" (UniqueName: \"kubernetes.io/projected/f65286a3-952e-4ac9-8d95-f05abef5c7fb-kube-api-access-d4zww\") pod \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") "
Jul 30 10:53:28.990864 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.990849    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls\") pod \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\" (UID: \"f65286a3-952e-4ac9-8d95-f05abef5c7fb\") "
Jul 30 10:53:28.991224 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.991184    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f65286a3-952e-4ac9-8d95-f05abef5c7fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f65286a3-952e-4ac9-8d95-f05abef5c7fb" (UID: "f65286a3-952e-4ac9-8d95-f05abef5c7fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:53:28.991224 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.991211    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afc0b315-b596-444e-b2ac-cee268956cd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "afc0b315-b596-444e-b2ac-cee268956cd3" (UID: "afc0b315-b596-444e-b2ac-cee268956cd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:53:28.991385 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.991365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/828b7ebb-d009-483b-b9cc-6eab42e886e4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "828b7ebb-d009-483b-b9cc-6eab42e886e4" (UID: "828b7ebb-d009-483b-b9cc-6eab42e886e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:53:28.992975 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.992949    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/828b7ebb-d009-483b-b9cc-6eab42e886e4-kube-api-access-xq4pc" (OuterVolumeSpecName: "kube-api-access-xq4pc") pod "828b7ebb-d009-483b-b9cc-6eab42e886e4" (UID: "828b7ebb-d009-483b-b9cc-6eab42e886e4"). InnerVolumeSpecName "kube-api-access-xq4pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:53:28.993089 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.993016    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f65286a3-952e-4ac9-8d95-f05abef5c7fb" (UID: "f65286a3-952e-4ac9-8d95-f05abef5c7fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:53:28.993313 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.993272    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65286a3-952e-4ac9-8d95-f05abef5c7fb-kube-api-access-d4zww" (OuterVolumeSpecName: "kube-api-access-d4zww") pod "f65286a3-952e-4ac9-8d95-f05abef5c7fb" (UID: "f65286a3-952e-4ac9-8d95-f05abef5c7fb"). InnerVolumeSpecName "kube-api-access-d4zww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:53:28.993411 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.993295    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc0b315-b596-444e-b2ac-cee268956cd3-kube-api-access-9vwfx" (OuterVolumeSpecName: "kube-api-access-9vwfx") pod "afc0b315-b596-444e-b2ac-cee268956cd3" (UID: "afc0b315-b596-444e-b2ac-cee268956cd3"). InnerVolumeSpecName "kube-api-access-9vwfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:53:28.993906 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:28.993887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:29.063232 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.063199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:29.092135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.092101    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/828b7ebb-d009-483b-b9cc-6eab42e886e4-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:29.092135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.092129    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq4pc\" (UniqueName: \"kubernetes.io/projected/828b7ebb-d009-483b-b9cc-6eab42e886e4-kube-api-access-xq4pc\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:29.092135 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.092140    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afc0b315-b596-444e-b2ac-cee268956cd3-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:29.092354 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.092151    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f65286a3-952e-4ac9-8d95-f05abef5c7fb-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:29.092354 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.092160    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vwfx\" (UniqueName: \"kubernetes.io/projected/afc0b315-b596-444e-b2ac-cee268956cd3-kube-api-access-9vwfx\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:29.092354 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.092169    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4zww\" (UniqueName: \"kubernetes.io/projected/f65286a3-952e-4ac9-8d95-f05abef5c7fb-kube-api-access-d4zww\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:29.092354 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.092178    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f65286a3-952e-4ac9-8d95-f05abef5c7fb-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:29.163310 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.163220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:29.786763 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.786731    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"
Jul 30 10:53:29.787257 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.786731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg" event={"ID":"afc0b315-b596-444e-b2ac-cee268956cd3","Type":"ContainerDied","Data":"82c5e365411e3b2c9827e8b11b7dc32e68ef4ebfa07c695295dc5092570bf18e"}
Jul 30 10:53:29.787257 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.786877    2581 scope.go:117] "RemoveContainer" containerID="5f1bb4346c476f3f7bdb47772892eb5530e5073bee2308be4cc38512f8664676"
Jul 30 10:53:29.788227 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.788184    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"
Jul 30 10:53:29.788295 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.788180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc" event={"ID":"f65286a3-952e-4ac9-8d95-f05abef5c7fb","Type":"ContainerDied","Data":"fde3b46dc6aa43526eebcdc2815a3064ba2df14502046c82968a366184ec5663"}
Jul 30 10:53:29.789602 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.789577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd" event={"ID":"828b7ebb-d009-483b-b9cc-6eab42e886e4","Type":"ContainerDied","Data":"8eef41bf3ff90930fbb95fd2b72e54173579b366ee33f27526f5cecf990b1071"}
Jul 30 10:53:29.789777 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.789604    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"
Jul 30 10:53:29.797511 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.797358    2581 scope.go:117] "RemoveContainer" containerID="e38d00a97015ab030e27399415337bce1276e4b593b8db369c38fda0201966d7"
Jul 30 10:53:29.806182 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.806165    2581 scope.go:117] "RemoveContainer" containerID="1ee62029deb90144324803059fce18a74a246ec27b32690b1381e0806872b5c0"
Jul 30 10:53:29.851808 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.851730    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"]
Jul 30 10:53:29.856238 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.856213    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8cd2f5-587cf84f44-pfvwc"]
Jul 30 10:53:29.882928 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.882895    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"]
Jul 30 10:53:29.895705 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.895677    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg"]
Jul 30 10:53:29.908193 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.908167    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"]
Jul 30 10:53:29.923410 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:29.923378    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd"]
Jul 30 10:53:30.229326 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:30.229245    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="828b7ebb-d009-483b-b9cc-6eab42e886e4" path="/var/lib/kubelet/pods/828b7ebb-d009-483b-b9cc-6eab42e886e4/volumes"
Jul 30 10:53:30.229614 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:30.229601    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afc0b315-b596-444e-b2ac-cee268956cd3" path="/var/lib/kubelet/pods/afc0b315-b596-444e-b2ac-cee268956cd3/volumes"
Jul 30 10:53:30.229963 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:30.229950    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65286a3-952e-4ac9-8d95-f05abef5c7fb" path="/var/lib/kubelet/pods/f65286a3-952e-4ac9-8d95-f05abef5c7fb/volumes"
Jul 30 10:53:31.786025 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:31.785984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:31.844912 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:31.844875    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:35.441263 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:35.441231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:35.503942 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:35.503909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:35.659847 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:35.659735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:54.753131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.753092    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"]
Jul 30 10:53:54.753552 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.753394    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b" podUID="78c43cd4-3709-4d96-bf10-05ad2898b0bf" containerName="maas-api" containerID="cri-o://b0c42922992ae18287386fce10fcd60c8307acdee1c771417ca5aa67d06a1db2" gracePeriod=30
Jul 30 10:53:54.820382 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.820344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:54.884383 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.883003    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"]
Jul 30 10:53:54.884383 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.883246    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh" podUID="466f2450-8ea9-4479-9c1f-2daa789bfbc0" containerName="payload-processing" containerID="cri-o://c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607" gracePeriod=30
Jul 30 10:53:54.911353 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.910241    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:54.927690 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.927640    2581 generic.go:356] "Generic (PLEG): container finished" podID="78c43cd4-3709-4d96-bf10-05ad2898b0bf" containerID="b0c42922992ae18287386fce10fcd60c8307acdee1c771417ca5aa67d06a1db2" exitCode=0
Jul 30 10:53:54.927889 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.927868    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b" event={"ID":"78c43cd4-3709-4d96-bf10-05ad2898b0bf","Type":"ContainerDied","Data":"b0c42922992ae18287386fce10fcd60c8307acdee1c771417ca5aa67d06a1db2"}
Jul 30 10:53:54.978164 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:54.978123    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh" podUID="466f2450-8ea9-4479-9c1f-2daa789bfbc0" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.90:9004: connect: connection refused"
Jul 30 10:53:55.027129 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.027088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:55.058193 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.058163    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:53:55.135071 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.135040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:55.146093 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.146062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c43cd4-3709-4d96-bf10-05ad2898b0bf-maas-api-tls\") pod \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") "
Jul 30 10:53:55.146319 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.146117    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c43cd4-3709-4d96-bf10-05ad2898b0bf-openshift-service-ca\") pod \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") "
Jul 30 10:53:55.146319 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.146163    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t967q\" (UniqueName: \"kubernetes.io/projected/78c43cd4-3709-4d96-bf10-05ad2898b0bf-kube-api-access-t967q\") pod \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\" (UID: \"78c43cd4-3709-4d96-bf10-05ad2898b0bf\") "
Jul 30 10:53:55.147196 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.147167    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78c43cd4-3709-4d96-bf10-05ad2898b0bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78c43cd4-3709-4d96-bf10-05ad2898b0bf" (UID: "78c43cd4-3709-4d96-bf10-05ad2898b0bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:53:55.148811 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.148781    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c43cd4-3709-4d96-bf10-05ad2898b0bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78c43cd4-3709-4d96-bf10-05ad2898b0bf" (UID: "78c43cd4-3709-4d96-bf10-05ad2898b0bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:53:55.149094 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.149071    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78c43cd4-3709-4d96-bf10-05ad2898b0bf-kube-api-access-t967q" (OuterVolumeSpecName: "kube-api-access-t967q") pod "78c43cd4-3709-4d96-bf10-05ad2898b0bf" (UID: "78c43cd4-3709-4d96-bf10-05ad2898b0bf"). InnerVolumeSpecName "kube-api-access-t967q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:53:55.170425 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.170394    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:53:55.246845 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.246774    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/466f2450-8ea9-4479-9c1f-2daa789bfbc0-plugins-config-volume\") pod \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\" (UID: \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\") "
Jul 30 10:53:55.247022 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.246923    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8bm4\" (UniqueName: \"kubernetes.io/projected/466f2450-8ea9-4479-9c1f-2daa789bfbc0-kube-api-access-j8bm4\") pod \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\" (UID: \"466f2450-8ea9-4479-9c1f-2daa789bfbc0\") "
Jul 30 10:53:55.247149 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.247131    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c43cd4-3709-4d96-bf10-05ad2898b0bf-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:55.247149 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.247146    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c43cd4-3709-4d96-bf10-05ad2898b0bf-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:55.247262 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.247157    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t967q\" (UniqueName: \"kubernetes.io/projected/78c43cd4-3709-4d96-bf10-05ad2898b0bf-kube-api-access-t967q\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:55.247262 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.247212    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/466f2450-8ea9-4479-9c1f-2daa789bfbc0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "466f2450-8ea9-4479-9c1f-2daa789bfbc0" (UID: "466f2450-8ea9-4479-9c1f-2daa789bfbc0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:53:55.248986 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.248965    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/466f2450-8ea9-4479-9c1f-2daa789bfbc0-kube-api-access-j8bm4" (OuterVolumeSpecName: "kube-api-access-j8bm4") pod "466f2450-8ea9-4479-9c1f-2daa789bfbc0" (UID: "466f2450-8ea9-4479-9c1f-2daa789bfbc0"). InnerVolumeSpecName "kube-api-access-j8bm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:53:55.348121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.348086    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/466f2450-8ea9-4479-9c1f-2daa789bfbc0-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:55.348121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.348115    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8bm4\" (UniqueName: \"kubernetes.io/projected/466f2450-8ea9-4479-9c1f-2daa789bfbc0-kube-api-access-j8bm4\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:53:55.531235 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.531200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:53:55.934669 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.934640    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"
Jul 30 10:53:55.935188 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.934640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b" event={"ID":"78c43cd4-3709-4d96-bf10-05ad2898b0bf","Type":"ContainerDied","Data":"5e57b09626e5196f2ca3c4f2bd783c057bf2a71e0036ad085f400d15fb0cceae"}
Jul 30 10:53:55.935188 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.934775    2581 scope.go:117] "RemoveContainer" containerID="b0c42922992ae18287386fce10fcd60c8307acdee1c771417ca5aa67d06a1db2"
Jul 30 10:53:55.936235 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.936019    2581 generic.go:356] "Generic (PLEG): container finished" podID="466f2450-8ea9-4479-9c1f-2daa789bfbc0" containerID="c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607" exitCode=0
Jul 30 10:53:55.936235 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.936078    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"
Jul 30 10:53:55.936235 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.936116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh" event={"ID":"466f2450-8ea9-4479-9c1f-2daa789bfbc0","Type":"ContainerDied","Data":"c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607"}
Jul 30 10:53:55.936235 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.936170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh" event={"ID":"466f2450-8ea9-4479-9c1f-2daa789bfbc0","Type":"ContainerDied","Data":"4941e894633eb31506565513dfde5abd4bd63afe45539362e06a4df86818b6b8"}
Jul 30 10:53:55.945650 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.945630    2581 scope.go:117] "RemoveContainer" containerID="c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607"
Jul 30 10:53:55.954019 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.953995    2581 scope.go:117] "RemoveContainer" containerID="c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607"
Jul 30 10:53:55.954313 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:53:55.954289    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607\": container with ID starting with c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607 not found: ID does not exist" containerID="c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607"
Jul 30 10:53:55.954407 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.954326    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607"} err="failed to get container status \"c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607\": rpc error: code = NotFound desc = could not find container \"c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607\": container with ID starting with c4933ffcf0127c7bf6755e462288e9ded94531d48ed6d5354c5ae61f6ae9e607 not found: ID does not exist"
Jul 30 10:53:55.959908 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.959882    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"]
Jul 30 10:53:55.964694 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.964665    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b"]
Jul 30 10:53:55.975223 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.975194    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"]
Jul 30 10:53:55.987811 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:55.982267    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh"]
Jul 30 10:53:56.228435 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:56.228402    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="466f2450-8ea9-4479-9c1f-2daa789bfbc0" path="/var/lib/kubelet/pods/466f2450-8ea9-4479-9c1f-2daa789bfbc0/volumes"
Jul 30 10:53:56.228804 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:56.228790    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78c43cd4-3709-4d96-bf10-05ad2898b0bf" path="/var/lib/kubelet/pods/78c43cd4-3709-4d96-bf10-05ad2898b0bf/volumes"
Jul 30 10:53:57.977377 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:53:57.977329    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-78eb1c-758dcb6b7f-4qx8b" podUID="78c43cd4-3709-4d96-bf10-05ad2898b0bf" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.89:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 30 10:54:00.552005 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:00.551971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:36.680246 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:36.680215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:37.490717 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:37.490683    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:42.470741 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:42.470714    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:54:42.483073 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:42.483053    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtsn9_e8e669b5-1ce0-404e-abe4-033e16dff345/ovn-acl-logging/0.log"
Jul 30 10:54:43.218142 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:43.218044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:43.316405 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:43.316373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:43.506745 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:43.506659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:43.742742 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:43.742707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:54.471694 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.471657    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"]
Jul 30 10:54:54.472163 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.471929    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm" podUID="e8e242e2-5cb8-4582-a791-526d2600bc67" containerName="maas-api" containerID="cri-o://7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a" gracePeriod=30
Jul 30 10:54:54.506356 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.506322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:54.575294 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.575260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:54.636861 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.636831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:54.710912 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.710885    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:54.733026 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.732957    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:54:54.806712 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.806678    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e242e2-5cb8-4582-a791-526d2600bc67-maas-api-tls\") pod \"e8e242e2-5cb8-4582-a791-526d2600bc67\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") "
Jul 30 10:54:54.806947 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.806801    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dgc2\" (UniqueName: \"kubernetes.io/projected/e8e242e2-5cb8-4582-a791-526d2600bc67-kube-api-access-5dgc2\") pod \"e8e242e2-5cb8-4582-a791-526d2600bc67\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") "
Jul 30 10:54:54.806947 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.806875    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e242e2-5cb8-4582-a791-526d2600bc67-openshift-service-ca\") pod \"e8e242e2-5cb8-4582-a791-526d2600bc67\" (UID: \"e8e242e2-5cb8-4582-a791-526d2600bc67\") "
Jul 30 10:54:54.807284 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.807249    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e242e2-5cb8-4582-a791-526d2600bc67-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8e242e2-5cb8-4582-a791-526d2600bc67" (UID: "e8e242e2-5cb8-4582-a791-526d2600bc67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:54:54.808998 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.808970    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e242e2-5cb8-4582-a791-526d2600bc67-kube-api-access-5dgc2" (OuterVolumeSpecName: "kube-api-access-5dgc2") pod "e8e242e2-5cb8-4582-a791-526d2600bc67" (UID: "e8e242e2-5cb8-4582-a791-526d2600bc67"). InnerVolumeSpecName "kube-api-access-5dgc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:54:54.809096 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.808970    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e242e2-5cb8-4582-a791-526d2600bc67-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8e242e2-5cb8-4582-a791-526d2600bc67" (UID: "e8e242e2-5cb8-4582-a791-526d2600bc67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:54:54.908170 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.908131    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dgc2\" (UniqueName: \"kubernetes.io/projected/e8e242e2-5cb8-4582-a791-526d2600bc67-kube-api-access-5dgc2\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:54:54.908170 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.908164    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e242e2-5cb8-4582-a791-526d2600bc67-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:54:54.908170 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:54.908178    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e242e2-5cb8-4582-a791-526d2600bc67-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:54:55.098184 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.098147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:54:55.237511 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.237473    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8e242e2-5cb8-4582-a791-526d2600bc67" containerID="7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a" exitCode=0
Jul 30 10:54:55.237682 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.237520    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"
Jul 30 10:54:55.237682 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.237544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm" event={"ID":"e8e242e2-5cb8-4582-a791-526d2600bc67","Type":"ContainerDied","Data":"7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a"}
Jul 30 10:54:55.237682 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.237585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm" event={"ID":"e8e242e2-5cb8-4582-a791-526d2600bc67","Type":"ContainerDied","Data":"106e705919f946e81c0924bb7323c2f06c3887f38f635f048df579d54c5f3b70"}
Jul 30 10:54:55.237682 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.237609    2581 scope.go:117] "RemoveContainer" containerID="7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a"
Jul 30 10:54:55.247446 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.247431    2581 scope.go:117] "RemoveContainer" containerID="7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a"
Jul 30 10:54:55.247695 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:54:55.247677    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a\": container with ID starting with 7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a not found: ID does not exist" containerID="7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a"
Jul 30 10:54:55.247762 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.247710    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a"} err="failed to get container status \"7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a\": rpc error: code = NotFound desc = could not find container \"7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a\": container with ID starting with 7788b931b4a5ca55f2bfd91bc308265ef53f515e51d7cefec70a00f04f020d5a not found: ID does not exist"
Jul 30 10:54:55.260088 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.260066    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"]
Jul 30 10:54:55.263848 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:55.263804    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2aadf4-775d8f6db6-rmdhm"]
Jul 30 10:54:56.229189 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:54:56.229152    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e242e2-5cb8-4582-a791-526d2600bc67" path="/var/lib/kubelet/pods/e8e242e2-5cb8-4582-a791-526d2600bc67/volumes"
Jul 30 10:55:01.282100 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:01.282065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:01.381373 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:01.381325    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:01.573541 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:01.573511    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:01.804498 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:01.804462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:12.560639 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.560598    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"]
Jul 30 10:55:12.561201 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.560885    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6" podUID="15a86a4e-cd6b-4425-89fd-15d2ac515fd4" containerName="maas-api" containerID="cri-o://5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb" gracePeriod=30
Jul 30 10:55:12.593929 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.593894    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"]
Jul 30 10:55:12.594138 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.594035    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:12.596045 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.596018    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b75946-29756805-s7kmj"]
Jul 30 10:55:12.624070 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.624028    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"]
Jul 30 10:55:12.624268 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.624243    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c" podUID="e21580a0-c075-41b3-bc9a-cd8fb28e1daa" containerName="payload-processing" containerID="cri-o://b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70" gracePeriod=30
Jul 30 10:55:12.634624 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.634593    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"]
Jul 30 10:55:12.634905 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.634854    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2" podUID="8a7a0400-c0b3-4938-a818-ee91c4c84c57" containerName="payload-pre-processing" containerID="cri-o://aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543" gracePeriod=30
Jul 30 10:55:12.693121 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.693089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:12.780528 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.780487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:12.853010 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.852981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:12.907525 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.907499    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:55:12.924434 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.924413    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:55:12.928722 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:12.928695    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:55:13.084441 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.084404    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l75jf\" (UniqueName: \"kubernetes.io/projected/8a7a0400-c0b3-4938-a818-ee91c4c84c57-kube-api-access-l75jf\") pod \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\" (UID: \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\") "
Jul 30 10:55:13.084678 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.084456    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-maas-api-tls\") pod \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") "
Jul 30 10:55:13.084678 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.084493    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7a0400-c0b3-4938-a818-ee91c4c84c57-plugins-config-volume\") pod \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\" (UID: \"8a7a0400-c0b3-4938-a818-ee91c4c84c57\") "
Jul 30 10:55:13.084678 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.084523    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsb6l\" (UniqueName: \"kubernetes.io/projected/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-kube-api-access-nsb6l\") pod \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") "
Jul 30 10:55:13.084678 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.084557    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ld85\" (UniqueName: \"kubernetes.io/projected/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-kube-api-access-5ld85\") pod \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\" (UID: \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\") "
Jul 30 10:55:13.084678 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.084610    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-openshift-service-ca\") pod \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\" (UID: \"15a86a4e-cd6b-4425-89fd-15d2ac515fd4\") "
Jul 30 10:55:13.084678 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.084630    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-plugins-config-volume\") pod \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\" (UID: \"e21580a0-c075-41b3-bc9a-cd8fb28e1daa\") "
Jul 30 10:55:13.085057 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.084969    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a7a0400-c0b3-4938-a818-ee91c4c84c57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a7a0400-c0b3-4938-a818-ee91c4c84c57" (UID: "8a7a0400-c0b3-4938-a818-ee91c4c84c57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:55:13.085057 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.085028    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15a86a4e-cd6b-4425-89fd-15d2ac515fd4" (UID: "15a86a4e-cd6b-4425-89fd-15d2ac515fd4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:55:13.085168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.085148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e21580a0-c075-41b3-bc9a-cd8fb28e1daa" (UID: "e21580a0-c075-41b3-bc9a-cd8fb28e1daa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:55:13.086693 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.086673    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15a86a4e-cd6b-4425-89fd-15d2ac515fd4" (UID: "15a86a4e-cd6b-4425-89fd-15d2ac515fd4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:55:13.086795 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.086706    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a7a0400-c0b3-4938-a818-ee91c4c84c57-kube-api-access-l75jf" (OuterVolumeSpecName: "kube-api-access-l75jf") pod "8a7a0400-c0b3-4938-a818-ee91c4c84c57" (UID: "8a7a0400-c0b3-4938-a818-ee91c4c84c57"). InnerVolumeSpecName "kube-api-access-l75jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:55:13.087068 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.087053    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-kube-api-access-nsb6l" (OuterVolumeSpecName: "kube-api-access-nsb6l") pod "15a86a4e-cd6b-4425-89fd-15d2ac515fd4" (UID: "15a86a4e-cd6b-4425-89fd-15d2ac515fd4"). InnerVolumeSpecName "kube-api-access-nsb6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:55:13.087068 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.087060    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-kube-api-access-5ld85" (OuterVolumeSpecName: "kube-api-access-5ld85") pod "e21580a0-c075-41b3-bc9a-cd8fb28e1daa" (UID: "e21580a0-c075-41b3-bc9a-cd8fb28e1daa"). InnerVolumeSpecName "kube-api-access-5ld85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:55:13.180131 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.180094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:13.186303 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.186278    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ld85\" (UniqueName: \"kubernetes.io/projected/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-kube-api-access-5ld85\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:13.186303 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.186305    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:13.186424 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.186315    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e21580a0-c075-41b3-bc9a-cd8fb28e1daa-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:13.186424 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.186324    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l75jf\" (UniqueName: \"kubernetes.io/projected/8a7a0400-c0b3-4938-a818-ee91c4c84c57-kube-api-access-l75jf\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:13.186424 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.186333    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:13.186424 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.186342    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7a0400-c0b3-4938-a818-ee91c4c84c57-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:13.186424 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.186350    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsb6l\" (UniqueName: \"kubernetes.io/projected/15a86a4e-cd6b-4425-89fd-15d2ac515fd4-kube-api-access-nsb6l\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:13.328283 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.328248    2581 generic.go:356] "Generic (PLEG): container finished" podID="8a7a0400-c0b3-4938-a818-ee91c4c84c57" containerID="aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543" exitCode=0
Jul 30 10:55:13.328471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.328287    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"
Jul 30 10:55:13.328471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.328320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2" event={"ID":"8a7a0400-c0b3-4938-a818-ee91c4c84c57","Type":"ContainerDied","Data":"aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543"}
Jul 30 10:55:13.328471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.328368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2" event={"ID":"8a7a0400-c0b3-4938-a818-ee91c4c84c57","Type":"ContainerDied","Data":"bac2e8ff77fbe75d0999656902e0d433f5dedf2563ed550a103744042ef62703"}
Jul 30 10:55:13.328471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.328391    2581 scope.go:117] "RemoveContainer" containerID="aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543"
Jul 30 10:55:13.329794 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.329764    2581 generic.go:356] "Generic (PLEG): container finished" podID="e21580a0-c075-41b3-bc9a-cd8fb28e1daa" containerID="b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70" exitCode=0
Jul 30 10:55:13.329945 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.329833    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"
Jul 30 10:55:13.329945 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.329859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c" event={"ID":"e21580a0-c075-41b3-bc9a-cd8fb28e1daa","Type":"ContainerDied","Data":"b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70"}
Jul 30 10:55:13.329945 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.329903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c" event={"ID":"e21580a0-c075-41b3-bc9a-cd8fb28e1daa","Type":"ContainerDied","Data":"fad5df150218f9fdc159d062c5a507340920310a957b38d663bf9a146d6688f6"}
Jul 30 10:55:13.331351 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.331309    2581 generic.go:356] "Generic (PLEG): container finished" podID="15a86a4e-cd6b-4425-89fd-15d2ac515fd4" containerID="5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb" exitCode=0
Jul 30 10:55:13.331475 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.331355    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6" event={"ID":"15a86a4e-cd6b-4425-89fd-15d2ac515fd4","Type":"ContainerDied","Data":"5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb"}
Jul 30 10:55:13.331475 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.331367    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"
Jul 30 10:55:13.331475 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.331403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6" event={"ID":"15a86a4e-cd6b-4425-89fd-15d2ac515fd4","Type":"ContainerDied","Data":"00938fd9e67f72d559ab5a899b67a1782dde4663d318c62bac2636db1d8dbbe6"}
Jul 30 10:55:13.341006 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.339573    2581 scope.go:117] "RemoveContainer" containerID="aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543"
Jul 30 10:55:13.341006 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:55:13.340775    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543\": container with ID starting with aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543 not found: ID does not exist" containerID="aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543"
Jul 30 10:55:13.341006 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.340827    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543"} err="failed to get container status \"aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543\": rpc error: code = NotFound desc = could not find container \"aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543\": container with ID starting with aff2ab27ac60c85c224d4afcdb2032db3befb4c3e1c700f2ecec5d0112cc8543 not found: ID does not exist"
Jul 30 10:55:13.341006 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.340853    2581 scope.go:117] "RemoveContainer" containerID="b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70"
Jul 30 10:55:13.351555 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.351536    2581 scope.go:117] "RemoveContainer" containerID="b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70"
Jul 30 10:55:13.351851 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:55:13.351830    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70\": container with ID starting with b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70 not found: ID does not exist" containerID="b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70"
Jul 30 10:55:13.351901 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.351858    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70"} err="failed to get container status \"b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70\": rpc error: code = NotFound desc = could not find container \"b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70\": container with ID starting with b54336ea17b4f9c697b4c44a2c6f772600b94661fdae52d5c0da24daf0a57c70 not found: ID does not exist"
Jul 30 10:55:13.351901 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.351876    2581 scope.go:117] "RemoveContainer" containerID="5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb"
Jul 30 10:55:13.356372 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.356348    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"]
Jul 30 10:55:13.360218 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.360198    2581 scope.go:117] "RemoveContainer" containerID="5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb"
Jul 30 10:55:13.360438 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:55:13.360421    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb\": container with ID starting with 5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb not found: ID does not exist" containerID="5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb"
Jul 30 10:55:13.360485 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.360445    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb"} err="failed to get container status \"5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb\": rpc error: code = NotFound desc = could not find container \"5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb\": container with ID starting with 5a99576e25388aebe05e31a688fa5704c7ce0d66604c7924646515a4b658f2eb not found: ID does not exist"
Jul 30 10:55:13.363912 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.363890    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2"]
Jul 30 10:55:13.377418 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.377395    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"]
Jul 30 10:55:13.382566 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.382544    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b75946-7c649d64b4-vnfj6"]
Jul 30 10:55:13.394182 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.394160    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"]
Jul 30 10:55:13.398512 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:13.398490    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c"]
Jul 30 10:55:14.227693 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:14.227658    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a86a4e-cd6b-4425-89fd-15d2ac515fd4" path="/var/lib/kubelet/pods/15a86a4e-cd6b-4425-89fd-15d2ac515fd4/volumes"
Jul 30 10:55:14.228089 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:14.227944    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a22757a-e376-4e92-8fcc-0dbba0d93a83" path="/var/lib/kubelet/pods/7a22757a-e376-4e92-8fcc-0dbba0d93a83/volumes"
Jul 30 10:55:14.228222 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:14.228209    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a7a0400-c0b3-4938-a818-ee91c4c84c57" path="/var/lib/kubelet/pods/8a7a0400-c0b3-4938-a818-ee91c4c84c57/volumes"
Jul 30 10:55:14.228517 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:14.228506    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21580a0-c075-41b3-bc9a-cd8fb28e1daa" path="/var/lib/kubelet/pods/e21580a0-c075-41b3-bc9a-cd8fb28e1daa/volumes"
Jul 30 10:55:19.664101 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:19.664071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:19.755951 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:19.755918    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:19.953975 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:19.953892    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:20.211192 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.211089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:20.344484 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344447    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"]
Jul 30 10:55:20.344883 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344869    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a7a0400-c0b3-4938-a818-ee91c4c84c57" containerName="payload-pre-processing"
Jul 30 10:55:20.344944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344885    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7a0400-c0b3-4938-a818-ee91c4c84c57" containerName="payload-pre-processing"
Jul 30 10:55:20.344944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344894    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21580a0-c075-41b3-bc9a-cd8fb28e1daa" containerName="payload-processing"
Jul 30 10:55:20.344944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344900    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21580a0-c075-41b3-bc9a-cd8fb28e1daa" containerName="payload-processing"
Jul 30 10:55:20.344944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344908    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc0b315-b596-444e-b2ac-cee268956cd3" containerName="payload-pre-processing"
Jul 30 10:55:20.344944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344914    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc0b315-b596-444e-b2ac-cee268956cd3" containerName="payload-pre-processing"
Jul 30 10:55:20.344944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344928    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a86a4e-cd6b-4425-89fd-15d2ac515fd4" containerName="maas-api"
Jul 30 10:55:20.344944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344934    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a86a4e-cd6b-4425-89fd-15d2ac515fd4" containerName="maas-api"
Jul 30 10:55:20.344944 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344943    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78c43cd4-3709-4d96-bf10-05ad2898b0bf" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344949    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c43cd4-3709-4d96-bf10-05ad2898b0bf" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344956    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="828b7ebb-d009-483b-b9cc-6eab42e886e4" containerName="payload-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344961    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="828b7ebb-d009-483b-b9cc-6eab42e886e4" containerName="payload-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344967    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f65286a3-952e-4ac9-8d95-f05abef5c7fb" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344973    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65286a3-952e-4ac9-8d95-f05abef5c7fb" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344982    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="466f2450-8ea9-4479-9c1f-2daa789bfbc0" containerName="payload-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344987    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="466f2450-8ea9-4479-9c1f-2daa789bfbc0" containerName="payload-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344993    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e242e2-5cb8-4582-a791-526d2600bc67" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.344998    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e242e2-5cb8-4582-a791-526d2600bc67" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345054    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc0b315-b596-444e-b2ac-cee268956cd3" containerName="payload-pre-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345062    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a86a4e-cd6b-4425-89fd-15d2ac515fd4" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345068    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f65286a3-952e-4ac9-8d95-f05abef5c7fb" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345073    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e242e2-5cb8-4582-a791-526d2600bc67" containerName="maas-api"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345079    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a7a0400-c0b3-4938-a818-ee91c4c84c57" containerName="payload-pre-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345084    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="828b7ebb-d009-483b-b9cc-6eab42e886e4" containerName="payload-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345090    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e21580a0-c075-41b3-bc9a-cd8fb28e1daa" containerName="payload-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345098    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="466f2450-8ea9-4479-9c1f-2daa789bfbc0" containerName="payload-processing"
Jul 30 10:55:20.345197 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.345105    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78c43cd4-3709-4d96-bf10-05ad2898b0bf" containerName="maas-api"
Jul 30 10:55:20.349832 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.349800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"
Jul 30 10:55:20.352282 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.352256    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j6dj6\""
Jul 30 10:55:20.354991 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.354958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"]
Jul 30 10:55:20.451608 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.451575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb2272d-2094-4828-9d21-c4a4ca4e0c36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6\" (UID: \"dfb2272d-2094-4828-9d21-c4a4ca4e0c36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"
Jul 30 10:55:20.553166 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.553061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb2272d-2094-4828-9d21-c4a4ca4e0c36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6\" (UID: \"dfb2272d-2094-4828-9d21-c4a4ca4e0c36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"
Jul 30 10:55:20.553735 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.553714    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb2272d-2094-4828-9d21-c4a4ca4e0c36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6\" (UID: \"dfb2272d-2094-4828-9d21-c4a4ca4e0c36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"
Jul 30 10:55:20.662997 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.662955    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"
Jul 30 10:55:20.799200 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:20.799173    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"]
Jul 30 10:55:20.801931 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:55:20.801883    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb2272d_2094_4828_9d21_c4a4ca4e0c36.slice/crio-52a2b7ca52b626e619c5bff22ea1cf689f757d97484694a13707f556132b0a6c WatchSource:0}: Error finding container 52a2b7ca52b626e619c5bff22ea1cf689f757d97484694a13707f556132b0a6c: Status 404 returned error can't find the container with id 52a2b7ca52b626e619c5bff22ea1cf689f757d97484694a13707f556132b0a6c
Jul 30 10:55:21.378193 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:21.378161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6" event={"ID":"dfb2272d-2094-4828-9d21-c4a4ca4e0c36","Type":"ContainerStarted","Data":"1f24482fcf0160c642ac48ca49448a395b667f6451125aed2c9fa2c389011ff1"}
Jul 30 10:55:21.378377 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:21.378210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6" event={"ID":"dfb2272d-2094-4828-9d21-c4a4ca4e0c36","Type":"ContainerStarted","Data":"52a2b7ca52b626e619c5bff22ea1cf689f757d97484694a13707f556132b0a6c"}
Jul 30 10:55:21.394168 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:21.394112    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6" podStartSLOduration=1.394096948 podStartE2EDuration="1.394096948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:55:21.392500963 +0000 UTC m=+3939.736564414" watchObservedRunningTime="2026-07-30 10:55:21.394096948 +0000 UTC m=+3939.738160404"
Jul 30 10:55:22.384545 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:22.384511    2581 generic.go:356] "Generic (PLEG): container finished" podID="dfb2272d-2094-4828-9d21-c4a4ca4e0c36" containerID="1f24482fcf0160c642ac48ca49448a395b667f6451125aed2c9fa2c389011ff1" exitCode=0
Jul 30 10:55:22.384951 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:22.384580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6" event={"ID":"dfb2272d-2094-4828-9d21-c4a4ca4e0c36","Type":"ContainerDied","Data":"1f24482fcf0160c642ac48ca49448a395b667f6451125aed2c9fa2c389011ff1"}
Jul 30 10:55:23.526520 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:23.526492    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"
Jul 30 10:55:23.583602 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:23.583563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb2272d-2094-4828-9d21-c4a4ca4e0c36-maas-api-service-ca\") pod \"dfb2272d-2094-4828-9d21-c4a4ca4e0c36\" (UID: \"dfb2272d-2094-4828-9d21-c4a4ca4e0c36\") "
Jul 30 10:55:23.583949 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:23.583927    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfb2272d-2094-4828-9d21-c4a4ca4e0c36-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dfb2272d-2094-4828-9d21-c4a4ca4e0c36" (UID: "dfb2272d-2094-4828-9d21-c4a4ca4e0c36"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:55:23.685071 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:23.684985    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb2272d-2094-4828-9d21-c4a4ca4e0c36-maas-api-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:24.395558 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:24.395511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6" event={"ID":"dfb2272d-2094-4828-9d21-c4a4ca4e0c36","Type":"ContainerDied","Data":"52a2b7ca52b626e619c5bff22ea1cf689f757d97484694a13707f556132b0a6c"}
Jul 30 10:55:24.395558 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:24.395557    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"
Jul 30 10:55:24.395838 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:24.395569    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52a2b7ca52b626e619c5bff22ea1cf689f757d97484694a13707f556132b0a6c"
Jul 30 10:55:26.334060 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.334015    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"]
Jul 30 10:55:26.334542 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.334283    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n" podUID="64a66887-0b60-44fc-9e83-74679accddd5" containerName="maas-api" containerID="cri-o://53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555" gracePeriod=30
Jul 30 10:55:26.362029 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.361999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:26.390912 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.390859    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"]
Jul 30 10:55:26.391233 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.391174    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b" podUID="f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad" containerName="payload-processing" containerID="cri-o://80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6" gracePeriod=30
Jul 30 10:55:26.400696 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.400661    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"]
Jul 30 10:55:26.400930 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.400905    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k" podUID="6e0ff321-8a29-410f-b0f9-86737fcd1e3d" containerName="payload-pre-processing" containerID="cri-o://b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb" gracePeriod=30
Jul 30 10:55:26.678836 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.678784    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"]
Jul 30 10:55:26.681348 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.681320    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bdf164-86wr6"]
Jul 30 10:55:26.687788 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.687766    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:55:26.694292 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.694268    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:55:26.716100 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.716074    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a66887-0b60-44fc-9e83-74679accddd5-maas-api-tls\") pod \"64a66887-0b60-44fc-9e83-74679accddd5\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") "
Jul 30 10:55:26.716238 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.716157    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a66887-0b60-44fc-9e83-74679accddd5-openshift-service-ca\") pod \"64a66887-0b60-44fc-9e83-74679accddd5\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") "
Jul 30 10:55:26.716238 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.716223    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt8gh\" (UniqueName: \"kubernetes.io/projected/64a66887-0b60-44fc-9e83-74679accddd5-kube-api-access-pt8gh\") pod \"64a66887-0b60-44fc-9e83-74679accddd5\" (UID: \"64a66887-0b60-44fc-9e83-74679accddd5\") "
Jul 30 10:55:26.716523 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.716497    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a66887-0b60-44fc-9e83-74679accddd5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64a66887-0b60-44fc-9e83-74679accddd5" (UID: "64a66887-0b60-44fc-9e83-74679accddd5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:55:26.718359 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.718313    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a66887-0b60-44fc-9e83-74679accddd5-kube-api-access-pt8gh" (OuterVolumeSpecName: "kube-api-access-pt8gh") pod "64a66887-0b60-44fc-9e83-74679accddd5" (UID: "64a66887-0b60-44fc-9e83-74679accddd5"). InnerVolumeSpecName "kube-api-access-pt8gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:55:26.718602 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.718575    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64a66887-0b60-44fc-9e83-74679accddd5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64a66887-0b60-44fc-9e83-74679accddd5" (UID: "64a66887-0b60-44fc-9e83-74679accddd5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:55:26.722527 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.722501    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:55:26.817273 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s2tq\" (UniqueName: \"kubernetes.io/projected/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-kube-api-access-9s2tq\") pod \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\" (UID: \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\") "
Jul 30 10:55:26.817466 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817299    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-plugins-config-volume\") pod \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\" (UID: \"6e0ff321-8a29-410f-b0f9-86737fcd1e3d\") "
Jul 30 10:55:26.817466 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817327    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-plugins-config-volume\") pod \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\" (UID: \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\") "
Jul 30 10:55:26.817466 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk54z\" (UniqueName: \"kubernetes.io/projected/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-kube-api-access-bk54z\") pod \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\" (UID: \"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad\") "
Jul 30 10:55:26.817710 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817688    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a66887-0b60-44fc-9e83-74679accddd5-openshift-service-ca\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:26.817786 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817703    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e0ff321-8a29-410f-b0f9-86737fcd1e3d" (UID: "6e0ff321-8a29-410f-b0f9-86737fcd1e3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:55:26.817786 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817716    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt8gh\" (UniqueName: \"kubernetes.io/projected/64a66887-0b60-44fc-9e83-74679accddd5-kube-api-access-pt8gh\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:26.817786 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817758    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a66887-0b60-44fc-9e83-74679accddd5-maas-api-tls\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:26.817786 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.817758    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad" (UID: "f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:55:26.819551 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.819529    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-kube-api-access-9s2tq" (OuterVolumeSpecName: "kube-api-access-9s2tq") pod "6e0ff321-8a29-410f-b0f9-86737fcd1e3d" (UID: "6e0ff321-8a29-410f-b0f9-86737fcd1e3d"). InnerVolumeSpecName "kube-api-access-9s2tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:55:26.819601 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.819554    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-kube-api-access-bk54z" (OuterVolumeSpecName: "kube-api-access-bk54z") pod "f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad" (UID: "f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad"). InnerVolumeSpecName "kube-api-access-bk54z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:55:26.918553 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.918458    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s2tq\" (UniqueName: \"kubernetes.io/projected/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-kube-api-access-9s2tq\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:26.918553 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.918491    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e0ff321-8a29-410f-b0f9-86737fcd1e3d-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:26.918553 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.918504    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-plugins-config-volume\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:26.918553 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:26.918515    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk54z\" (UniqueName: \"kubernetes.io/projected/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad-kube-api-access-bk54z\") on node \"ip-10-0-131-179.ec2.internal\" DevicePath \"\""
Jul 30 10:55:27.413098 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.413064    2581 generic.go:356] "Generic (PLEG): container finished" podID="f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad" containerID="80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6" exitCode=0
Jul 30 10:55:27.413588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.413110    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"
Jul 30 10:55:27.413588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.413164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b" event={"ID":"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad","Type":"ContainerDied","Data":"80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6"}
Jul 30 10:55:27.413588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.413227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b" event={"ID":"f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad","Type":"ContainerDied","Data":"70bc6cf9b7dfcb764c38727ab8bbadd657a073444b168ad2061d81cccd7e7a7a"}
Jul 30 10:55:27.413588 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.413261    2581 scope.go:117] "RemoveContainer" containerID="80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6"
Jul 30 10:55:27.414674 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.414657    2581 generic.go:356] "Generic (PLEG): container finished" podID="64a66887-0b60-44fc-9e83-74679accddd5" containerID="53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555" exitCode=0
Jul 30 10:55:27.414755 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.414686    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n" event={"ID":"64a66887-0b60-44fc-9e83-74679accddd5","Type":"ContainerDied","Data":"53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555"}
Jul 30 10:55:27.414755 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.414707    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"
Jul 30 10:55:27.414755 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.414741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n" event={"ID":"64a66887-0b60-44fc-9e83-74679accddd5","Type":"ContainerDied","Data":"a57bc61e4ab87874e8b222b1c6e1611f5417bc86c58e5cd0f83b4255f5a4044c"}
Jul 30 10:55:27.416187 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.416164    2581 generic.go:356] "Generic (PLEG): container finished" podID="6e0ff321-8a29-410f-b0f9-86737fcd1e3d" containerID="b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb" exitCode=0
Jul 30 10:55:27.416341 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.416196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k" event={"ID":"6e0ff321-8a29-410f-b0f9-86737fcd1e3d","Type":"ContainerDied","Data":"b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb"}
Jul 30 10:55:27.416341 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.416227    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"
Jul 30 10:55:27.416341 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.416233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k" event={"ID":"6e0ff321-8a29-410f-b0f9-86737fcd1e3d","Type":"ContainerDied","Data":"c8c718196ae2219ad99fd57be0c84b176b919d0abb2f107c4ff9024d15d99c3a"}
Jul 30 10:55:27.424210 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.424183    2581 scope.go:117] "RemoveContainer" containerID="80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6"
Jul 30 10:55:27.424521 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:55:27.424494    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6\": container with ID starting with 80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6 not found: ID does not exist" containerID="80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6"
Jul 30 10:55:27.424634 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.424534    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6"} err="failed to get container status \"80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6\": rpc error: code = NotFound desc = could not find container \"80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6\": container with ID starting with 80dc0ebdf73c629a215c619440befdbcd93d4a2eef87348bfea175c2d07eb9b6 not found: ID does not exist"
Jul 30 10:55:27.424634 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.424556    2581 scope.go:117] "RemoveContainer" containerID="53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555"
Jul 30 10:55:27.433073 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.433051    2581 scope.go:117] "RemoveContainer" containerID="53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555"
Jul 30 10:55:27.433377 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:55:27.433357    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555\": container with ID starting with 53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555 not found: ID does not exist" containerID="53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555"
Jul 30 10:55:27.433458 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.433384    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555"} err="failed to get container status \"53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555\": rpc error: code = NotFound desc = could not find container \"53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555\": container with ID starting with 53e5675723e795574f361c5da855215a51944b59d07b283c30f513794206f555 not found: ID does not exist"
Jul 30 10:55:27.433458 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.433402    2581 scope.go:117] "RemoveContainer" containerID="b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb"
Jul 30 10:55:27.436530 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.436510    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"]
Jul 30 10:55:27.440543 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.440516    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b"]
Jul 30 10:55:27.443200 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.443181    2581 scope.go:117] "RemoveContainer" containerID="b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb"
Jul 30 10:55:27.443530 ip-10-0-131-179 kubenswrapper[2581]: E0730 10:55:27.443509    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb\": container with ID starting with b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb not found: ID does not exist" containerID="b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb"
Jul 30 10:55:27.443577 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.443538    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb"} err="failed to get container status \"b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb\": rpc error: code = NotFound desc = could not find container \"b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb\": container with ID starting with b3705ffde4946aca6aed9bb49845b3d1e2ccc56fe525f636ae31a515e0fc59fb not found: ID does not exist"
Jul 30 10:55:27.451567 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.451536    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"]
Jul 30 10:55:27.454947 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.454920    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bdf164-85fb7b54f-cjf8n"]
Jul 30 10:55:27.464281 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.464246    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"]
Jul 30 10:55:27.469983 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.469953    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k"]
Jul 30 10:55:27.485752 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:27.485723    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:28.228648 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:28.228603    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a66887-0b60-44fc-9e83-74679accddd5" path="/var/lib/kubelet/pods/64a66887-0b60-44fc-9e83-74679accddd5/volumes"
Jul 30 10:55:28.229102 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:28.229081    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e0ff321-8a29-410f-b0f9-86737fcd1e3d" path="/var/lib/kubelet/pods/6e0ff321-8a29-410f-b0f9-86737fcd1e3d/volumes"
Jul 30 10:55:28.229452 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:28.229435    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb2272d-2094-4828-9d21-c4a4ca4e0c36" path="/var/lib/kubelet/pods/dfb2272d-2094-4828-9d21-c4a4ca4e0c36/volumes"
Jul 30 10:55:28.229796 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:28.229780    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad" path="/var/lib/kubelet/pods/f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad/volumes"
Jul 30 10:55:32.221478 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:32.221441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:33.442465 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:33.442426    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:34.068894 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:34.068855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:34.140587 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:34.140549    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:35.078328 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:35.078295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:40.192030 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:40.191999    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54646dcfcb-vbhqz_89aac36b-c888-4941-83c9-9d956540051b/manager/0.log"
Jul 30 10:55:40.308444 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:40.308420    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-crl4t_7cc0ca30-febd-45eb-a72e-4d65f11d59bb/server/0.log"
Jul 30 10:55:40.532719 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:40.532642    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74749788-ks8kn_32624ede-ce31-48ec-a2fa-c22093f4ea55/copy-manifests/0.log"
Jul 30 10:55:40.545929 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:40.545899    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74749788-ks8kn_32624ede-ce31-48ec-a2fa-c22093f4ea55/manager/0.log"
Jul 30 10:55:41.144369 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:41.144341    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-56dbcbcdbf-c8shw_37f0403f-2dae-4faa-9df9-a81c5a77f1b8/maas-api/0.log"
Jul 30 10:55:41.271077 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:41.271043    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756775-qb4jx_700481e0-679d-44ce-a4c3-ac9d5970d530/cleanup/0.log"
Jul 30 10:55:41.390843 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:41.390796    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756790-hfztd_f036f477-a4fe-483e-b1b6-18e3775e6382/cleanup/0.log"
Jul 30 10:55:41.620690 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:41.620660    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-b4wbd_f527b3bd-f7b9-413f-9445-b1f686d091b5/postgres/0.log"
Jul 30 10:55:42.883891 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:42.883857    2581 scope.go:117] "RemoveContainer" containerID="d6cfdf17f413baab8af759ff401050a5b5d11f807a459629d19104371e23ff64"
Jul 30 10:55:43.330918 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:43.330887    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-c9zns_3529f17f-8456-45c0-9b9d-4050d1ea6ac8/kuadrant-console-plugin/0.log"
Jul 30 10:55:44.431700 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:44.431675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d4fcfdb4d-krg2z_3aae51f5-a86d-4610-8c6f-bccc340545ce/kube-auth-proxy/0.log"
Jul 30 10:55:45.391318 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:45.391291    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5h7nh_78da463a-d05d-44c7-b911-3599a1e099d6/main/0.log"
Jul 30 10:55:45.620745 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:45.620714    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qhtqk_ad2ca8cc-86b5-4530-8e5b-e0d84f03fb44/main/0.log"
Jul 30 10:55:45.737128 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:45.737051    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9n7ck_8c8efd57-bb39-48bc-8feb-cb4ec30531c5/main/0.log"
Jul 30 10:55:51.574998 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.574966    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-94b2d/must-gather-sd5cb"]
Jul 30 10:55:51.575370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575320    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a66887-0b60-44fc-9e83-74679accddd5" containerName="maas-api"
Jul 30 10:55:51.575370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575331    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a66887-0b60-44fc-9e83-74679accddd5" containerName="maas-api"
Jul 30 10:55:51.575370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575342    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e0ff321-8a29-410f-b0f9-86737fcd1e3d" containerName="payload-pre-processing"
Jul 30 10:55:51.575370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575348    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e0ff321-8a29-410f-b0f9-86737fcd1e3d" containerName="payload-pre-processing"
Jul 30 10:55:51.575370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575358    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad" containerName="payload-processing"
Jul 30 10:55:51.575370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575364    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad" containerName="payload-processing"
Jul 30 10:55:51.575370 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575371    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb2272d-2094-4828-9d21-c4a4ca4e0c36" containerName="revoke-keys"
Jul 30 10:55:51.575642 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575376    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb2272d-2094-4828-9d21-c4a4ca4e0c36" containerName="revoke-keys"
Jul 30 10:55:51.575642 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575433    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a66887-0b60-44fc-9e83-74679accddd5" containerName="maas-api"
Jul 30 10:55:51.575642 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575443    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e0ff321-8a29-410f-b0f9-86737fcd1e3d" containerName="payload-pre-processing"
Jul 30 10:55:51.575642 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575449    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb2272d-2094-4828-9d21-c4a4ca4e0c36" containerName="revoke-keys"
Jul 30 10:55:51.575642 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.575457    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93cf2f3-6b98-4b7e-9be9-e7f020e8cfad" containerName="payload-processing"
Jul 30 10:55:51.580240 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.580220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-94b2d/must-gather-sd5cb"
Jul 30 10:55:51.582542 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.582519    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-94b2d\"/\"default-dockercfg-khmgf\""
Jul 30 10:55:51.583217 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.583194    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-94b2d\"/\"kube-root-ca.crt\""
Jul 30 10:55:51.583725 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.583704    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-94b2d\"/\"openshift-service-ca.crt\""
Jul 30 10:55:51.593660 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.593637    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-94b2d/must-gather-sd5cb"]
Jul 30 10:55:51.607418 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.607393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:51.709805 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.709768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log" limit=1024
Jul 30 10:55:51.738305 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.738272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4ts5\" (UniqueName: \"kubernetes.io/projected/fee77283-68f4-4a23-a3b2-22835d8e979f-kube-api-access-b4ts5\") pod \"must-gather-sd5cb\" (UID: \"fee77283-68f4-4a23-a3b2-22835d8e979f\") " pod="openshift-must-gather-94b2d/must-gather-sd5cb"
Jul 30 10:55:51.738489 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.738404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fee77283-68f4-4a23-a3b2-22835d8e979f-must-gather-output\") pod \"must-gather-sd5cb\" (UID: \"fee77283-68f4-4a23-a3b2-22835d8e979f\") " pod="openshift-must-gather-94b2d/must-gather-sd5cb"
Jul 30 10:55:51.839676 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.839582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fee77283-68f4-4a23-a3b2-22835d8e979f-must-gather-output\") pod \"must-gather-sd5cb\" (UID: \"fee77283-68f4-4a23-a3b2-22835d8e979f\") " pod="openshift-must-gather-94b2d/must-gather-sd5cb"
Jul 30 10:55:51.839676 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.839632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4ts5\" (UniqueName: \"kubernetes.io/projected/fee77283-68f4-4a23-a3b2-22835d8e979f-kube-api-access-b4ts5\") pod \"must-gather-sd5cb\" (UID: \"fee77283-68f4-4a23-a3b2-22835d8e979f\") " pod="openshift-must-gather-94b2d/must-gather-sd5cb"
Jul 30 10:55:51.839977 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.839955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fee77283-68f4-4a23-a3b2-22835d8e979f-must-gather-output\") pod \"must-gather-sd5cb\" (UID: \"fee77283-68f4-4a23-a3b2-22835d8e979f\") " pod="openshift-must-gather-94b2d/must-gather-sd5cb"
Jul 30 10:55:51.847829 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.847795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4ts5\" (UniqueName: \"kubernetes.io/projected/fee77283-68f4-4a23-a3b2-22835d8e979f-kube-api-access-b4ts5\") pod \"must-gather-sd5cb\" (UID: \"fee77283-68f4-4a23-a3b2-22835d8e979f\") " pod="openshift-must-gather-94b2d/must-gather-sd5cb"
Jul 30 10:55:51.889878 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:51.889846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-94b2d/must-gather-sd5cb"
Jul 30 10:55:52.059019 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:52.058996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-94b2d/must-gather-sd5cb"]
Jul 30 10:55:52.061129 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:55:52.061103    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfee77283_68f4_4a23_a3b2_22835d8e979f.slice/crio-4bbf2c7ae8b0aa1cce6933f12f2065639e0ed93071b15f9efb54b54ec83185dd WatchSource:0}: Error finding container 4bbf2c7ae8b0aa1cce6933f12f2065639e0ed93071b15f9efb54b54ec83185dd: Status 404 returned error can't find the container with id 4bbf2c7ae8b0aa1cce6933f12f2065639e0ed93071b15f9efb54b54ec83185dd
Jul 30 10:55:52.062863 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:52.062848    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:55:52.540226 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:52.540195    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-94b2d/must-gather-sd5cb" event={"ID":"fee77283-68f4-4a23-a3b2-22835d8e979f","Type":"ContainerStarted","Data":"4bbf2c7ae8b0aa1cce6933f12f2065639e0ed93071b15f9efb54b54ec83185dd"}
Jul 30 10:55:55.558485 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:55.558431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-94b2d/must-gather-sd5cb" event={"ID":"fee77283-68f4-4a23-a3b2-22835d8e979f","Type":"ContainerStarted","Data":"bf5e12ae8cdff873c10f030023ed57cba69220a40f4c33ab297eee4b0223195b"}
Jul 30 10:55:55.558485 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:55.558492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-94b2d/must-gather-sd5cb" event={"ID":"fee77283-68f4-4a23-a3b2-22835d8e979f","Type":"ContainerStarted","Data":"2ac195e0642a6afa0482f2588af26a8e664b6e76571ca147bb859c28a64e2df1"}
Jul 30 10:55:55.576606 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:55.576545    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-94b2d/must-gather-sd5cb" podStartSLOduration=2.079906482 podStartE2EDuration="4.576525713s" totalImagesPullingTime="2.496619231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:55:55.57637552 +0000 UTC m=+3973.920438976" watchObservedRunningTime="2026-07-30 10:55:55.576525713 +0000 UTC m=+3973.920589170"
Jul 30 10:55:56.341127 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:56.341095    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lpltn_2e7c60fa-cb09-4408-9884-72da3cd0776c/global-pull-secret-syncer/0.log"
Jul 30 10:55:56.397143 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:56.397111    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-68zjd_c64c4728-534c-48f4-96f2-296c35c37661/konnectivity-agent/0.log"
Jul 30 10:55:56.554300 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:55:56.554269    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-179.ec2.internal_e7b463b0db8cbb6cbf3303819f4fbf03/haproxy/0.log"
Jul 30 10:56:01.745330 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:01.745231    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-c9zns_3529f17f-8456-45c0-9b9d-4050d1ea6ac8/kuadrant-console-plugin/0.log"
Jul 30 10:56:03.833068 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:03.832992    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_975db069-8a4f-40ee-b749-877667c38633/alertmanager/0.log"
Jul 30 10:56:03.863154 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:03.861765    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_975db069-8a4f-40ee-b749-877667c38633/config-reloader/0.log"
Jul 30 10:56:03.897357 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:03.897222    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_975db069-8a4f-40ee-b749-877667c38633/kube-rbac-proxy-web/0.log"
Jul 30 10:56:03.938606 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:03.938579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_975db069-8a4f-40ee-b749-877667c38633/kube-rbac-proxy/0.log"
Jul 30 10:56:03.967236 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:03.967198    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_975db069-8a4f-40ee-b749-877667c38633/kube-rbac-proxy-metric/0.log"
Jul 30 10:56:03.991090 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:03.991062    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_975db069-8a4f-40ee-b749-877667c38633/prom-label-proxy/0.log"
Jul 30 10:56:04.034606 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.034571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_975db069-8a4f-40ee-b749-877667c38633/init-config-reloader/0.log"
Jul 30 10:56:04.111480 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.111388    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mb7bj_3b847446-5e4d-46dd-a09f-21c2a63b4eae/kube-state-metrics/0.log"
Jul 30 10:56:04.133064 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.133033    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mb7bj_3b847446-5e4d-46dd-a09f-21c2a63b4eae/kube-rbac-proxy-main/0.log"
Jul 30 10:56:04.155506 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.155427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mb7bj_3b847446-5e4d-46dd-a09f-21c2a63b4eae/kube-rbac-proxy-self/0.log"
Jul 30 10:56:04.344119 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.344086    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss4c2_1ee094a2-2252-49ce-b61f-fd8945f8ba21/node-exporter/0.log"
Jul 30 10:56:04.367014 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.366981    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss4c2_1ee094a2-2252-49ce-b61f-fd8945f8ba21/kube-rbac-proxy/0.log"
Jul 30 10:56:04.392212 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.392181    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss4c2_1ee094a2-2252-49ce-b61f-fd8945f8ba21/init-textfile/0.log"
Jul 30 10:56:04.597640 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.597609    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae18be4-3dbf-47c4-83c8-97293feec5ae/prometheus/0.log"
Jul 30 10:56:04.620162 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.620110    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae18be4-3dbf-47c4-83c8-97293feec5ae/config-reloader/0.log"
Jul 30 10:56:04.643400 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.643372    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae18be4-3dbf-47c4-83c8-97293feec5ae/thanos-sidecar/0.log"
Jul 30 10:56:04.666663 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.666634    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae18be4-3dbf-47c4-83c8-97293feec5ae/kube-rbac-proxy-web/0.log"
Jul 30 10:56:04.688604 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.688576    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae18be4-3dbf-47c4-83c8-97293feec5ae/kube-rbac-proxy/0.log"
Jul 30 10:56:04.713890 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.713849    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae18be4-3dbf-47c4-83c8-97293feec5ae/kube-rbac-proxy-thanos/0.log"
Jul 30 10:56:04.735765 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.735734    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cae18be4-3dbf-47c4-83c8-97293feec5ae/init-config-reloader/0.log"
Jul 30 10:56:04.765641 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.765607    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-47rlb_1ae5300b-c8ed-4133-8747-3d9c8aafebf2/prometheus-operator/0.log"
Jul 30 10:56:04.782495 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.782457    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-47rlb_1ae5300b-c8ed-4133-8747-3d9c8aafebf2/kube-rbac-proxy/0.log"
Jul 30 10:56:04.807454 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:04.807417    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-xp9p4_f0993c7e-24ba-45f2-8ac6-6972f972b198/prometheus-operator-admission-webhook/0.log"
Jul 30 10:56:06.712253 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.712212    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"]
Jul 30 10:56:06.720308 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.720268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.725700 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.725666    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"]
Jul 30 10:56:06.805245 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.805197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-proc\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.805443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.805282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgjpq\" (UniqueName: \"kubernetes.io/projected/45663ba9-a2e2-4120-aba0-db3425a6a0a5-kube-api-access-vgjpq\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.805443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.805302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-podres\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.805443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.805324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-lib-modules\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.805443 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.805356    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-sys\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906278 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-proc\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgjpq\" (UniqueName: \"kubernetes.io/projected/45663ba9-a2e2-4120-aba0-db3425a6a0a5-kube-api-access-vgjpq\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-podres\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-proc\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906471 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-lib-modules\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906734 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-sys\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906734 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-podres\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906734 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-sys\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.906734 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.906678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45663ba9-a2e2-4120-aba0-db3425a6a0a5-lib-modules\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:06.916362 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:06.916323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgjpq\" (UniqueName: \"kubernetes.io/projected/45663ba9-a2e2-4120-aba0-db3425a6a0a5-kube-api-access-vgjpq\") pod \"perf-node-gather-daemonset-rjw9z\" (UID: \"45663ba9-a2e2-4120-aba0-db3425a6a0a5\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:07.034454 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:07.034361    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:07.229598 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:07.229310    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"]
Jul 30 10:56:07.236953 ip-10-0-131-179 kubenswrapper[2581]: W0730 10:56:07.235324    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod45663ba9_a2e2_4120_aba0_db3425a6a0a5.slice/crio-a245325293f2a676f1f33f9c8e1f15914252c312fd3bd39ed99c0dec4784929f WatchSource:0}: Error finding container a245325293f2a676f1f33f9c8e1f15914252c312fd3bd39ed99c0dec4784929f: Status 404 returned error can't find the container with id a245325293f2a676f1f33f9c8e1f15914252c312fd3bd39ed99c0dec4784929f
Jul 30 10:56:07.609812 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:07.609736    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-rjm76_679015b0-4770-47c3-b5aa-6c4a8f4a596d/download-server/0.log"
Jul 30 10:56:07.654838 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:07.654571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z" event={"ID":"45663ba9-a2e2-4120-aba0-db3425a6a0a5","Type":"ContainerStarted","Data":"3eff031d4666dbf2c7800982fab145439ef9026e6a85d422f4416463c4f9ed1e"}
Jul 30 10:56:07.654838 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:07.654673    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z" event={"ID":"45663ba9-a2e2-4120-aba0-db3425a6a0a5","Type":"ContainerStarted","Data":"a245325293f2a676f1f33f9c8e1f15914252c312fd3bd39ed99c0dec4784929f"}
Jul 30 10:56:07.655116 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:07.654968    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:07.672353 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:07.672289    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z" podStartSLOduration=1.672269797 podStartE2EDuration="1.672269797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:56:07.669696602 +0000 UTC m=+3986.013760060" watchObservedRunningTime="2026-07-30 10:56:07.672269797 +0000 UTC m=+3986.016333253"
Jul 30 10:56:09.350211 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:09.350181    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g45fw_bca1e841-e31d-4be7-9548-4a20562bdc69/dns/0.log"
Jul 30 10:56:09.370306 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:09.370281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g45fw_bca1e841-e31d-4be7-9548-4a20562bdc69/kube-rbac-proxy/0.log"
Jul 30 10:56:09.392739 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:09.392706    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bv2lv_55368fb6-e950-4d09-9283-6c53a4946933/dns-node-resolver/0.log"
Jul 30 10:56:10.021000 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:10.020974    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8fhn2_f9439732-bedf-4e4f-ada8-150cf78abe3d/node-ca/0.log"
Jul 30 10:56:11.249065 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:11.249035    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d4fcfdb4d-krg2z_3aae51f5-a86d-4610-8c6f-bccc340545ce/kube-auth-proxy/0.log"
Jul 30 10:56:12.246232 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:12.246169    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sff5w_d11925bb-9b71-4172-94e8-7ab883f3fd8a/serve-healthcheck-canary/0.log"
Jul 30 10:56:12.772894 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:12.772866    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-777xr_f02d76a2-3fee-4543-973b-68cf39d7d30d/kube-rbac-proxy/0.log"
Jul 30 10:56:12.792790 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:12.792761    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-777xr_f02d76a2-3fee-4543-973b-68cf39d7d30d/exporter/0.log"
Jul 30 10:56:12.812015 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:12.811991    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-777xr_f02d76a2-3fee-4543-973b-68cf39d7d30d/extractor/0.log"
Jul 30 10:56:13.674150 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:13.674116    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-rjw9z"
Jul 30 10:56:15.644605 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:15.643755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54646dcfcb-vbhqz_89aac36b-c888-4941-83c9-9d956540051b/manager/0.log"
Jul 30 10:56:15.666868 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:15.666836    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-crl4t_7cc0ca30-febd-45eb-a72e-4d65f11d59bb/server/0.log"
Jul 30 10:56:15.863634 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:15.863594    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74749788-ks8kn_32624ede-ce31-48ec-a2fa-c22093f4ea55/manager/0.log"
Jul 30 10:56:15.882785 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:15.882754    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74749788-ks8kn_32624ede-ce31-48ec-a2fa-c22093f4ea55/copy-manifests/0.log"
Jul 30 10:56:17.368914 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:17.368877    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75b6964665-tvchg_642f24b8-bffe-4bba-a4cd-d4a08d19114b/manager/0.log"
Jul 30 10:56:17.394612 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:17.394578    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-n2fz2_6b4cb7d0-888e-4cb8-988b-d2e2e14df29f/openshift-lws-operator/0.log"
Jul 30 10:56:17.670877 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:17.670760    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d4fcfdb4d-krg2z_3aae51f5-a86d-4610-8c6f-bccc340545ce/kube-auth-proxy/0.log"
Jul 30 10:56:19.335993 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:19.335947    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d4fcfdb4d-krg2z_3aae51f5-a86d-4610-8c6f-bccc340545ce/kube-auth-proxy/0.log"
Jul 30 10:56:23.989885 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:23.989786    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6prkf_f0c02eae-446c-47fc-924f-6a7e61b4b34a/kube-multus-additional-cni-plugins/0.log"
Jul 30 10:56:24.011590 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:24.011561    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6prkf_f0c02eae-446c-47fc-924f-6a7e61b4b34a/egress-router-binary-copy/0.log"
Jul 30 10:56:24.031632 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:24.031607    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6prkf_f0c02eae-446c-47fc-924f-6a7e61b4b34a/cni-plugins/0.log"
Jul 30 10:56:24.053537 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:24.053506    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6prkf_f0c02eae-446c-47fc-924f-6a7e61b4b34a/bond-cni-plugin/0.log"
Jul 30 10:56:24.073423 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:24.073386    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6prkf_f0c02eae-446c-47fc-924f-6a7e61b4b34a/routeoverride-cni/0.log"
Jul 30 10:56:24.096517 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:24.096481    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6prkf_f0c02eae-446c-47fc-924f-6a7e61b4b34a/whereabouts-cni-bincopy/0.log"
Jul 30 10:56:24.117933 ip-10-0-131-179 kubenswrapper[2581]: I0730 10:56:24.117900    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6prkf_f0c02eae-446c-47fc-924f-6a7e61b4b34a/whereabouts-cni/0.log"