Sep 09 16:06:35.759721 ip-10-0-137-148 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 16:06:35.759737 ip-10-0-137-148 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 16:06:35.759747 ip-10-0-137-148 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 16:06:35.759958 ip-10-0-137-148 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 16:06:45.952770 ip-10-0-137-148 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 16:06:45.952787 ip-10-0-137-148 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ea8dd884d19c492bbf868cfb5c38e0be --
Sep 09 16:08:22.123044 ip-10-0-137-148 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 16:08:22.543604 ip-10-0-137-148 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 16:08:22.543604 ip-10-0-137-148 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 16:08:22.543604 ip-10-0-137-148 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 16:08:22.543604 ip-10-0-137-148 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 16:08:22.543604 ip-10-0-137-148 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 16:08:22.544637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.544551    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 16:08:22.549205 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549183    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:08:22.549205 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549199    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:08:22.549205 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549206    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:08:22.549205 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549211    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549215    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549218    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549221    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549225    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549228    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549231    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549234    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549237    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549239    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549242    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549245    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549247    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549250    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549253    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549256    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549258    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549261    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549263    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549266    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:08:22.549403 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549269    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549271    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549274    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549277    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549280    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549283    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549285    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549288    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549291    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549293    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549297    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549300    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549302    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549304    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549308    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549311    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549314    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549317    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549321    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549324    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:08:22.549902 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549327    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549329    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549332    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549335    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549338    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549341    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549344    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549348    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549351    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549355    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549358    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549361    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549363    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549366    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549368    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549371    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549373    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549377    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549381    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:08:22.550400 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549385    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549388    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549391    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549394    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549397    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549400    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549403    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549407    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549410    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549413    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549417    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549419    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549422    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549425    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549428    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549431    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549433    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549436    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549438    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549441    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:08:22.550890 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549443    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549447    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549450    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549452    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549455    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549458    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549460    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549463    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549465    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549468    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549470    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549473    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549475    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549478    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549480    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549483    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.549485    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550214    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550221    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550226    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:08:22.551399 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550229    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550231    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550234    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550236    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550239    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550242    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550244    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550247    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550249    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550252    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550255    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550258    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550260    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550263    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550266    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550269    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550272    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550274    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550277    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550279    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:08:22.551905 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550282    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550284    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550288    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550290    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550293    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550295    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550298    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550302    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550307    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550310    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550313    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550316    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550319    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550321    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550324    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550327    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550330    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550333    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550335    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550338    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:08:22.552444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550340    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550343    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550345    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550348    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550350    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550353    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550355    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550358    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550361    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550363    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550366    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550369    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550372    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550374    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550376    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550379    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550381    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550384    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550386    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550389    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:08:22.552953 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550392    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550396    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550399    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550402    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550405    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550407    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550410    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550413    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550416    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550418    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550421    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550423    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550426    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550428    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550432    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550435    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550438    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550441    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550444    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:08:22.553445 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550447    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550450    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550452    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550456    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550458    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550463    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550466    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550469    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550471    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550474    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550477    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550479    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550482    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550484    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550487    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550490    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550492    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550889    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550894    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550897    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:08:22.554006 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550900    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550902    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550905    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550908    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550910    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550913    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550915    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550918    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550922    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550926    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550930    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550933    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550936    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550939    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550942    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550944    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550947    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550951    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:08:22.554525 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550953    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550956    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550958    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550961    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550963    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550966    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550968    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550971    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550974    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550976    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550981    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550984    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550987    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550990    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550992    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550995    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.550997    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551000    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551003    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:08:22.554989 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551005    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551007    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551010    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551013    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551015    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551018    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551020    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551023    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551026    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551029    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551032    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551034    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551038    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551042    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551045    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551047    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551050    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551053    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551055    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:08:22.555452 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551058    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551061    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551063    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551066    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551069    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551071    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551074    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551076    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551079    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551081    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551084    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551086    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551089    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551091    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551094    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551096    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551099    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551102    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551105    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551107    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551110    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:08:22.555930 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551112    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551115    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551117    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551120    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551124    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551127    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551130    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551132    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551135    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551137    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551140    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551142    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551145    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551147    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551150    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551152    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551154    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551157    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551159    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551240    2567 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551281    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 16:08:22.556441 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551288    2567 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551292    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551297    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551300    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551304    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551309    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551312    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551315    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551318    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551322    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551325    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551328    2567 flags.go:64] FLAG: --cgroup-root=""
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551331    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551334    2567 flags.go:64] FLAG: --client-ca-file=""
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551338    2567 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551342    2567 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551348    2567 flags.go:64] FLAG: --cluster-domain=""
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551351    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551354    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551357    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551361    2567 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551365    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551368    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 16:08:22.556963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551371    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551374    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551377    2567 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551380    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551383    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551386    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551389    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551393    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551396    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551399    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551402    2567 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551406    2567 flags.go:64] FLAG: --enable-server="true"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551409    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551414    2567 flags.go:64] FLAG: --event-burst="100"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551417    2567 flags.go:64] FLAG: --event-qps="50"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551420    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551423    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551426    2567 flags.go:64] FLAG: --eviction-hard=""
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551430    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551433    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551436    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551439    2567 flags.go:64] FLAG: --eviction-soft=""
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551442    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551445    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551449    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 16:08:22.557573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551452    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551455    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551458    2567 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551460    2567 flags.go:64] FLAG: --feature-gates=""
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551464    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551468    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551471    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551474    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551477    2567 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551480    2567 flags.go:64] FLAG: --help="false"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551483    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551486    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551488    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551491    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551494    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551498    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551501    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551503    2567 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551508    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551511    2567 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551513    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551517    2567 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551519    2567 flags.go:64] FLAG: --kube-reserved=""
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551522    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 16:08:22.558242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551525    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551528    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551531    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551534    2567 flags.go:64] FLAG: --lock-file=""
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551536    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551548    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551552    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551558    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551561    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551564    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551567    2567 flags.go:64] FLAG: --logging-format="text"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551570    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551574    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551576    2567 flags.go:64] FLAG: --manifest-url=""
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551579    2567 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551584    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551587    2567 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551591    2567 flags.go:64] FLAG: --max-pods="110"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551594    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551596    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551599    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551602    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551605    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551608    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551611    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 16:08:22.558858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551618    2567 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551623    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551626    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551629    2567 flags.go:64] FLAG: --pod-cidr=""
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551632    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551638    2567 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551640    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551644    2567 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551647    2567 flags.go:64] FLAG: --port="10250"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551650    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551653    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-091a62a7bedd3559d"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551656    2567 flags.go:64] FLAG: --qos-reserved=""
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551659    2567 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551662    2567 flags.go:64] FLAG: --register-node="true"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551665    2567 flags.go:64] FLAG: --register-with-taints=""
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551669    2567 flags.go:64] FLAG: --registry-burst="10"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551673    2567 flags.go:64] FLAG: --registry-qps="5"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551676    2567 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551679    2567 flags.go:64] FLAG: --reserved-memory=""
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551683    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551686    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551689    2567 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551692    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551695    2567 flags.go:64] FLAG: --runonce="false"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551698    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 16:08:22.559485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551701    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551703    2567 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551706    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551709    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551712    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551715    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551718    2567 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551720    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551724    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551727    2567 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551730    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551733    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551736    2567 flags.go:64] FLAG: --system-cgroups=""
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551738    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551744    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551746    2567 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551749    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551754    2567 flags.go:64] FLAG: --tls-min-version=""
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551756    2567 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551759    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551762    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551765    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551778    2567 flags.go:64] FLAG: --v="2"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551783    2567 flags.go:64] FLAG: --version="false"
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551787    2567 flags.go:64] FLAG: --vmodule=""
Sep 09 16:08:22.560125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551791    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.551794    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551909    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551912    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551916    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551920    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551924    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551927    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551930    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551932    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551936    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551938    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551941    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551944    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551947    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551951    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551953    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551956    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551958    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:08:22.560737 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551962    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551964    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551967    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551969    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551971    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551975    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551979    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551981    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551984    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551989    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551991    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551994    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.551997    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552000    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552002    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552005    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552007    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552010    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552012    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:08:22.561282 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552015    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552017    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552020    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552022    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552026    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552028    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552031    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552034    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552037    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552040    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552043    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552045    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552048    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552050    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552054    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552057    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552060    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552063    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552065    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552068    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:08:22.561745 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552070    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552073    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552076    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552079    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552082    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552084    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552086    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552089    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552092    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552095    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552097    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552100    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552102    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552105    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552107    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552110    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552112    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552115    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552118    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552120    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:08:22.562260 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552122    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552126    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552129    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552132    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552134    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552137    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552139    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552142    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552144    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552147    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552149    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552151    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552154    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552156    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552162    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552164    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552167    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552181    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552183    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552186    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:08:22.562758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552189    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552192    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.552195    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.552942    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.560719    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.560733    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.560748    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.560754    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560824    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560829    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560832    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560836    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560839    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560841    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:08:22.563268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560844    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560848    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560852    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560855    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560858    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560860    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560863    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560866    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560869    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560871    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560874    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560876    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560879    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560882    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560885    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560889    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560892    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560895    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560899    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:08:22.563616 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560902    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560905    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560908    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560911    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560914    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560916    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560919    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560922    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560924    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560927    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560930    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560932    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560935    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560937    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560939    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560942    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560945    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560947    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560950    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560952    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:08:22.564099 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560955    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560957    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560960    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560962    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560965    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560967    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560970    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560972    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560975    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560978    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560980    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560983    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560985    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560988    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560991    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560994    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560996    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.560999    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561002    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561004    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:08:22.564622 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561007    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561009    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561012    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561014    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561016    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561019    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561022    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561025    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561027    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561029    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561032    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561034    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561037    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561041    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561044    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561046    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561049    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561052    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561054    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561057    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:08:22.565132 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561060    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561062    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561065    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561067    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561069    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561072    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561075    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561078    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561081    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561083    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561086    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561089    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561091    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561094    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.561098    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 16:08:22.565624 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561205    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561209    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561212    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561216    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561218    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561221    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561225    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561228    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561231    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561234    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561237    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561239    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561242    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561245    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561247    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561250    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561252    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561255    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561257    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:08:22.566019 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561261    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561264    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561267    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561270    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561274    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561277    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561280    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561283    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561286    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561289    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561291    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561294    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561297    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561300    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561302    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561305    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561307    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561310    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561313    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:08:22.566478 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561315    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561318    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561321    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561323    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561326    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561328    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561331    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561334    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561336    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561339    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561342    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561344    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561347    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561350    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561352    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561355    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561357    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561360    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561364    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561367    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:08:22.566961 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561369    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561372    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561374    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561377    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561379    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561382    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561384    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561387    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561389    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561392    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561396    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561399    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561402    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561405    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561408    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561410    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561413    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561416    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561418    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561421    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:08:22.567444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561424    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561426    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561429    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561431    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561434    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561437    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561439    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561442    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561444    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561447    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561450    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561453    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561455    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561458    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561460    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561463    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561465    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561468    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561470    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:08:22.567937 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561474    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:08:22.568392 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:22.561477    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:08:22.568392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.561482    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 16:08:22.568392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.561592    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 16:08:22.568392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.565185    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 16:08:22.568392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.566266    2567 server.go:1019] "Starting client certificate rotation"
Sep 09 16:08:22.568392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.566358    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 16:08:22.568392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.566417    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 16:08:22.569873 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.569782    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 16:08:22.571060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.571041    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 16:08:22.581530 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.581508    2567 log.go:25] "Validated CRI v1 runtime API"
Sep 09 16:08:22.586674 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.586656    2567 log.go:25] "Validated CRI v1 image API"
Sep 09 16:08:22.587500 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.587477    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 16:08:22.591214 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.591194    2567 fs.go:135] Filesystem UUIDs: map[5448ad77-7825-44bc-a33f-5cf60f3fb857:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d8b07d5c-204f-42bc-a410-a0bf1e96da0c:/dev/nvme0n1p4]
Sep 09 16:08:22.591282 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.591213    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 16:08:22.597620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.597509    2567 manager.go:216] Machine: {Timestamp:2026-09-09 16:08:22.596048056 +0000 UTC m=+0.367139297 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099848 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c36843c6b5e30f0e86ca514d3da24 SystemUUID:ec2c3684-3c6b-5e30-f0e8-6ca514d3da24 BootID:ea8dd884-d19c-492b-bf86-8cfb5c38e0be Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:60:05:83:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:60:05:83:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:0e:4b:50:9f:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 16:08:22.597620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.597619    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 16:08:22.597744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.597732    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 16:08:22.598669 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.598653    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 16:08:22.601105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.601081    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 16:08:22.601241 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.601107    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-148.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 16:08:22.602738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.602726    2567 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 16:08:22.602781 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.602739    2567 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 16:08:22.602781 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.602748    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 16:08:22.603623 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.603612    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 16:08:22.604835 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.604825    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 16:08:22.609478 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.609467    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 16:08:22.609589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.609579    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 16:08:22.609632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.609609    2567 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 16:08:22.609632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.609619    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 16:08:22.609698 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.609634    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 16:08:22.609698 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.609643    2567 kubelet.go:398] "Adding apiserver pod source"
Sep 09 16:08:22.609698 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.609650    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 16:08:22.610011 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.610001    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 16:08:22.610064 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.610020    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 16:08:22.613415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.613400    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 16:08:22.616480 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.616465    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 16:08:22.616551 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.616496    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 16:08:22.617949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.617936    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 16:08:22.617949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.617952    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.617958    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.617966    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.617979    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.617987    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.618000    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.618006    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.618012    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.618017    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.618044    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 16:08:22.618076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.618051    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 16:08:22.619050 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.619039    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 16:08:22.619050 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.619049    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 16:08:22.622026 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.622002    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-148.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 16:08:22.622109 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.622027    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 16:08:22.622174 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.622139    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 16:08:22.623058 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.623046    2567 server.go:1268] "Started kubelet"
Sep 09 16:08:22.623184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.623141    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 16:08:22.623222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.623123    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 16:08:22.623284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.623272    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 16:08:22.623889 ip-10-0-137-148 systemd[1]: Started Kubernetes Kubelet.
Sep 09 16:08:22.629596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.629571    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 16:08:22.631003 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.630970    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 16:08:22.631449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.631382    2567 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 16:08:22.635347 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.635329    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 16:08:22.635432 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.635396    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 16:08:22.635752 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.635556    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:22.636158 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636134    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 16:08:22.636158 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636151    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 16:08:22.636286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636165    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 16:08:22.636286 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.635006    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-148.ec2.internal.18d3b2d478a3a4fc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-148.ec2.internal,UID:ip-10-0-137-148.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-148.ec2.internal,},FirstTimestamp:2026-09-09 16:08:22.623020284 +0000 UTC m=+0.394111521,LastTimestamp:2026-09-09 16:08:22.623020284 +0000 UTC m=+0.394111521,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-148.ec2.internal,}"
Sep 09 16:08:22.636286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636224    2567 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 16:08:22.636286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636233    2567 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 16:08:22.636741 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636727    2567 factory.go:153] Registering CRI-O factory
Sep 09 16:08:22.636821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636743    2567 factory.go:223] Registration of the crio container factory successfully
Sep 09 16:08:22.636821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636808    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 16:08:22.636821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636817    2567 factory.go:55] Registering systemd factory
Sep 09 16:08:22.636821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636823    2567 factory.go:223] Registration of the systemd container factory successfully
Sep 09 16:08:22.636969 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636835    2567 factory.go:103] Registering Raw factory
Sep 09 16:08:22.636969 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.636844    2567 manager.go:1196] Started watching for new ooms in manager
Sep 09 16:08:22.637228 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.637217    2567 manager.go:349] Starting recovery of all containers
Sep 09 16:08:22.641353 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.641166    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 16:08:22.641353 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.641282    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 16:08:22.648388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.648371    2567 manager.go:354] Recovery completed
Sep 09 16:08:22.648595 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.648573    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xh5km"
Sep 09 16:08:22.652522 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.652509    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:08:22.654448 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.654430    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:08:22.654547 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.654460    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:08:22.654547 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.654471    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:08:22.655431 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.655415    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 16:08:22.655431 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.655428    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 16:08:22.655557 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.655435    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:08:22.655557 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.655446    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 16:08:22.655841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.655827    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xh5km"
Sep 09 16:08:22.656212 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.656198    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:08:22.656281 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.656224    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:08:22.656281 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.656234    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:08:22.656603 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.656527    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-148.ec2.internal.18d3b2d47a832d39  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-148.ec2.internal,UID:ip-10-0-137-148.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-148.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-148.ec2.internal,},FirstTimestamp:2026-09-09 16:08:22.654446905 +0000 UTC m=+0.425538142,LastTimestamp:2026-09-09 16:08:22.654446905 +0000 UTC m=+0.425538142,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-148.ec2.internal,}"
Sep 09 16:08:22.657520 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.657504    2567 policy_none.go:49] "None policy: Start"
Sep 09 16:08:22.657520 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.657521    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 16:08:22.657648 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.657531    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 16:08:22.659450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.659438    2567 policy_none.go:47] "Start"
Sep 09 16:08:22.693468 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.693450    2567 manager.go:337] "Starting Device Plugin manager"
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.693491    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.693504    2567 server.go:87] "Starting device plugin registration server"
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.693759    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.693786    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.693953    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.694030    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.694044    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.694567    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 16:08:22.709447 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.694620    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:22.729138 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.729101    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 16:08:22.730341 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.730323    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 16:08:22.730439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.730367    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 16:08:22.730439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.730389    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 16:08:22.730439 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.730429    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 16:08:22.732629 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.732611    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:08:22.794666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.794536    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:08:22.795622 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.795595    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:08:22.795746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.795633    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:08:22.795746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.795651    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:08:22.795746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.795677    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.803099 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.803083    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.803192 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.803106    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-148.ec2.internal\": node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:22.826514 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.826490    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:22.830493 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.830473    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"]
Sep 09 16:08:22.830551 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.830541    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:08:22.832695 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.832678    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:08:22.832798 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.832706    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:08:22.832798 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.832720    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:08:22.835092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835079    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:08:22.835199 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835186    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.835240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835213    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:08:22.835926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835902    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:08:22.835926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835911    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:08:22.835926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835927    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:08:22.836089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835933    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:08:22.836089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835937    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:08:22.836089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.835944    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:08:22.838763 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.838749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.838828 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.838791    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:08:22.839725 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.839707    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:08:22.839815 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.839741    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:08:22.839815 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.839756    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:08:22.855455 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.855428    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-148.ec2.internal\" not found" node="ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.859546 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.859531    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-148.ec2.internal\" not found" node="ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.927443 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:22.927415    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:22.936716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.936693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.936803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.936719    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07650a7db62586f9e69be13fe56d6e10-config\") pod \"kube-apiserver-proxy-ip-10-0-137-148.ec2.internal\" (UID: \"07650a7db62586f9e69be13fe56d6e10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:22.936803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:22.936734    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.028064 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.027884    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:23.037184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.037160    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.037272 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.037188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.037272 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.037208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07650a7db62586f9e69be13fe56d6e10-config\") pod \"kube-apiserver-proxy-ip-10-0-137-148.ec2.internal\" (UID: \"07650a7db62586f9e69be13fe56d6e10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.037375 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.037315    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.037375 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.037329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07650a7db62586f9e69be13fe56d6e10-config\") pod \"kube-apiserver-proxy-ip-10-0-137-148.ec2.internal\" (UID: \"07650a7db62586f9e69be13fe56d6e10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.037449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.037388    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.128648 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.128621    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:23.158114 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.158089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.163105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.163072    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.229222 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.229184    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:23.329737 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.329697    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:23.430621 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.430530    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:23.535042 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.535000    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 16:08:23.538477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.538457    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:08:23.567412 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.567389    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 16:08:23.567824 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.567519    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 16:08:23.567824 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.567554    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 16:08:23.612126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.612087    2567 apiserver.go:52] "Watching apiserver"
Sep 09 16:08:23.630564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.630542    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 16:08:23.631612 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.631590    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vqsxq","kube-system/konnectivity-agent-42v8l","openshift-cluster-node-tuning-operator/tuned-wwg29","openshift-image-registry/node-ca-tvjw4","openshift-multus/multus-additional-cni-plugins-lgs8j","openshift-multus/multus-wmvg7","openshift-multus/network-metrics-daemon-4w9ps","openshift-ovn-kubernetes/ovnkube-node-gjswq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm","openshift-dns/node-resolver-mc4sp","openshift-network-diagnostics/network-check-target-qqgc8","openshift-network-operator/iptables-alerter-68mrd"]
Sep 09 16:08:23.634350 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.634328    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.634452 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.634394    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:23.635601 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.635568    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 16:08:23.635601 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.635584    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.636656 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.636641    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:23.638936 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.638913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.639159 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.639095    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 16:08:23.639461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.639439    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p5sjg\""
Sep 09 16:08:23.641529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.639736    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 16:08:23.641529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.639948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fcf4a3e9-eec4-49f1-82df-6590d505ae68-agent-certs\") pod \"konnectivity-agent-42v8l\" (UID: \"fcf4a3e9-eec4-49f1-82df-6590d505ae68\") " pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:23.641529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.640014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fcf4a3e9-eec4-49f1-82df-6590d505ae68-konnectivity-ca\") pod \"konnectivity-agent-42v8l\" (UID: \"fcf4a3e9-eec4-49f1-82df-6590d505ae68\") " pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:23.641529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.640104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19e81986-d11f-4538-8975-961f0a59681f-kubelet-config\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.641529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.640141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19e81986-d11f-4538-8975-961f0a59681f-dbus\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.641529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.640181    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.641529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.641037    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hxbbt\""
Sep 09 16:08:23.641529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.641081    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:08:23.642227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.642209    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 16:08:23.642744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.642727    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.644862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.644844    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 16:08:23.644991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.644975    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 16:08:23.645033 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.645014    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-997nh\""
Sep 09 16:08:23.645085 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.645042    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 16:08:23.645137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.645125    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.647192 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.647172    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 16:08:23.647281 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.647224    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 16:08:23.647381 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.647365    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.647533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.647517    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 16:08:23.647613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.647595    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 16:08:23.647666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.647642    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 16:08:23.647710 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.647703    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 16:08:23.647931 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.647916    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 16:08:23.648157 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.648143    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2l99j\""
Sep 09 16:08:23.649690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.649675    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 16:08:23.649804 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.649788    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:23.649886 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.649857    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:23.649949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.649894    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2gclv\""
Sep 09 16:08:23.651730 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.651713    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 16:08:23.652292 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.652278    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.654391 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.654375    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 16:08:23.654528 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.654505    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 16:08:23.654648 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.654631    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9f7xv\""
Sep 09 16:08:23.654697 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.654645    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 16:08:23.654746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.654728    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.654934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.654881    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 16:08:23.654934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.654899    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 16:08:23.655247 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.655233    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 16:08:23.656766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.656750    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 16:08:23.657196 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.657179    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 16:08:23.657288 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.657205    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 16:08:23.657288 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.657211    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sgk8s\""
Sep 09 16:08:23.657472 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.657458    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.660075 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.660059    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 16:08:23.660178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.660124    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 16:08:23.660246 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.660174    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 16:08:23.660452 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.660438    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:23.660539 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.660518    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:23.660587 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.660566    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gccmf\""
Sep 09 16:08:23.661672 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.661630    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 16:03:23 +0000 UTC" deadline="2028-04-05 18:41:57.151857587 +0000 UTC"
Sep 09 16:08:23.661719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.661672    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13778h33m33.490188656s"
Sep 09 16:08:23.662880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.662862    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"]
Sep 09 16:08:23.662935 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.662898    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"]
Sep 09 16:08:23.662935 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.662923    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.665305 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.665285    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 16:08:23.665481 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.665465    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7gmbr\""
Sep 09 16:08:23.665722 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.665706    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 16:08:23.665931 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.665916    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:08:23.680309 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.680288    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ln242"
Sep 09 16:08:23.686427 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.686385    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ln242"
Sep 09 16:08:23.737567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.737546    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 16:08:23.740954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.740931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw4rf\" (UniqueName: \"kubernetes.io/projected/f84998c4-126c-43fe-9312-5e9b21762fb1-kube-api-access-mw4rf\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.741054 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.740959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741054 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.740976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-log-socket\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741054 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.740994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.741054 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741013    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-device-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.741214 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f84998c4-126c-43fe-9312-5e9b21762fb1-cni-binary-copy\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.741214 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.741144    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:23.741214 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741189    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-k8s-cni-cncf-io\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.741313 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.741248    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret podName:19e81986-d11f-4538-8975-961f0a59681f nodeName:}" failed. No retries permitted until 2026-09-09 16:08:24.241229541 +0000 UTC m=+2.012320767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret") pod "global-pull-secret-syncer-vqsxq" (UID: "19e81986-d11f-4538-8975-961f0a59681f") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:23.741313 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741271    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-run-netns\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741313 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-cni-netd\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741313 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-sys\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.741508 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-lib-modules\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.741508 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fcf4a3e9-eec4-49f1-82df-6590d505ae68-konnectivity-ca\") pod \"konnectivity-agent-42v8l\" (UID: \"fcf4a3e9-eec4-49f1-82df-6590d505ae68\") " pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:23.741508 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-socket-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.741666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.741666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741535    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8f87\" (UniqueName: \"kubernetes.io/projected/f100dd61-6da6-4a68-9a9c-ca5402787eb5-kube-api-access-n8f87\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.741666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-sys-fs\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.741666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-kubernetes\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.741666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-host\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.741666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-env-overrides\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-var-lib-kubelet\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741722    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-kubelet\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741750    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-etc-kubernetes\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741767    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-ovn\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741783    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p27wf\" (UniqueName: \"kubernetes.io/projected/d299899c-8552-439f-a03d-0d643d9a3268-kube-api-access-p27wf\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741854    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741869    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-cni-bin\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741888    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-systemd\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741910    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-iptables-alerter-script\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d299899c-8552-439f-a03d-0d643d9a3268-host\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741949    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d299899c-8552-439f-a03d-0d643d9a3268-serviceca\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741972    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cnibin\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.741994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.741993    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-conf-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742037    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-daemon-config\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvcb\" (UniqueName: \"kubernetes.io/projected/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-kube-api-access-fbvcb\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-etc-selinux\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-socket-dir-parent\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-multus-certs\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-systemd-units\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57d8707f-7f36-4b05-b159-83a6d3bf2987-hosts-file\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742234    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57d8707f-7f36-4b05-b159-83a6d3bf2987-tmp-dir\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742265    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4t4m\" (UniqueName: \"kubernetes.io/projected/57d8707f-7f36-4b05-b159-83a6d3bf2987-kube-api-access-p4t4m\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-modprobe-d\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742338    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysconfig\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742351    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-run\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.742582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-cnibin\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-cni-multus\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742394    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-kubelet\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742409    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysctl-d\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742454    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovnkube-config\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742471    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovnkube-script-lib\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742497    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19e81986-d11f-4538-8975-961f0a59681f-dbus\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742516    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-systemd\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-tuned\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqfbn\" (UniqueName: \"kubernetes.io/projected/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-kube-api-access-zqfbn\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fcf4a3e9-eec4-49f1-82df-6590d505ae68-agent-certs\") pod \"konnectivity-agent-42v8l\" (UID: \"fcf4a3e9-eec4-49f1-82df-6590d505ae68\") " pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-system-cni-dir\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrgb\" (UniqueName: \"kubernetes.io/projected/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-kube-api-access-msrgb\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742644    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19e81986-d11f-4538-8975-961f0a59681f-dbus\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysctl-conf\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.743248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-hostroot\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742747    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhhm\" (UniqueName: \"kubernetes.io/projected/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-kube-api-access-bdhhm\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742769    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5jch\" (UniqueName: \"kubernetes.io/projected/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-kube-api-access-b5jch\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-registration-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-tmp\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742851    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-cni-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742846    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fcf4a3e9-eec4-49f1-82df-6590d505ae68-konnectivity-ca\") pod \"konnectivity-agent-42v8l\" (UID: \"fcf4a3e9-eec4-49f1-82df-6590d505ae68\") " pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742865    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-slash\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovn-node-metrics-cert\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742924    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19e81986-d11f-4538-8975-961f0a59681f-kubelet-config\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-netns\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.742971    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-var-lib-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.743013    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-etc-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.743026    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19e81986-d11f-4538-8975-961f0a59681f-kubelet-config\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.743018    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.743057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-node-log\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.743080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-cni-bin\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.743761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.743099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-host-slash\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.744268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.743134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-system-cni-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.747022 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.747006    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fcf4a3e9-eec4-49f1-82df-6590d505ae68-agent-certs\") pod \"konnectivity-agent-42v8l\" (UID: \"fcf4a3e9-eec4-49f1-82df-6590d505ae68\") " pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:23.843380 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.843548 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843384    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8f87\" (UniqueName: \"kubernetes.io/projected/f100dd61-6da6-4a68-9a9c-ca5402787eb5-kube-api-access-n8f87\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.843548 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843409    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-sys-fs\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.843548 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843478    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-sys-fs\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.843687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-kubernetes\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.843687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843591    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-host\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.843687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843618    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-env-overrides\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.843687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.843687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-var-lib-kubelet\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843693    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-host\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-kubelet\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-etc-kubernetes\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843753    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-ovn\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-kubelet\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843776    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843771    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-var-lib-kubelet\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843829    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-etc-kubernetes\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843825    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-ovn\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843688    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-kubernetes\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843856    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843869    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p27wf\" (UniqueName: \"kubernetes.io/projected/d299899c-8552-439f-a03d-0d643d9a3268-kube-api-access-p27wf\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843935    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.843949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-cni-bin\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.843997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-systemd\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844027    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-iptables-alerter-script\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-cni-bin\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844055    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d299899c-8552-439f-a03d-0d643d9a3268-host\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-systemd\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d299899c-8552-439f-a03d-0d643d9a3268-serviceca\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cnibin\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844114    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d299899c-8552-439f-a03d-0d643d9a3268-host\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844158    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cnibin\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844220    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-env-overrides\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-conf-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-daemon-config\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvcb\" (UniqueName: \"kubernetes.io/projected/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-kube-api-access-fbvcb\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.844745 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844319    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-conf-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844324    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-etc-selinux\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844366    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-socket-dir-parent\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844393    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-multus-certs\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-etc-selinux\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-systemd-units\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57d8707f-7f36-4b05-b159-83a6d3bf2987-hosts-file\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57d8707f-7f36-4b05-b159-83a6d3bf2987-tmp-dir\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844475    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-socket-dir-parent\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844491    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-multus-certs\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844525    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d299899c-8552-439f-a03d-0d643d9a3268-serviceca\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844541    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-systemd-units\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4t4m\" (UniqueName: \"kubernetes.io/projected/57d8707f-7f36-4b05-b159-83a6d3bf2987-kube-api-access-p4t4m\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844589    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-iptables-alerter-script\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57d8707f-7f36-4b05-b159-83a6d3bf2987-hosts-file\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844826    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57d8707f-7f36-4b05-b159-83a6d3bf2987-tmp-dir\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844841    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-daemon-config\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.845456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.844585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-modprobe-d\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845318    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysconfig\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-run\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845379    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-cnibin\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845388    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845403    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysconfig\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.845393    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845420    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-modprobe-d\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845439    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-run\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-cni-multus\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845450    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-var-lib-cni-multus\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.845468    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:24.345448423 +0000 UTC m=+2.116539663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845471    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-cnibin\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845541    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-kubelet\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:23.846300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845579    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysctl-d\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovnkube-config\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovnkube-script-lib\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-kubelet\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-systemd\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845654    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-tuned\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845693    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfbn\" (UniqueName: \"kubernetes.io/projected/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-kube-api-access-zqfbn\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-system-cni-dir\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysctl-d\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msrgb\" (UniqueName: \"kubernetes.io/projected/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-kube-api-access-msrgb\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysctl-conf\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845780    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-systemd\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845766    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-hostroot\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-hostroot\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845837    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f100dd61-6da6-4a68-9a9c-ca5402787eb5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhhm\" (UniqueName: \"kubernetes.io/projected/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-kube-api-access-bdhhm\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5jch\" (UniqueName: \"kubernetes.io/projected/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-kube-api-access-b5jch\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:23.847102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-registration-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.845992    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-tmp\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846019    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-cni-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846045    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-slash\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f100dd61-6da6-4a68-9a9c-ca5402787eb5-system-cni-dir\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846070    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovn-node-metrics-cert\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846093    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovnkube-config\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-netns\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-var-lib-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846172    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-etc-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846199    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-node-log\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846217    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-registration-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-cni-bin\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846271    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-cni-bin\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-netns\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846352    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-sysctl-conf\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846373    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-var-lib-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846383    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-host-slash\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.848007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-system-cni-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846416    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-etc-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846417    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-multus-cni-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846172    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovnkube-script-lib\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-node-log\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846455    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-host-slash\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846475    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw4rf\" (UniqueName: \"kubernetes.io/projected/f84998c4-126c-43fe-9312-5e9b21762fb1-kube-api-access-mw4rf\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846515    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-system-cni-dir\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846477    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-slash\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-log-socket\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846569    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-run-openvswitch\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846578    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-device-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846588    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-log-socket\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846604    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f84998c4-126c-43fe-9312-5e9b21762fb1-cni-binary-copy\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846617    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-device-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-k8s-cni-cncf-io\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-run-netns\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.849104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-cni-netd\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.846712    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f84998c4-126c-43fe-9312-5e9b21762fb1-host-run-k8s-cni-cncf-io\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-sys\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847147    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-lib-modules\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-socket-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-socket-dir\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847404    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-run-netns\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847455    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f84998c4-126c-43fe-9312-5e9b21762fb1-cni-binary-copy\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847518    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-sys\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847461    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-host-cni-netd\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.847639    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-lib-modules\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.848741    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-etc-tuned\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.850100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.848769    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-tmp\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.851970 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.851941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-ovn-node-metrics-cert\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.853102 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.853079    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:08:23.853231 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.853111    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:08:23.853231 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.853147    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dvdnc for pod openshift-network-diagnostics/network-check-target-qqgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:23.853361 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:23.853235    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc podName:3272770a-bf22-4f01-b755-490c20dc8cad nodeName:}" failed. No retries permitted until 2026-09-09 16:08:24.353215082 +0000 UTC m=+2.124306325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dvdnc" (UniqueName: "kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc") pod "network-check-target-qqgc8" (UID: "3272770a-bf22-4f01-b755-490c20dc8cad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:23.854513 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.854229    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8f87\" (UniqueName: \"kubernetes.io/projected/f100dd61-6da6-4a68-9a9c-ca5402787eb5-kube-api-access-n8f87\") pod \"multus-additional-cni-plugins-lgs8j\" (UID: \"f100dd61-6da6-4a68-9a9c-ca5402787eb5\") " pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:23.854513 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.854387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p27wf\" (UniqueName: \"kubernetes.io/projected/d299899c-8552-439f-a03d-0d643d9a3268-kube-api-access-p27wf\") pod \"node-ca-tvjw4\" (UID: \"d299899c-8552-439f-a03d-0d643d9a3268\") " pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:23.854724 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.854705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4t4m\" (UniqueName: \"kubernetes.io/projected/57d8707f-7f36-4b05-b159-83a6d3bf2987-kube-api-access-p4t4m\") pod \"node-resolver-mc4sp\" (UID: \"57d8707f-7f36-4b05-b159-83a6d3bf2987\") " pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:23.856191 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.856137    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5jch\" (UniqueName: \"kubernetes.io/projected/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-kube-api-access-b5jch\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:23.856533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.856509    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhhm\" (UniqueName: \"kubernetes.io/projected/76f6bbd1-eb47-4a9e-a196-e8e258aa9807-kube-api-access-bdhhm\") pod \"iptables-alerter-68mrd\" (UID: \"76f6bbd1-eb47-4a9e-a196-e8e258aa9807\") " pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:23.856690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.856669    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqfbn\" (UniqueName: \"kubernetes.io/projected/138b21f6-2f50-46b2-81f7-44dd28a5c5f0-kube-api-access-zqfbn\") pod \"tuned-wwg29\" (UID: \"138b21f6-2f50-46b2-81f7-44dd28a5c5f0\") " pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:23.857007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.856977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvcb\" (UniqueName: \"kubernetes.io/projected/eb6734d7-47a8-450d-94ac-8e9fbcc4a693-kube-api-access-fbvcb\") pod \"ovnkube-node-gjswq\" (UID: \"eb6734d7-47a8-450d-94ac-8e9fbcc4a693\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:23.857051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.856977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrgb\" (UniqueName: \"kubernetes.io/projected/2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877-kube-api-access-msrgb\") pod \"aws-ebs-csi-driver-node-kttrm\" (UID: \"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:23.857734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.857717    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw4rf\" (UniqueName: \"kubernetes.io/projected/f84998c4-126c-43fe-9312-5e9b21762fb1-kube-api-access-mw4rf\") pod \"multus-wmvg7\" (UID: \"f84998c4-126c-43fe-9312-5e9b21762fb1\") " pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:23.894263 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.894238    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:08:23.910841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.910799    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:08:23.969924 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.969854    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:23.991184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:23.991156    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wwg29"
Sep 09 16:08:24.010316 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.010294    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvjw4"
Sep 09 16:08:24.014224 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.014207    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgs8j"
Sep 09 16:08:24.039174 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.039154    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wmvg7"
Sep 09 16:08:24.042937 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.042918    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:24.070120 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.070092    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm"
Sep 09 16:08:24.085022 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.085000    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mc4sp"
Sep 09 16:08:24.091892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.091874    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-68mrd"
Sep 09 16:08:24.146885 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:24.146833    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07650a7db62586f9e69be13fe56d6e10.slice/crio-2585af9ce5b4e95fa77b057d708a5cb5b392e124bee3da7f78781338d6dbca80 WatchSource:0}: Error finding container 2585af9ce5b4e95fa77b057d708a5cb5b392e124bee3da7f78781338d6dbca80: Status 404 returned error can't find the container with id 2585af9ce5b4e95fa77b057d708a5cb5b392e124bee3da7f78781338d6dbca80
Sep 09 16:08:24.149955 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.149940    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:08:24.249103 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.249031    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:24.249230 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.249159    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:24.249230 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.249207    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret podName:19e81986-d11f-4538-8975-961f0a59681f nodeName:}" failed. No retries permitted until 2026-09-09 16:08:25.249194236 +0000 UTC m=+3.020285461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret") pod "global-pull-secret-syncer-vqsxq" (UID: "19e81986-d11f-4538-8975-961f0a59681f") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:24.350336 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.350304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:24.350486 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.350429    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:24.350486 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.350478    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:25.350464653 +0000 UTC m=+3.121555893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:24.403716 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:24.403691    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae075c190650950e327ad43f6cd7f70.slice/crio-ea94a0e35cdec57829485a00626641c0f48f425c9e4767f74a16a889c64e48ce WatchSource:0}: Error finding container ea94a0e35cdec57829485a00626641c0f48f425c9e4767f74a16a889c64e48ce: Status 404 returned error can't find the container with id ea94a0e35cdec57829485a00626641c0f48f425c9e4767f74a16a889c64e48ce
Sep 09 16:08:24.450876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.450844    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:24.451001 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.450987    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:08:24.451043 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.451004    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:08:24.451043 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.451013    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dvdnc for pod openshift-network-diagnostics/network-check-target-qqgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:24.451113 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.451063    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc podName:3272770a-bf22-4f01-b755-490c20dc8cad nodeName:}" failed. No retries permitted until 2026-09-09 16:08:25.451045372 +0000 UTC m=+3.222136597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvdnc" (UniqueName: "kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc") pod "network-check-target-qqgc8" (UID: "3272770a-bf22-4f01-b755-490c20dc8cad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:24.465087 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:24.465062    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd299899c_8552_439f_a03d_0d643d9a3268.slice/crio-49939f498119fe294e2f80d04766451de64d35dc9cbe7f325342c391192de7ce WatchSource:0}: Error finding container 49939f498119fe294e2f80d04766451de64d35dc9cbe7f325342c391192de7ce: Status 404 returned error can't find the container with id 49939f498119fe294e2f80d04766451de64d35dc9cbe7f325342c391192de7ce
Sep 09 16:08:24.565463 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:24.565433    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138b21f6_2f50_46b2_81f7_44dd28a5c5f0.slice/crio-c21240efa3e10f6b2219a018c8218321f1320e725f6e03b56dbb262f8fc12a1e WatchSource:0}: Error finding container c21240efa3e10f6b2219a018c8218321f1320e725f6e03b56dbb262f8fc12a1e: Status 404 returned error can't find the container with id c21240efa3e10f6b2219a018c8218321f1320e725f6e03b56dbb262f8fc12a1e
Sep 09 16:08:24.566096 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:24.566075    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6734d7_47a8_450d_94ac_8e9fbcc4a693.slice/crio-bdd5d6f9651c01deaa0da3643ec38b039c64578980684fa6329d8ee5e7f4a55d WatchSource:0}: Error finding container bdd5d6f9651c01deaa0da3643ec38b039c64578980684fa6329d8ee5e7f4a55d: Status 404 returned error can't find the container with id bdd5d6f9651c01deaa0da3643ec38b039c64578980684fa6329d8ee5e7f4a55d
Sep 09 16:08:24.616950 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:24.616922    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7b9bc7_f1fc_40a5_8d0c_9bc71f20c877.slice/crio-3f02057467485580b0a43cbabbe4a9f67aa011bab9d07e8e9d47f16b683aaa13 WatchSource:0}: Error finding container 3f02057467485580b0a43cbabbe4a9f67aa011bab9d07e8e9d47f16b683aaa13: Status 404 returned error can't find the container with id 3f02057467485580b0a43cbabbe4a9f67aa011bab9d07e8e9d47f16b683aaa13
Sep 09 16:08:24.690950 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.690889    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 16:03:24 +0000 UTC" deadline="2028-03-21 16:14:00.656125393 +0000 UTC"
Sep 09 16:08:24.690950 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.690939    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13416h5m35.965190282s"
Sep 09 16:08:24.733637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.733612    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:24.733806 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:24.733749    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:24.737441 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.737393    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal" event={"ID":"07650a7db62586f9e69be13fe56d6e10","Type":"ContainerStarted","Data":"2585af9ce5b4e95fa77b057d708a5cb5b392e124bee3da7f78781338d6dbca80"}
Sep 09 16:08:24.738562 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.738537    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm" event={"ID":"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877","Type":"ContainerStarted","Data":"3f02057467485580b0a43cbabbe4a9f67aa011bab9d07e8e9d47f16b683aaa13"}
Sep 09 16:08:24.740228 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.740198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"bdd5d6f9651c01deaa0da3643ec38b039c64578980684fa6329d8ee5e7f4a55d"}
Sep 09 16:08:24.741411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.741387    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wwg29" event={"ID":"138b21f6-2f50-46b2-81f7-44dd28a5c5f0","Type":"ContainerStarted","Data":"c21240efa3e10f6b2219a018c8218321f1320e725f6e03b56dbb262f8fc12a1e"}
Sep 09 16:08:24.742732 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.742691    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvjw4" event={"ID":"d299899c-8552-439f-a03d-0d643d9a3268","Type":"ContainerStarted","Data":"49939f498119fe294e2f80d04766451de64d35dc9cbe7f325342c391192de7ce"}
Sep 09 16:08:24.745541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.745513    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" event={"ID":"3ae075c190650950e327ad43f6cd7f70","Type":"ContainerStarted","Data":"ea94a0e35cdec57829485a00626641c0f48f425c9e4767f74a16a889c64e48ce"}
Sep 09 16:08:24.993415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:24.993380    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:08:25.257543 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:25.257434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:25.257729 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.257606    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:25.257729 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.257690    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret podName:19e81986-d11f-4538-8975-961f0a59681f nodeName:}" failed. No retries permitted until 2026-09-09 16:08:27.25766837 +0000 UTC m=+5.028759599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret") pod "global-pull-secret-syncer-vqsxq" (UID: "19e81986-d11f-4538-8975-961f0a59681f") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:25.317521 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:25.317479    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:08:25.358176 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:25.358143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:25.358354 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.358293    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:25.358434 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.358367    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:27.358346593 +0000 UTC m=+5.129437833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:25.458958 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:25.458920    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:25.459160 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.459102    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:08:25.459160 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.459124    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:08:25.459160 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.459136    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dvdnc for pod openshift-network-diagnostics/network-check-target-qqgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:25.459317 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.459199    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc podName:3272770a-bf22-4f01-b755-490c20dc8cad nodeName:}" failed. No retries permitted until 2026-09-09 16:08:27.459184966 +0000 UTC m=+5.230276206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvdnc" (UniqueName: "kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc") pod "network-check-target-qqgc8" (UID: "3272770a-bf22-4f01-b755-490c20dc8cad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:25.691854 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:25.691808    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 16:03:24 +0000 UTC" deadline="2028-03-25 17:22:08.647777599 +0000 UTC"
Sep 09 16:08:25.691854 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:25.691847    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13513h13m42.955935459s"
Sep 09 16:08:25.731277 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:25.731235    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:25.731465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:25.731285    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:25.731465 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.731408    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:25.731669 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:25.731507    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:26.548544 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:26.548504    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f6bbd1_eb47_4a9e_a196_e8e258aa9807.slice/crio-82fd4012debff3ebce70e2f2536ffe6e213c5c1896da2a3074a9664166856af0 WatchSource:0}: Error finding container 82fd4012debff3ebce70e2f2536ffe6e213c5c1896da2a3074a9664166856af0: Status 404 returned error can't find the container with id 82fd4012debff3ebce70e2f2536ffe6e213c5c1896da2a3074a9664166856af0
Sep 09 16:08:26.591444 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:26.591408    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84998c4_126c_43fe_9312_5e9b21762fb1.slice/crio-d1f4346cf94fb935fdfb92cda0873f0bc2a6f3c6b15b8a22f38ddbf36b3e7041 WatchSource:0}: Error finding container d1f4346cf94fb935fdfb92cda0873f0bc2a6f3c6b15b8a22f38ddbf36b3e7041: Status 404 returned error can't find the container with id d1f4346cf94fb935fdfb92cda0873f0bc2a6f3c6b15b8a22f38ddbf36b3e7041
Sep 09 16:08:26.598273 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:26.597532    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d8707f_7f36_4b05_b159_83a6d3bf2987.slice/crio-076aa486ffd3b1163fcf5937b140c91ac9cc3db38200dd16f158a9cae29929d0 WatchSource:0}: Error finding container 076aa486ffd3b1163fcf5937b140c91ac9cc3db38200dd16f158a9cae29929d0: Status 404 returned error can't find the container with id 076aa486ffd3b1163fcf5937b140c91ac9cc3db38200dd16f158a9cae29929d0
Sep 09 16:08:26.606488 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:26.606460    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf100dd61_6da6_4a68_9a9c_ca5402787eb5.slice/crio-27d477db82b938fd36e68d32f609e71636e3ffb4c3b255428d1d2ad6da97f066 WatchSource:0}: Error finding container 27d477db82b938fd36e68d32f609e71636e3ffb4c3b255428d1d2ad6da97f066: Status 404 returned error can't find the container with id 27d477db82b938fd36e68d32f609e71636e3ffb4c3b255428d1d2ad6da97f066
Sep 09 16:08:26.731093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:26.731015    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:26.731676 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:26.731131    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:26.751614 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:26.751479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-68mrd" event={"ID":"76f6bbd1-eb47-4a9e-a196-e8e258aa9807","Type":"ContainerStarted","Data":"82fd4012debff3ebce70e2f2536ffe6e213c5c1896da2a3074a9664166856af0"}
Sep 09 16:08:26.754413 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:26.754376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal" event={"ID":"07650a7db62586f9e69be13fe56d6e10","Type":"ContainerStarted","Data":"516ea72f7b0a3471b4dc7a56da3240cfcba1ebf8a7a03a79e0d5895533abad8f"}
Sep 09 16:08:26.758321 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:26.757952    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mc4sp" event={"ID":"57d8707f-7f36-4b05-b159-83a6d3bf2987","Type":"ContainerStarted","Data":"076aa486ffd3b1163fcf5937b140c91ac9cc3db38200dd16f158a9cae29929d0"}
Sep 09 16:08:26.759576 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:26.759352    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerStarted","Data":"27d477db82b938fd36e68d32f609e71636e3ffb4c3b255428d1d2ad6da97f066"}
Sep 09 16:08:26.762388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:26.762361    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wmvg7" event={"ID":"f84998c4-126c-43fe-9312-5e9b21762fb1","Type":"ContainerStarted","Data":"d1f4346cf94fb935fdfb92cda0873f0bc2a6f3c6b15b8a22f38ddbf36b3e7041"}
Sep 09 16:08:26.766793 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:26.766739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42v8l" event={"ID":"fcf4a3e9-eec4-49f1-82df-6590d505ae68","Type":"ContainerStarted","Data":"8f2121d3fa185e2d25b93a7996fffb1e77623825b95356ec2b1713e1b1554b36"}
Sep 09 16:08:26.773091 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:26.773006    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal" podStartSLOduration=2.772987701 podStartE2EDuration="2.772987701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:26.772625264 +0000 UTC m=+4.543716514" watchObservedRunningTime="2026-09-09 16:08:26.772987701 +0000 UTC m=+4.544078954"
Sep 09 16:08:27.279991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:27.279590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:27.279991 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.279925    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:27.279991 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.280003    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret podName:19e81986-d11f-4538-8975-961f0a59681f nodeName:}" failed. No retries permitted until 2026-09-09 16:08:31.279982146 +0000 UTC m=+9.051073375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret") pod "global-pull-secret-syncer-vqsxq" (UID: "19e81986-d11f-4538-8975-961f0a59681f") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:27.380995 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:27.380946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:27.381233 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.381177    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:27.381331 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.381253    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:31.381232119 +0000 UTC m=+9.152323368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:27.483029 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:27.482304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:27.483029 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.482541    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:08:27.483029 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.482568    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:08:27.483029 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.482583    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dvdnc for pod openshift-network-diagnostics/network-check-target-qqgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:27.483029 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.482643    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc podName:3272770a-bf22-4f01-b755-490c20dc8cad nodeName:}" failed. No retries permitted until 2026-09-09 16:08:31.482624044 +0000 UTC m=+9.253715273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvdnc" (UniqueName: "kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc") pod "network-check-target-qqgc8" (UID: "3272770a-bf22-4f01-b755-490c20dc8cad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:27.731409 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:27.730852    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:27.731409 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.731000    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:27.731409 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:27.731095    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:27.731409 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:27.731230    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:27.772242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:27.772179    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" event={"ID":"3ae075c190650950e327ad43f6cd7f70","Type":"ContainerStarted","Data":"238a00f1175467f799d353d2c38b0164338d490795e9760497bd310eb0b0dbe8"}
Sep 09 16:08:28.733492 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:28.732953    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:28.733492 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:28.733097    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:28.777980 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:28.777931    2567 generic.go:356] "Generic (PLEG): container finished" podID="3ae075c190650950e327ad43f6cd7f70" containerID="238a00f1175467f799d353d2c38b0164338d490795e9760497bd310eb0b0dbe8" exitCode=0
Sep 09 16:08:28.778156 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:28.777998    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" event={"ID":"3ae075c190650950e327ad43f6cd7f70","Type":"ContainerDied","Data":"238a00f1175467f799d353d2c38b0164338d490795e9760497bd310eb0b0dbe8"}
Sep 09 16:08:29.731084 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:29.731046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:29.731268 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:29.731189    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:29.731619 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:29.731595    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:29.731776 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:29.731755    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:30.731282 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:30.731243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:30.731787 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:30.731427    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:31.317005 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:31.316969    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:31.317162 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.317137    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:31.317228 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.317217    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret podName:19e81986-d11f-4538-8975-961f0a59681f nodeName:}" failed. No retries permitted until 2026-09-09 16:08:39.317197958 +0000 UTC m=+17.088289187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret") pod "global-pull-secret-syncer-vqsxq" (UID: "19e81986-d11f-4538-8975-961f0a59681f") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:31.417695 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:31.417561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:31.417695 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.417643    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:31.417958 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.417725    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:39.417698805 +0000 UTC m=+17.188790033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:31.518894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:31.518858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:31.519088 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.519065    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:08:31.519185 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.519091    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:08:31.519185 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.519105    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dvdnc for pod openshift-network-diagnostics/network-check-target-qqgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:31.519185 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.519177    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc podName:3272770a-bf22-4f01-b755-490c20dc8cad nodeName:}" failed. No retries permitted until 2026-09-09 16:08:39.519157736 +0000 UTC m=+17.290248978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvdnc" (UniqueName: "kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc") pod "network-check-target-qqgc8" (UID: "3272770a-bf22-4f01-b755-490c20dc8cad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:31.730948 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:31.730656    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:31.730948 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:31.730656    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:31.730948 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.730866    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:31.731241 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:31.730979    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:32.734221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:32.734191    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:32.734658 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:32.734313    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:33.730947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:33.730856    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:33.731122 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:33.730992    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:33.731122 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:33.731046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:33.731246 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:33.731171    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:34.730852 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:34.730814    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:34.731242 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:34.730959    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:35.730890 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:35.730837    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:35.730890 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:35.730856    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:35.731312 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:35.730964    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:35.731312 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:35.731110    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:36.731511 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:36.731482    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:36.731986 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:36.731606    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:37.731188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:37.731147    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:37.731363 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:37.731155    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:37.731363 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:37.731288    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:37.731464 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:37.731366    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:38.731009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:38.730973    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:38.731436 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:38.731133    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:39.381225 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:39.381189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:39.381368 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.381328    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:39.381433 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.381396    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret podName:19e81986-d11f-4538-8975-961f0a59681f nodeName:}" failed. No retries permitted until 2026-09-09 16:08:55.381377318 +0000 UTC m=+33.152468543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret") pod "global-pull-secret-syncer-vqsxq" (UID: "19e81986-d11f-4538-8975-961f0a59681f") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:39.482006 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:39.481970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:39.482169 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.482099    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:39.482169 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.482157    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:55.482138574 +0000 UTC m=+33.253229811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:39.582697 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:39.582620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:39.582849 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.582758    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:08:39.582849 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.582796    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:08:39.582849 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.582809    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dvdnc for pod openshift-network-diagnostics/network-check-target-qqgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:39.582969 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.582866    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc podName:3272770a-bf22-4f01-b755-490c20dc8cad nodeName:}" failed. No retries permitted until 2026-09-09 16:08:55.582847978 +0000 UTC m=+33.353939218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvdnc" (UniqueName: "kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc") pod "network-check-target-qqgc8" (UID: "3272770a-bf22-4f01-b755-490c20dc8cad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:39.731277 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:39.731241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:39.731735 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:39.731244    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:39.731735 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.731392    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:39.731735 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:39.731462    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:40.731295 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:40.731265    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:40.731825 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:40.731389    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:41.730868 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:41.730833    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:41.731049 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:41.730960    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:41.731049 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:41.731012    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:41.731171 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:41.731147    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:42.732484 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:42.732452    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:42.732983 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:42.732568    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:43.731806 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.731495    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:43.731919 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.731496    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:43.731919 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:43.731880    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:43.732035 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:43.731992    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:43.810351 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.810314    2567 generic.go:356] "Generic (PLEG): container finished" podID="f100dd61-6da6-4a68-9a9c-ca5402787eb5" containerID="755b23da5731544e98ff8c1d16f3b93a03440fd271243fa4df4f81831459b7ea" exitCode=0
Sep 09 16:08:43.811282 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.810387    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerDied","Data":"755b23da5731544e98ff8c1d16f3b93a03440fd271243fa4df4f81831459b7ea"}
Sep 09 16:08:43.812219 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.812196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wmvg7" event={"ID":"f84998c4-126c-43fe-9312-5e9b21762fb1","Type":"ContainerStarted","Data":"4004c65a19412be6a17785039913634df740143020ea0a131e450fe298cc86c8"}
Sep 09 16:08:43.816290 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.816266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42v8l" event={"ID":"fcf4a3e9-eec4-49f1-82df-6590d505ae68","Type":"ContainerStarted","Data":"143e263c282b345d3c627c30ec75022371043247b7a3abfa98642173a7a7c881"}
Sep 09 16:08:43.817871 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.817850    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wwg29" event={"ID":"138b21f6-2f50-46b2-81f7-44dd28a5c5f0","Type":"ContainerStarted","Data":"9cb6b60e995544851b5005774803c27a47822ae5daa778e8f12a2611fc5eefc3"}
Sep 09 16:08:43.819360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.819334    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvjw4" event={"ID":"d299899c-8552-439f-a03d-0d643d9a3268","Type":"ContainerStarted","Data":"91ca1907e66b47e4796d803b841b8c4b67f839530c063800f4d4147f60f51dca"}
Sep 09 16:08:43.820737 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.820717    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm" event={"ID":"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877","Type":"ContainerStarted","Data":"36510f3bb25232a66a4459688009044f810570fcb15e891ea8339fbd007db00e"}
Sep 09 16:08:43.823841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.823822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"97f6e7892e2e0a651274bba991fb35526c804cb114de9e0915470965aa74e74d"}
Sep 09 16:08:43.823927 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.823881    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"601b363ab97f27281679985ab784bac2fdff3fc0a1345b35278b2146230a9dbd"}
Sep 09 16:08:43.823977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.823930    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"e0d7b9ede2e5eeea835fe515335a351a601e94c13506324393fbf6bed81c97a5"}
Sep 09 16:08:43.824011 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.823979    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"6e1a7784190b427120c62783025f296899a426edbd763cd436b1aefce11cae54"}
Sep 09 16:08:43.824048 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.824026    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"345ec487126bea99dfec36ad10f912fd8a88131dc2bbe80a7b5efae670218831"}
Sep 09 16:08:43.824084 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.824069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"83e313fde483b2d374149469d7761d96edc57b001e52a583b8c9aab1aaf898fc"}
Sep 09 16:08:43.825732 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.825710    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" event={"ID":"3ae075c190650950e327ad43f6cd7f70","Type":"ContainerStarted","Data":"02f3b9d96a09e311bba6324d8f5cefe991d8ccd8997f99cdb9d9b7744466e329"}
Sep 09 16:08:43.827132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.827111    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mc4sp" event={"ID":"57d8707f-7f36-4b05-b159-83a6d3bf2987","Type":"ContainerStarted","Data":"55b9cd42e814bbada3eb42861714fc3250ad7ec025c342a09b933630b119b533"}
Sep 09 16:08:43.843206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.843167    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" podStartSLOduration=19.84315257 podStartE2EDuration="19.84315257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:43.842450271 +0000 UTC m=+21.613541529" watchObservedRunningTime="2026-09-09 16:08:43.84315257 +0000 UTC m=+21.614243816"
Sep 09 16:08:43.860153 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.860110    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-42v8l" podStartSLOduration=4.307252067 podStartE2EDuration="20.860096315s" totalImagesPullingTime="16.552844248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:43.859600114 +0000 UTC m=+21.630691361" watchObservedRunningTime="2026-09-09 16:08:43.860096315 +0000 UTC m=+21.631187552"
Sep 09 16:08:43.891883 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.891802    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wwg29" podStartSLOduration=10.064828627 podStartE2EDuration="20.891789062s" totalImagesPullingTime="10.826960435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:43.891558885 +0000 UTC m=+21.662650131" watchObservedRunningTime="2026-09-09 16:08:43.891789062 +0000 UTC m=+21.662880298"
Sep 09 16:08:43.891987 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.891966    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wmvg7" podStartSLOduration=4.182749904 podStartE2EDuration="20.89196191s" totalImagesPullingTime="16.709212006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:43.87591695 +0000 UTC m=+21.647008195" watchObservedRunningTime="2026-09-09 16:08:43.89196191 +0000 UTC m=+21.663053153"
Sep 09 16:08:43.929445 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.929394    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tvjw4" podStartSLOduration=6.136396043 podStartE2EDuration="20.929382316s" totalImagesPullingTime="14.792986273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:43.904943657 +0000 UTC m=+21.676034914" watchObservedRunningTime="2026-09-09 16:08:43.929382316 +0000 UTC m=+21.700473562"
Sep 09 16:08:43.929852 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:43.929823    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mc4sp" podStartSLOduration=4.392543988 podStartE2EDuration="20.929814711s" totalImagesPullingTime="16.537270723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:43.929618121 +0000 UTC m=+21.700709366" watchObservedRunningTime="2026-09-09 16:08:43.929814711 +0000 UTC m=+21.700905956"
Sep 09 16:08:44.435824 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.435801    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 16:08:44.706484 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.706374    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T16:08:44.435819154Z","UUID":"72b0739e-b48d-4bad-b9a8-7baa0a952b56","Handler":null,"Name":"","Endpoint":""}
Sep 09 16:08:44.707804 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.707784    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 16:08:44.707919 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.707817    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 16:08:44.731213 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.731190    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:44.731323 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:44.731280    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:44.775400 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.775374    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:44.775881 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.775866    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:44.830857 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.830824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-68mrd" event={"ID":"76f6bbd1-eb47-4a9e-a196-e8e258aa9807","Type":"ContainerStarted","Data":"f9dbae323597a392b94dc345638358361075fd3581ce7bd434245034c2bb01b5"}
Sep 09 16:08:44.832696 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.832670    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm" event={"ID":"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877","Type":"ContainerStarted","Data":"b36648be85d31b9f9a3b2cf631e758c746e42e4376e89191f8ab71545098a202"}
Sep 09 16:08:44.833353 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.833334    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:44.833735 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.833720    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-42v8l"
Sep 09 16:08:44.845279 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:44.845233    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-68mrd" podStartSLOduration=5.30512431 podStartE2EDuration="21.845220223s" totalImagesPullingTime="16.540095913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:44.844839596 +0000 UTC m=+22.615930853" watchObservedRunningTime="2026-09-09 16:08:44.845220223 +0000 UTC m=+22.616311468"
Sep 09 16:08:45.731347 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:45.731312    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:45.731347 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:45.731352    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:45.731600 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:45.731442    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:45.731653 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:45.731611    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:46.730969 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:46.730931    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:46.731475 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:46.731059    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:46.839987 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:46.839955    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"5f16d896f4290482c66ab60cf65e7cf8ab16428eadca2fe16e06bc25e8e5be2f"}
Sep 09 16:08:47.730871 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:47.730683    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:47.731028 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:47.730683    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:47.731028 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:47.730946    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:47.731028 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:47.731008    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:47.843679 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:47.843642    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm" event={"ID":"2b7b9bc7-f1fc-40a5-8d0c-9bc71f20c877","Type":"ContainerStarted","Data":"d596df0313ff680c5cd48f43d26726fe960d84cbbfda422e59575a1c339c9daf"}
Sep 09 16:08:47.860299 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:47.860253    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kttrm" podStartSLOduration=9.941481928 podStartE2EDuration="24.860239951s" totalImagesPullingTime="14.918758023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:47.859625601 +0000 UTC m=+25.630716846" watchObservedRunningTime="2026-09-09 16:08:47.860239951 +0000 UTC m=+25.631331197"
Sep 09 16:08:48.731556 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:48.731526    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:48.732412 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:48.731651    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:48.849819 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:48.849761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" event={"ID":"eb6734d7-47a8-450d-94ac-8e9fbcc4a693","Type":"ContainerStarted","Data":"952b1d28e4519719c63170a207470f2b37aeaa294d3e53340e8e1bf379c6f943"}
Sep 09 16:08:48.874863 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:48.874808    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq" podStartSLOduration=7.260780587 podStartE2EDuration="25.874792233s" totalImagesPullingTime="18.614011646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:08:48.874458516 +0000 UTC m=+26.645549763" watchObservedRunningTime="2026-09-09 16:08:48.874792233 +0000 UTC m=+26.645883473"
Sep 09 16:08:49.731183 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.731146    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:49.731183 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.731167    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:49.731418 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:49.731251    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:49.731418 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:49.731396    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:49.852785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.852743    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:49.853276 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.852847    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:49.853276 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.852880    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:49.869936 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.869727    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:49.870082 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.870046    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:08:49.935417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.935378    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4w9ps"]
Sep 09 16:08:49.935591 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.935496    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:49.935662 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:49.935611    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:49.938456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.938432    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qqgc8"]
Sep 09 16:08:49.938584 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.938517    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:49.938639 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:49.938610    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:49.946605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.946577    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vqsxq"]
Sep 09 16:08:49.946734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:49.946678    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:49.946816 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:49.946796    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:51.730804 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:51.730713    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:51.731150 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:51.730713    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:51.731150 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:51.730826    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:51.731150 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:51.730713    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:51.731150 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:51.730886    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:51.731150 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:51.730958    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:51.857929 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:51.857896    2567 generic.go:356] "Generic (PLEG): container finished" podID="f100dd61-6da6-4a68-9a9c-ca5402787eb5" containerID="76fde4fd71b7afb29cf288bbe21f8d3542bf21415ac2c8cc6421e595f19332ae" exitCode=0
Sep 09 16:08:51.858072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:51.857978    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerDied","Data":"76fde4fd71b7afb29cf288bbe21f8d3542bf21415ac2c8cc6421e595f19332ae"}
Sep 09 16:08:53.731012 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:53.730838    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:53.731406 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:53.730862    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:53.731406 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:53.731077    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:53.731406 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:53.730892    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:53.731406 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:53.731149    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:53.731406 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:53.731246    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:53.865043 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:53.865011    2567 generic.go:356] "Generic (PLEG): container finished" podID="f100dd61-6da6-4a68-9a9c-ca5402787eb5" containerID="b610af1599214a14c14819a40385103bab10ef83dbc7db9a161bde1a92cef958" exitCode=0
Sep 09 16:08:53.865212 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:53.865052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerDied","Data":"b610af1599214a14c14819a40385103bab10ef83dbc7db9a161bde1a92cef958"}
Sep 09 16:08:55.396568 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:55.396541    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:55.396931 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.396677    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:55.396931 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.396735    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret podName:19e81986-d11f-4538-8975-961f0a59681f nodeName:}" failed. No retries permitted until 2026-09-09 16:09:27.396717164 +0000 UTC m=+65.167808404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret") pod "global-pull-secret-syncer-vqsxq" (UID: "19e81986-d11f-4538-8975-961f0a59681f") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:08:55.497142 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:55.497111    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:55.497299 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.497257    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:55.497334 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.497320    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:09:27.49730519 +0000 UTC m=+65.268396413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:08:55.597511 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:55.597488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:55.597665 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.597615    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:08:55.597665 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.597630    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:08:55.597665 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.597639    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dvdnc for pod openshift-network-diagnostics/network-check-target-qqgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:55.597760 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.597681    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc podName:3272770a-bf22-4f01-b755-490c20dc8cad nodeName:}" failed. No retries permitted until 2026-09-09 16:09:27.597669794 +0000 UTC m=+65.368761018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvdnc" (UniqueName: "kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc") pod "network-check-target-qqgc8" (UID: "3272770a-bf22-4f01-b755-490c20dc8cad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:08:55.731404 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:55.731376    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:55.731607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:55.731411    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:55.731607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:55.731476    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:55.731607 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.731486    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqsxq" podUID="19e81986-d11f-4538-8975-961f0a59681f"
Sep 09 16:08:55.731607 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.731546    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qqgc8" podUID="3272770a-bf22-4f01-b755-490c20dc8cad"
Sep 09 16:08:55.731740 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:55.731624    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:08:55.870834 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:55.870791    2567 generic.go:356] "Generic (PLEG): container finished" podID="f100dd61-6da6-4a68-9a9c-ca5402787eb5" containerID="ba6aba138852c0feaea488ce64f7fed6bf37d3709331f5aa8c2dcaf702ca5c84" exitCode=0
Sep 09 16:08:55.870981 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:55.870874    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerDied","Data":"ba6aba138852c0feaea488ce64f7fed6bf37d3709331f5aa8c2dcaf702ca5c84"}
Sep 09 16:08:56.042129 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.042107    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeReady"
Sep 09 16:08:56.042259 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.042211    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 16:08:56.073003 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.072977    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-96b8bb895-tldfb"]
Sep 09 16:08:56.074717 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.074703    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.077024 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.076997    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 16:08:56.077118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.077026    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 16:08:56.077118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.077001    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 16:08:56.077118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.076998    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jv6x\""
Sep 09 16:08:56.082252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.082235    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 16:08:56.087428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.087407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96b8bb895-tldfb"]
Sep 09 16:08:56.092685 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.091665    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6gz8f"]
Sep 09 16:08:56.094800 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.094106    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cmlbz"]
Sep 09 16:08:56.095179 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.095162    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6gz8f"
Sep 09 16:08:56.096461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.096443    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.097428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.097407    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-74c5r\""
Sep 09 16:08:56.097517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.097432    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 16:08:56.097517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.097416    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 16:08:56.097517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.097412    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 16:08:56.098438 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.098418    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 16:08:56.098552 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.098538    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 16:08:56.098692 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.098678    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgn4p\""
Sep 09 16:08:56.104654 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.104633    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6gz8f"]
Sep 09 16:08:56.105358 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.105339    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmlbz"]
Sep 09 16:08:56.201725 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.201869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201731    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-image-registry-private-configuration\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.201869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201801    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cb7d6f9-896f-4de3-b644-02091a56a39a-ca-trust-extracted\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.201869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da78760a-b579-4a43-83cf-0a0f0a7bd11c-cert\") pod \"ingress-canary-6gz8f\" (UID: \"da78760a-b579-4a43-83cf-0a0f0a7bd11c\") " pod="openshift-ingress-canary/ingress-canary-6gz8f"
Sep 09 16:08:56.201869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-trusted-ca\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.201869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-config-volume\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.202051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-installation-pull-secrets\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.202051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201940    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhp6p\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-kube-api-access-rhp6p\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.202051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.201968    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjfxz\" (UniqueName: \"kubernetes.io/projected/da78760a-b579-4a43-83cf-0a0f0a7bd11c-kube-api-access-vjfxz\") pod \"ingress-canary-6gz8f\" (UID: \"da78760a-b579-4a43-83cf-0a0f0a7bd11c\") " pod="openshift-ingress-canary/ingress-canary-6gz8f"
Sep 09 16:08:56.202051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.202007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.202051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.202025    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-certificates\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.202051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.202043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-bound-sa-token\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.202219 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.202065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-tmp-dir\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.202219 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.202081    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdcs8\" (UniqueName: \"kubernetes.io/projected/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-kube-api-access-sdcs8\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.303027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.302944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.303027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.302982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-image-registry-private-configuration\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303017    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cb7d6f9-896f-4de3-b644-02091a56a39a-ca-trust-extracted\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303033    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da78760a-b579-4a43-83cf-0a0f0a7bd11c-cert\") pod \"ingress-canary-6gz8f\" (UID: \"da78760a-b579-4a43-83cf-0a0f0a7bd11c\") " pod="openshift-ingress-canary/ingress-canary-6gz8f"
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-trusted-ca\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303081    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-config-volume\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303105    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-installation-pull-secrets\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.303110    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhp6p\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-kube-api-access-rhp6p\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.303177    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:56.803157339 +0000 UTC m=+34.574248564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjfxz\" (UniqueName: \"kubernetes.io/projected/da78760a-b579-4a43-83cf-0a0f0a7bd11c-kube-api-access-vjfxz\") pod \"ingress-canary-6gz8f\" (UID: \"da78760a-b579-4a43-83cf-0a0f0a7bd11c\") " pod="openshift-ingress-canary/ingress-canary-6gz8f"
Sep 09 16:08:56.303252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-certificates\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303292    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-bound-sa-token\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-tmp-dir\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.303645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdcs8\" (UniqueName: \"kubernetes.io/projected/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-kube-api-access-sdcs8\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.303645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303419    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cb7d6f9-896f-4de3-b644-02091a56a39a-ca-trust-extracted\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.303645 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.303641    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:08:56.303960 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.303657    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:08:56.303960 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.303699    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:08:56.803684802 +0000 UTC m=+34.574776039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:08:56.304065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.303956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-certificates\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.304373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.304244    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-tmp-dir\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.304464 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.304392    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-trusted-ca\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.304464 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.304402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-config-volume\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.307060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.307038    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-installation-pull-secrets\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.307185 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.307041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-image-registry-private-configuration\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.307185 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.307121    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da78760a-b579-4a43-83cf-0a0f0a7bd11c-cert\") pod \"ingress-canary-6gz8f\" (UID: \"da78760a-b579-4a43-83cf-0a0f0a7bd11c\") " pod="openshift-ingress-canary/ingress-canary-6gz8f"
Sep 09 16:08:56.311348 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.311325    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdcs8\" (UniqueName: \"kubernetes.io/projected/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-kube-api-access-sdcs8\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.311719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.311697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-bound-sa-token\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.311830 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.311755    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhp6p\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-kube-api-access-rhp6p\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.312360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.312326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjfxz\" (UniqueName: \"kubernetes.io/projected/da78760a-b579-4a43-83cf-0a0f0a7bd11c-kube-api-access-vjfxz\") pod \"ingress-canary-6gz8f\" (UID: \"da78760a-b579-4a43-83cf-0a0f0a7bd11c\") " pod="openshift-ingress-canary/ingress-canary-6gz8f"
Sep 09 16:08:56.404198 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.404172    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6gz8f"
Sep 09 16:08:56.679599 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.679571    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6gz8f"]
Sep 09 16:08:56.684417 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:08:56.684392    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda78760a_b579_4a43_83cf_0a0f0a7bd11c.slice/crio-210d0a8e57b025c9693d4a437cfc0c31f10ff2660f3914364a22adb9ba87b12a WatchSource:0}: Error finding container 210d0a8e57b025c9693d4a437cfc0c31f10ff2660f3914364a22adb9ba87b12a: Status 404 returned error can't find the container with id 210d0a8e57b025c9693d4a437cfc0c31f10ff2660f3914364a22adb9ba87b12a
Sep 09 16:08:56.807957 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.807921    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:56.808105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.807998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:56.808105 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.808080    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:08:56.808178 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.808129    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:08:56.808178 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.808140    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:08:56.808178 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.808151    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:57.808131242 +0000 UTC m=+35.579222485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:08:56.808178 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:56.808175    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:08:57.808164122 +0000 UTC m=+35.579255345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:08:56.874309 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:56.874273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6gz8f" event={"ID":"da78760a-b579-4a43-83cf-0a0f0a7bd11c","Type":"ContainerStarted","Data":"210d0a8e57b025c9693d4a437cfc0c31f10ff2660f3914364a22adb9ba87b12a"}
Sep 09 16:08:57.731176 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.731136    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:08:57.731768 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.731192    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:08:57.731768 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.731146    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:08:57.734874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.734690    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 16:08:57.734874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.734690    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 16:08:57.734874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.734746    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zj7bv\""
Sep 09 16:08:57.734874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.734726    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 16:08:57.734874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.734727    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 16:08:57.734874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.734753    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-trsmq\""
Sep 09 16:08:57.815817 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.815768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:57.815992 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:57.815834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:57.815992 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:57.815932    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:08:57.815992 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:57.815954    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:08:57.815992 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:57.815961    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:08:57.816211 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:57.816019    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:08:59.816000461 +0000 UTC m=+37.587091690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:08:57.816211 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:57.816039    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:08:59.816029119 +0000 UTC m=+37.587120347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:08:59.835512 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:59.835441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:08:59.835512 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:08:59.835487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:08:59.835958 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:59.835597    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:08:59.835958 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:59.835614    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:08:59.835958 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:59.835634    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:08:59.835958 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:59.835647    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:09:03.835633003 +0000 UTC m=+41.606724238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:08:59.835958 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:08:59.835712    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:09:03.835700675 +0000 UTC m=+41.606791913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:09:00.886402 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:00.886331    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6gz8f" event={"ID":"da78760a-b579-4a43-83cf-0a0f0a7bd11c","Type":"ContainerStarted","Data":"92eaeb6dd872c0d2d110b45d6f23b70cd9ca4ca0e109068680290662aeaceab0"}
Sep 09 16:09:00.901665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:00.901618    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6gz8f" podStartSLOduration=1.6399987729999999 podStartE2EDuration="4.90160045s" totalImagesPullingTime="3.261601677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:00.90122768 +0000 UTC m=+38.672318927" watchObservedRunningTime="2026-09-09 16:09:00.90160045 +0000 UTC m=+38.672691698"
Sep 09 16:09:01.288400 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:01.288322    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:01.395900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:01.395860    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:02.718955 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:02.718925    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:02.771746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:02.771712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:02.894433 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:02.894397    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerStarted","Data":"ab939bd3d8f15b933ce515c40c9e435070b79dc064de8d2036d287b130debd19"}
Sep 09 16:09:03.865611 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:03.865569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:09:03.865611 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:03.865617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:09:03.866067 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:03.865710    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:09:03.866067 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:03.865766    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:09:11.865754138 +0000 UTC m=+49.636845361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:09:03.866067 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:03.865708    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:09:03.866067 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:03.865807    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:09:03.866067 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:03.865856    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:09:11.865841683 +0000 UTC m=+49.636932907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:09:03.899967 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:03.899939    2567 generic.go:356] "Generic (PLEG): container finished" podID="f100dd61-6da6-4a68-9a9c-ca5402787eb5" containerID="ab939bd3d8f15b933ce515c40c9e435070b79dc064de8d2036d287b130debd19" exitCode=0
Sep 09 16:09:03.900076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:03.899988    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerDied","Data":"ab939bd3d8f15b933ce515c40c9e435070b79dc064de8d2036d287b130debd19"}
Sep 09 16:09:04.904925 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:04.904892    2567 generic.go:356] "Generic (PLEG): container finished" podID="f100dd61-6da6-4a68-9a9c-ca5402787eb5" containerID="7459766f9b0a61352e85b60639c546756607cc9d391b2019d085648833098d70" exitCode=0
Sep 09 16:09:04.905342 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:04.904933    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerDied","Data":"7459766f9b0a61352e85b60639c546756607cc9d391b2019d085648833098d70"}
Sep 09 16:09:05.910257 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:05.910223    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" event={"ID":"f100dd61-6da6-4a68-9a9c-ca5402787eb5","Type":"ContainerStarted","Data":"fd74e4ef0d82a01f75c0e00a958987b58cf2e8681211d49c1912f48130629db3"}
Sep 09 16:09:05.930436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:05.930369    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lgs8j" podStartSLOduration=9.863117941 podStartE2EDuration="42.930353077s" totalImagesPullingTime="33.067235136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:05.92856595 +0000 UTC m=+43.699657195" watchObservedRunningTime="2026-09-09 16:09:05.930353077 +0000 UTC m=+43.701444322"
Sep 09 16:09:06.128233 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:06.128206    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:06.199274 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:06.199204    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:06.296755 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:06.296721    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:06.434103 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:06.434063    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:06.534732 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:06.534652    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:07.443435 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:07.443407    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:07.567834 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:07.567800    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:08.813829 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:08.813803    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:10.730819 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:10.730764    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:11.850319 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:11.850285    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:11.925346 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:11.925320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:09:11.925482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:11.925352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:09:11.925482 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:11.925448    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:09:11.925482 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:11.925453    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:09:11.925482 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:11.925466    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:09:11.925634 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:11.925494    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:09:27.925481347 +0000 UTC m=+65.696572583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:09:11.925634 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:11.925506    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:09:27.925500763 +0000 UTC m=+65.696591986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:09:14.198269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:14.198230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:20.882155 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:20.882114    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:21.868222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:21.868197    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjswq"
Sep 09 16:09:22.517794 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:22.517742    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:22.621138 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:22.621110    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:23.730260 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:23.730225    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:25.189181 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:25.189142    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:25.275884 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:25.275854    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:26.902977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:26.902940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:26.954378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:26.954346    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:27.434754 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.434713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:09:27.437334 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.437316    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 16:09:27.448428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.448405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19e81986-d11f-4538-8975-961f0a59681f-original-pull-secret\") pod \"global-pull-secret-syncer-vqsxq\" (UID: \"19e81986-d11f-4538-8975-961f0a59681f\") " pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:09:27.455398 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.455378    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqsxq"
Sep 09 16:09:27.535357 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.535319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:09:27.537871 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.537851    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 16:09:27.545814 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:27.545797    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 16:09:27.545871 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:27.545855    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:10:31.545839028 +0000 UTC m=+129.316930252 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : secret "metrics-daemon-secret" not found
Sep 09 16:09:27.636081 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.636041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:09:27.638737 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.638721    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 16:09:27.648712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.648691    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 16:09:27.659924 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.659898    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvdnc\" (UniqueName: \"kubernetes.io/projected/3272770a-bf22-4f01-b755-490c20dc8cad-kube-api-access-dvdnc\") pod \"network-check-target-qqgc8\" (UID: \"3272770a-bf22-4f01-b755-490c20dc8cad\") " pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:09:27.718751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.718682    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vqsxq"]
Sep 09 16:09:27.721600 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:09:27.721573    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e81986_d11f_4538_8975_961f0a59681f.slice/crio-ab173f973799abccb4cc803be369ff76ec8400ed7fc2b5100d5db4396fb1dc76 WatchSource:0}: Error finding container ab173f973799abccb4cc803be369ff76ec8400ed7fc2b5100d5db4396fb1dc76: Status 404 returned error can't find the container with id ab173f973799abccb4cc803be369ff76ec8400ed7fc2b5100d5db4396fb1dc76
Sep 09 16:09:27.752055 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.752026    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-trsmq\""
Sep 09 16:09:27.759765 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.759727    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:09:27.938722 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.938683    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:09:27.938722 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.938733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:09:27.939202 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:27.938861    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:09:27.939202 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:27.938864    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:09:27.939202 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:27.938886    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:09:27.939202 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:27.938918    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:09:59.938903138 +0000 UTC m=+97.709994380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:09:27.939202 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:27.938932    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:09:59.938926475 +0000 UTC m=+97.710017698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:09:27.960008 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:27.959977    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vqsxq" event={"ID":"19e81986-d11f-4538-8975-961f0a59681f","Type":"ContainerStarted","Data":"ab173f973799abccb4cc803be369ff76ec8400ed7fc2b5100d5db4396fb1dc76"}
Sep 09 16:09:28.024716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:28.024650    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qqgc8"]
Sep 09 16:09:28.027761 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:09:28.027738    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3272770a_bf22_4f01_b755_490c20dc8cad.slice/crio-05755e9721d7c10201fd2618aef329730364b0138e72f7ce4012ac5e5c9e03e6 WatchSource:0}: Error finding container 05755e9721d7c10201fd2618aef329730364b0138e72f7ce4012ac5e5c9e03e6: Status 404 returned error can't find the container with id 05755e9721d7c10201fd2618aef329730364b0138e72f7ce4012ac5e5c9e03e6
Sep 09 16:09:28.964855 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:28.964817    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qqgc8" event={"ID":"3272770a-bf22-4f01-b755-490c20dc8cad","Type":"ContainerStarted","Data":"05755e9721d7c10201fd2618aef329730364b0138e72f7ce4012ac5e5c9e03e6"}
Sep 09 16:09:33.979230 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:33.979191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vqsxq" event={"ID":"19e81986-d11f-4538-8975-961f0a59681f","Type":"ContainerStarted","Data":"a1b57d4e9d636b2c44a04e6108060ec10a84694f6f3f3860d3530725f85591b8"}
Sep 09 16:09:33.980589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:33.980568    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qqgc8" event={"ID":"3272770a-bf22-4f01-b755-490c20dc8cad","Type":"ContainerStarted","Data":"c273e53c1882b17af368cd5274b5f7fab9764c6ed7d42fa9e9a70db64711a951"}
Sep 09 16:09:33.980697 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:33.980688    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:09:34.007144 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:34.007103    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vqsxq" podStartSLOduration=65.10052534 podStartE2EDuration="1m11.007089937s" totalImagesPullingTime="5.906564597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:33.992908241 +0000 UTC m=+71.763999488" watchObservedRunningTime="2026-09-09 16:09:34.007089937 +0000 UTC m=+71.778181216"
Sep 09 16:09:34.007261 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:34.007242    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qqgc8" podStartSLOduration=65.397881952 podStartE2EDuration="1m11.007236421s" totalImagesPullingTime="5.609354469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:09:34.006358882 +0000 UTC m=+71.777450128" watchObservedRunningTime="2026-09-09 16:09:34.007236421 +0000 UTC m=+71.778327715"
Sep 09 16:09:44.331805 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:44.331737    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:44.428952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:44.428918    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:45.838386 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:45.838254    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:47.143119 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:47.143086    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:09:59.969263 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:59.969215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:09:59.969699 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:09:59.969273    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:09:59.969699 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:59.969365    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:09:59.969699 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:59.969403    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:09:59.969699 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:59.969432    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:09:59.969699 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:59.969421    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:11:03.969407309 +0000 UTC m=+161.740498532 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:09:59.969699 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:09:59.969511    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:11:03.969492108 +0000 UTC m=+161.740583332 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:10:04.984909 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:10:04.984877    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qqgc8"
Sep 09 16:10:31.594278 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:10:31.594215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:10:31.594762 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:10:31.594374    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 16:10:31.594762 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:10:31.594453    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:33.594436854 +0000 UTC m=+251.365528079 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : secret "metrics-daemon-secret" not found
Sep 09 16:10:59.084521 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:10:59.084460    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" podUID="5cb7d6f9-896f-4de3-b644-02091a56a39a"
Sep 09 16:10:59.110836 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:10:59.110800    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cmlbz" podUID="ad3d00b2-26db-4cd6-ab74-9a284e6552a6"
Sep 09 16:10:59.184716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:10:59.184692    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:10:59.184843 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:10:59.184692    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:11:00.742795 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:11:00.742729    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:11:04.017065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:11:04.017003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:11:04.017547 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:11:04.017094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:11:04.017547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:11:04.017150    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:11:04.017547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:11:04.017178    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:11:04.017547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:11:04.017189    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96b8bb895-tldfb: secret "image-registry-tls" not found
Sep 09 16:11:04.017547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:11:04.017218    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls podName:ad3d00b2-26db-4cd6-ab74-9a284e6552a6 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:06.01720204 +0000 UTC m=+283.788293268 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls") pod "dns-default-cmlbz" (UID: "ad3d00b2-26db-4cd6-ab74-9a284e6552a6") : secret "dns-default-metrics-tls" not found
Sep 09 16:11:04.017547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:11:04.017235    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls podName:5cb7d6f9-896f-4de3-b644-02091a56a39a nodeName:}" failed. No retries permitted until 2026-09-09 16:13:06.017224594 +0000 UTC m=+283.788315831 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls") pod "image-registry-96b8bb895-tldfb" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a") : secret "image-registry-tls" not found
Sep 09 16:11:15.731075 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:11:15.730980    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:12:10.903469 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:10.903434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:33.629612 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:33.629576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:12:33.629995 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:33.629725    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 16:12:33.629995 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:33.629826    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs podName:1d4dc8b5-2a2a-4d02-9553-13e9b24c7468 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:35.629802365 +0000 UTC m=+373.400893594 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs") pod "network-metrics-daemon-4w9ps" (UID: "1d4dc8b5-2a2a-4d02-9553-13e9b24c7468") : secret "metrics-daemon-secret" not found
Sep 09 16:12:38.323504 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:38.323471    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:51.025211 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.025130    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"]
Sep 09 16:12:51.027926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.027893    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"]
Sep 09 16:12:51.028059 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.028027    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.030560 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.030533    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 16:12:51.030763 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.030746    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm"]
Sep 09 16:12:51.030857 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.030833    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.031911 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.031891    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 16:12:51.031994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.031894    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rf6sk\""
Sep 09 16:12:51.032597 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.032580    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 16:12:51.032675 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.032603    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 16:12:51.033177 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.033162    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-w6mxn"]
Sep 09 16:12:51.033277 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.033264    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm"
Sep 09 16:12:51.033663 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.033517    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tspc7\""
Sep 09 16:12:51.033834 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.033812    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:12:51.033943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.033830    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 16:12:51.033943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.033811    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 16:12:51.033943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.033936    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 16:12:51.035893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.035876    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.036457 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.036440    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ts9b6\""
Sep 09 16:12:51.036533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.036481    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:12:51.036533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.036513    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 16:12:51.038128 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.038113    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 09 16:12:51.038330 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.038316    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 16:12:51.038444 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.038428    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tpmft\""
Sep 09 16:12:51.038640 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.038620    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 09 16:12:51.038640 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.038623    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 16:12:51.046234 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.046209    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"]
Sep 09 16:12:51.047256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.047233    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"]
Sep 09 16:12:51.049910 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.049887    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm"]
Sep 09 16:12:51.050785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.050749    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 09 16:12:51.051271 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.051249    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-w6mxn"]
Sep 09 16:12:51.117711 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.117671    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c2s7d"]
Sep 09 16:12:51.120505 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.120488    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:51.122723 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.122688    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 16:12:51.122858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.122724    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sxkkq\""
Sep 09 16:12:51.122858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.122732    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 16:12:51.124600 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.124578    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"]
Sep 09 16:12:51.127531 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.127511    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.129712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.129672    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k6vq9\""
Sep 09 16:12:51.129712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.129675    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 16:12:51.129878 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.129839    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:12:51.130005 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.129993    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 16:12:51.130318 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.130305    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 16:12:51.132525 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.132504    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c2s7d"]
Sep 09 16:12:51.152496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78278da3-be7a-4082-8193-47bf1351254d-tmp\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.152614 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152518    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v545t\" (UniqueName: \"kubernetes.io/projected/1d3c85a7-c177-44a7-86d1-451e99035b01-kube-api-access-v545t\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.152614 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152550    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78278da3-be7a-4082-8193-47bf1351254d-serving-cert\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.152614 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d3c85a7-c177-44a7-86d1-451e99035b01-serving-cert\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.152723 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j9vs\" (UniqueName: \"kubernetes.io/projected/ba9b17f8-21cf-4855-a0b8-5159396b0900-kube-api-access-2j9vs\") pod \"volume-data-source-validator-695c895bd6-lf7sm\" (UID: \"ba9b17f8-21cf-4855-a0b8-5159396b0900\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm"
Sep 09 16:12:51.152723 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78278da3-be7a-4082-8193-47bf1351254d-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.152723 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152717    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e70db848-4b03-483a-b7a5-5bb1ca178da3-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.152858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78278da3-be7a-4082-8193-47bf1351254d-snapshots\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.152858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152760    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d524\" (UniqueName: \"kubernetes.io/projected/e70db848-4b03-483a-b7a5-5bb1ca178da3-kube-api-access-7d524\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.152858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152796    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d3c85a7-c177-44a7-86d1-451e99035b01-config\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.152858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152816    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78278da3-be7a-4082-8193-47bf1351254d-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.152858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152829    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlc86\" (UniqueName: \"kubernetes.io/projected/78278da3-be7a-4082-8193-47bf1351254d-kube-api-access-rlc86\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.152858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.152848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.158076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.158057    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"]
Sep 09 16:12:51.220487 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.220448    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-jpjpt"]
Sep 09 16:12:51.223368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.223351    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-jpjpt"
Sep 09 16:12:51.225521 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.225500    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zxsqt\""
Sep 09 16:12:51.233134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.233115    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-jpjpt"]
Sep 09 16:12:51.253194 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:51.253299 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e74fbbd-d60f-49f4-a7a9-842799743d6a-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.253299 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253231    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dc19098-673b-4f8e-907c-222c0fa46c18-nginx-conf\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:51.253369 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253303    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78278da3-be7a-4082-8193-47bf1351254d-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.253369 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253333    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d524\" (UniqueName: \"kubernetes.io/projected/e70db848-4b03-483a-b7a5-5bb1ca178da3-kube-api-access-7d524\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.253369 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d3c85a7-c177-44a7-86d1-451e99035b01-config\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.253507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.253507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253394    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e74fbbd-d60f-49f4-a7a9-842799743d6a-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.253507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78278da3-be7a-4082-8193-47bf1351254d-tmp\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.253507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253462    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78278da3-be7a-4082-8193-47bf1351254d-serving-cert\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.253507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d3c85a7-c177-44a7-86d1-451e99035b01-serving-cert\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.253507 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:51.253487    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:51.253820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45rhj\" (UniqueName: \"kubernetes.io/projected/1e74fbbd-d60f-49f4-a7a9-842799743d6a-kube-api-access-45rhj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.253820 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:51.253550    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls podName:e70db848-4b03-483a-b7a5-5bb1ca178da3 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:51.753529485 +0000 UTC m=+269.524620727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-shxqk" (UID: "e70db848-4b03-483a-b7a5-5bb1ca178da3") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:51.253820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j9vs\" (UniqueName: \"kubernetes.io/projected/ba9b17f8-21cf-4855-a0b8-5159396b0900-kube-api-access-2j9vs\") pod \"volume-data-source-validator-695c895bd6-lf7sm\" (UID: \"ba9b17f8-21cf-4855-a0b8-5159396b0900\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm"
Sep 09 16:12:51.253820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e70db848-4b03-483a-b7a5-5bb1ca178da3-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.253820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253640    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78278da3-be7a-4082-8193-47bf1351254d-snapshots\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.253820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253685    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78278da3-be7a-4082-8193-47bf1351254d-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.253820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlc86\" (UniqueName: \"kubernetes.io/projected/78278da3-be7a-4082-8193-47bf1351254d-kube-api-access-rlc86\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.253820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v545t\" (UniqueName: \"kubernetes.io/projected/1d3c85a7-c177-44a7-86d1-451e99035b01-kube-api-access-v545t\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.254222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253933    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78278da3-be7a-4082-8193-47bf1351254d-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.254222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.253960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d3c85a7-c177-44a7-86d1-451e99035b01-config\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.254222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.254165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78278da3-be7a-4082-8193-47bf1351254d-tmp\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.254513 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.254494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78278da3-be7a-4082-8193-47bf1351254d-snapshots\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.254583 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.254548    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78278da3-be7a-4082-8193-47bf1351254d-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.254763 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.254730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e70db848-4b03-483a-b7a5-5bb1ca178da3-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.255928 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.255910    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d3c85a7-c177-44a7-86d1-451e99035b01-serving-cert\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.256027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.256010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78278da3-be7a-4082-8193-47bf1351254d-serving-cert\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.262663 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.262642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d524\" (UniqueName: \"kubernetes.io/projected/e70db848-4b03-483a-b7a5-5bb1ca178da3-kube-api-access-7d524\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.262663 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.262656    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v545t\" (UniqueName: \"kubernetes.io/projected/1d3c85a7-c177-44a7-86d1-451e99035b01-kube-api-access-v545t\") pod \"service-ca-operator-859f94c4b-tv76m\" (UID: \"1d3c85a7-c177-44a7-86d1-451e99035b01\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.262838 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.262731    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j9vs\" (UniqueName: \"kubernetes.io/projected/ba9b17f8-21cf-4855-a0b8-5159396b0900-kube-api-access-2j9vs\") pod \"volume-data-source-validator-695c895bd6-lf7sm\" (UID: \"ba9b17f8-21cf-4855-a0b8-5159396b0900\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm"
Sep 09 16:12:51.263712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.263695    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlc86\" (UniqueName: \"kubernetes.io/projected/78278da3-be7a-4082-8193-47bf1351254d-kube-api-access-rlc86\") pod \"insights-operator-76bcd6ccf5-w6mxn\" (UID: \"78278da3-be7a-4082-8193-47bf1351254d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.316381 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.316319    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:51.349382 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.349364    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"
Sep 09 16:12:51.354522 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.354499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45rhj\" (UniqueName: \"kubernetes.io/projected/1e74fbbd-d60f-49f4-a7a9-842799743d6a-kube-api-access-45rhj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.354616 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.354599    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:51.354651 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.354637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf2c5\" (UniqueName: \"kubernetes.io/projected/77fa5113-4106-423b-af24-890d1779acec-kube-api-access-lf2c5\") pod \"network-check-source-685456655f-jpjpt\" (UID: \"77fa5113-4106-423b-af24-890d1779acec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-jpjpt"
Sep 09 16:12:51.354695 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.354676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e74fbbd-d60f-49f4-a7a9-842799743d6a-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.354730 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.354701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dc19098-673b-4f8e-907c-222c0fa46c18-nginx-conf\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:51.354730 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:51.354717    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:12:51.354838 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.354767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e74fbbd-d60f-49f4-a7a9-842799743d6a-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.354838 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:51.354797    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert podName:2dc19098-673b-4f8e-907c-222c0fa46c18 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:51.854764588 +0000 UTC m=+269.625855825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c2s7d" (UID: "2dc19098-673b-4f8e-907c-222c0fa46c18") : secret "networking-console-plugin-cert" not found
Sep 09 16:12:51.355043 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.355019    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm"
Sep 09 16:12:51.355386 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.355355    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e74fbbd-d60f-49f4-a7a9-842799743d6a-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.355458 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.355384    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dc19098-673b-4f8e-907c-222c0fa46c18-nginx-conf\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:51.356927 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.356906    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e74fbbd-d60f-49f4-a7a9-842799743d6a-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.359611 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.359592    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn"
Sep 09 16:12:51.365162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.365141    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45rhj\" (UniqueName: \"kubernetes.io/projected/1e74fbbd-d60f-49f4-a7a9-842799743d6a-kube-api-access-45rhj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-xlrkw\" (UID: \"1e74fbbd-d60f-49f4-a7a9-842799743d6a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.437212 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.437183    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"
Sep 09 16:12:51.455545 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.455522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf2c5\" (UniqueName: \"kubernetes.io/projected/77fa5113-4106-423b-af24-890d1779acec-kube-api-access-lf2c5\") pod \"network-check-source-685456655f-jpjpt\" (UID: \"77fa5113-4106-423b-af24-890d1779acec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-jpjpt"
Sep 09 16:12:51.466145 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.466118    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf2c5\" (UniqueName: \"kubernetes.io/projected/77fa5113-4106-423b-af24-890d1779acec-kube-api-access-lf2c5\") pod \"network-check-source-685456655f-jpjpt\" (UID: \"77fa5113-4106-423b-af24-890d1779acec\") " pod="openshift-network-diagnostics/network-check-source-685456655f-jpjpt"
Sep 09 16:12:51.531630 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.531587    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-jpjpt"
Sep 09 16:12:51.622449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.622418    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m"]
Sep 09 16:12:51.626499 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:12:51.626471    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3c85a7_c177_44a7_86d1_451e99035b01.slice/crio-f2e7a13fab692be397fc64e065210bb2482445ccdd03b6c5ebf778ba83448401 WatchSource:0}: Error finding container f2e7a13fab692be397fc64e065210bb2482445ccdd03b6c5ebf778ba83448401: Status 404 returned error can't find the container with id f2e7a13fab692be397fc64e065210bb2482445ccdd03b6c5ebf778ba83448401
Sep 09 16:12:51.634401 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.634378    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm"]
Sep 09 16:12:51.636956 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.636928    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-w6mxn"]
Sep 09 16:12:51.638529 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:12:51.638505    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9b17f8_21cf_4855_a0b8_5159396b0900.slice/crio-d9e43528d32ec2f787767a30a1a404dfc6a62656cb90212a3cc8020773ff7ffb WatchSource:0}: Error finding container d9e43528d32ec2f787767a30a1a404dfc6a62656cb90212a3cc8020773ff7ffb: Status 404 returned error can't find the container with id d9e43528d32ec2f787767a30a1a404dfc6a62656cb90212a3cc8020773ff7ffb
Sep 09 16:12:51.639024 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:12:51.639004    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78278da3_be7a_4082_8193_47bf1351254d.slice/crio-77df396b60923fa4e66055597179b4a90ac448e4d128ea1e4f2b9d839a745668 WatchSource:0}: Error finding container 77df396b60923fa4e66055597179b4a90ac448e4d128ea1e4f2b9d839a745668: Status 404 returned error can't find the container with id 77df396b60923fa4e66055597179b4a90ac448e4d128ea1e4f2b9d839a745668
Sep 09 16:12:51.706544 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.706510    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw"]
Sep 09 16:12:51.708948 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:12:51.708921    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e74fbbd_d60f_49f4_a7a9_842799743d6a.slice/crio-39607d40d5c5ffa190ad1af47ca2b8e8513c7528e30224d1d1ad629f402ff4bf WatchSource:0}: Error finding container 39607d40d5c5ffa190ad1af47ca2b8e8513c7528e30224d1d1ad629f402ff4bf: Status 404 returned error can't find the container with id 39607d40d5c5ffa190ad1af47ca2b8e8513c7528e30224d1d1ad629f402ff4bf
Sep 09 16:12:51.758763 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.758732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:51.758912 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:51.758872    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:51.758973 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:51.758922    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls podName:e70db848-4b03-483a-b7a5-5bb1ca178da3 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:52.758909821 +0000 UTC m=+270.530001045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-shxqk" (UID: "e70db848-4b03-483a-b7a5-5bb1ca178da3") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:51.799528 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.799503    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-jpjpt"]
Sep 09 16:12:51.802207 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:12:51.802182    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77fa5113_4106_423b_af24_890d1779acec.slice/crio-20404896870b6b1783fd0bea145e147ac01f8f17c68103db49469171a98ffe01 WatchSource:0}: Error finding container 20404896870b6b1783fd0bea145e147ac01f8f17c68103db49469171a98ffe01: Status 404 returned error can't find the container with id 20404896870b6b1783fd0bea145e147ac01f8f17c68103db49469171a98ffe01
Sep 09 16:12:51.859592 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:51.859571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:51.859702 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:51.859681    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:12:51.859744 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:51.859722    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert podName:2dc19098-673b-4f8e-907c-222c0fa46c18 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:52.859709914 +0000 UTC m=+270.630801137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c2s7d" (UID: "2dc19098-673b-4f8e-907c-222c0fa46c18") : secret "networking-console-plugin-cert" not found
Sep 09 16:12:52.447956 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.447919    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-jpjpt" event={"ID":"77fa5113-4106-423b-af24-890d1779acec","Type":"ContainerStarted","Data":"761931336a32d46948cbf65c4bb11b36aeed67ddbc5168a2ea2d2db8a78789cf"}
Sep 09 16:12:52.448398 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.448016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-jpjpt" event={"ID":"77fa5113-4106-423b-af24-890d1779acec","Type":"ContainerStarted","Data":"20404896870b6b1783fd0bea145e147ac01f8f17c68103db49469171a98ffe01"}
Sep 09 16:12:52.449425 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.449383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m" event={"ID":"1d3c85a7-c177-44a7-86d1-451e99035b01","Type":"ContainerStarted","Data":"f2e7a13fab692be397fc64e065210bb2482445ccdd03b6c5ebf778ba83448401"}
Sep 09 16:12:52.450665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.450628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn" event={"ID":"78278da3-be7a-4082-8193-47bf1351254d","Type":"ContainerStarted","Data":"77df396b60923fa4e66055597179b4a90ac448e4d128ea1e4f2b9d839a745668"}
Sep 09 16:12:52.451974 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.451947    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw" event={"ID":"1e74fbbd-d60f-49f4-a7a9-842799743d6a","Type":"ContainerStarted","Data":"39607d40d5c5ffa190ad1af47ca2b8e8513c7528e30224d1d1ad629f402ff4bf"}
Sep 09 16:12:52.453079 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.453055    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm" event={"ID":"ba9b17f8-21cf-4855-a0b8-5159396b0900","Type":"ContainerStarted","Data":"d9e43528d32ec2f787767a30a1a404dfc6a62656cb90212a3cc8020773ff7ffb"}
Sep 09 16:12:52.463275 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.463028    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-jpjpt" podStartSLOduration=1.4630120180000001 podStartE2EDuration="1.463012018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:12:52.462878927 +0000 UTC m=+270.233970190" watchObservedRunningTime="2026-09-09 16:12:52.463012018 +0000 UTC m=+270.234103266"
Sep 09 16:12:52.647590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.647555    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:52.766991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.766885    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:52.767161 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:52.767026    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:52.767161 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:52.767107    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls podName:e70db848-4b03-483a-b7a5-5bb1ca178da3 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:54.767085867 +0000 UTC m=+272.538177095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-shxqk" (UID: "e70db848-4b03-483a-b7a5-5bb1ca178da3") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:52.868309 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:52.868268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:52.868466 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:52.868449    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:12:52.868564 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:52.868535    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert podName:2dc19098-673b-4f8e-907c-222c0fa46c18 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:54.868512577 +0000 UTC m=+272.639603824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c2s7d" (UID: "2dc19098-673b-4f8e-907c-222c0fa46c18") : secret "networking-console-plugin-cert" not found
Sep 09 16:12:53.457508 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:53.457471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm" event={"ID":"ba9b17f8-21cf-4855-a0b8-5159396b0900","Type":"ContainerStarted","Data":"b40bee042928139fc74fb42966e7ccddd9e3fb08f165f770681317d0f6132429"}
Sep 09 16:12:53.472933 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:53.472886    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lf7sm" podStartSLOduration=1.217047513 podStartE2EDuration="2.47286761s" totalImagesPullingTime="1.255820097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:12:53.4716104 +0000 UTC m=+271.242701647" watchObservedRunningTime="2026-09-09 16:12:53.47286761 +0000 UTC m=+271.243958856"
Sep 09 16:12:53.548478 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:53.548445    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:53.610347 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:53.610311    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:54.463954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:54.463881    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw" event={"ID":"1e74fbbd-d60f-49f4-a7a9-842799743d6a","Type":"ContainerStarted","Data":"d3407b55f7fc6c176a1b6f0da70aaccff01c80a0e6b0b53b8fa494c9989f1cbc"}
Sep 09 16:12:54.479367 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:54.479072    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw" podStartSLOduration=1.199124928 podStartE2EDuration="3.479050475s" totalImagesPullingTime="2.279925547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:12:54.478577745 +0000 UTC m=+272.249668993" watchObservedRunningTime="2026-09-09 16:12:54.479050475 +0000 UTC m=+272.250141722"
Sep 09 16:12:54.788049 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:54.787960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:54.788200 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:54.788086    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:54.788200 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:54.788163    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls podName:e70db848-4b03-483a-b7a5-5bb1ca178da3 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:58.788143367 +0000 UTC m=+276.559234604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-shxqk" (UID: "e70db848-4b03-483a-b7a5-5bb1ca178da3") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:54.889267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:54.889049    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:54.889447 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:54.889281    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:12:54.889447 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:54.889347    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert podName:2dc19098-673b-4f8e-907c-222c0fa46c18 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:58.889328763 +0000 UTC m=+276.660419988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c2s7d" (UID: "2dc19098-673b-4f8e-907c-222c0fa46c18") : secret "networking-console-plugin-cert" not found
Sep 09 16:12:55.951797 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:55.951727    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:55.960491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:55.960459    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2"]
Sep 09 16:12:55.964248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:55.964223    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2"
Sep 09 16:12:55.966644 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:55.966617    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 16:12:55.966803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:55.966767    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hv48j\""
Sep 09 16:12:55.967450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:55.967427    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 16:12:55.972766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:55.972741    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2"]
Sep 09 16:12:55.998028 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:55.997997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r979l\" (UniqueName: \"kubernetes.io/projected/03592906-9343-483f-9448-a8caaa7b59ea-kube-api-access-r979l\") pod \"migrator-fdbb8fdff-27cl2\" (UID: \"03592906-9343-483f-9448-a8caaa7b59ea\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2"
Sep 09 16:12:56.044430 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.044398    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:56.098431 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.098407    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r979l\" (UniqueName: \"kubernetes.io/projected/03592906-9343-483f-9448-a8caaa7b59ea-kube-api-access-r979l\") pod \"migrator-fdbb8fdff-27cl2\" (UID: \"03592906-9343-483f-9448-a8caaa7b59ea\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2"
Sep 09 16:12:56.106152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.106127    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r979l\" (UniqueName: \"kubernetes.io/projected/03592906-9343-483f-9448-a8caaa7b59ea-kube-api-access-r979l\") pod \"migrator-fdbb8fdff-27cl2\" (UID: \"03592906-9343-483f-9448-a8caaa7b59ea\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2"
Sep 09 16:12:56.145007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.144970    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:56.275027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.274943    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2"
Sep 09 16:12:56.473115 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.473063    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m" event={"ID":"1d3c85a7-c177-44a7-86d1-451e99035b01","Type":"ContainerStarted","Data":"b46d6a297e3f20b76774851a48a2d0049fcbcc62047bffa175cebbb9df066bd3"}
Sep 09 16:12:56.474636 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.474609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn" event={"ID":"78278da3-be7a-4082-8193-47bf1351254d","Type":"ContainerStarted","Data":"3e74f2177c8a3fcbc6f92d03a6f78a7dfcc42b7ea3ee4c57f3c05c1b578665d7"}
Sep 09 16:12:56.488898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.488844    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m" podStartSLOduration=1.060035832 podStartE2EDuration="5.488825369s" totalImagesPullingTime="4.428789537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:12:56.48703581 +0000 UTC m=+274.258127057" watchObservedRunningTime="2026-09-09 16:12:56.488825369 +0000 UTC m=+274.259916616"
Sep 09 16:12:56.505093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.504866    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn" podStartSLOduration=1.091965363 podStartE2EDuration="5.50484801s" totalImagesPullingTime="4.412882647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:12:56.503727795 +0000 UTC m=+274.274819043" watchObservedRunningTime="2026-09-09 16:12:56.50484801 +0000 UTC m=+274.275939259"
Sep 09 16:12:56.545191 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:56.545114    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2"]
Sep 09 16:12:56.548475 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:12:56.548451    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03592906_9343_483f_9448_a8caaa7b59ea.slice/crio-6182c0e0f79eeb45cbf5d3a8088d5aed2fa5f6dfab193cc52110f7c5083329af WatchSource:0}: Error finding container 6182c0e0f79eeb45cbf5d3a8088d5aed2fa5f6dfab193cc52110f7c5083329af: Status 404 returned error can't find the container with id 6182c0e0f79eeb45cbf5d3a8088d5aed2fa5f6dfab193cc52110f7c5083329af
Sep 09 16:12:57.176097 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.176067    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k59c2"]
Sep 09 16:12:57.180606 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.180584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.183183 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.183156    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rd78t\""
Sep 09 16:12:57.183332 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.183314    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 16:12:57.183989 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.183972    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 16:12:57.188004 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.187901    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k59c2"]
Sep 09 16:12:57.208071 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.208044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.208186 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.208080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a83495-fd18-446f-aa7b-cafcfba2d846-data-volume\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.208186 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.208160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67a83495-fd18-446f-aa7b-cafcfba2d846-crio-socket\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.208290 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.208269    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xzbs\" (UniqueName: \"kubernetes.io/projected/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-api-access-2xzbs\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.208353 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.208336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.309116 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.309078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzbs\" (UniqueName: \"kubernetes.io/projected/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-api-access-2xzbs\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.309300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.309238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.309375 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.309325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.309375 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.309350    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a83495-fd18-446f-aa7b-cafcfba2d846-data-volume\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.309479 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:57.309396    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:12:57.309479 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.309417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67a83495-fd18-446f-aa7b-cafcfba2d846-crio-socket\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.309479 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:57.309466    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:57.809446138 +0000 UTC m=+275.580537381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:12:57.309594 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:57.309501    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:12:57.309594 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:57.309551    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:57.809537907 +0000 UTC m=+275.580629142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : configmap "kube-rbac-proxy" not found
Sep 09 16:12:57.309594 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.309505    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67a83495-fd18-446f-aa7b-cafcfba2d846-crio-socket\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.309803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.309765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a83495-fd18-446f-aa7b-cafcfba2d846-data-volume\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.317807 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.317756    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xzbs\" (UniqueName: \"kubernetes.io/projected/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-api-access-2xzbs\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.479798 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.479676    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2" event={"ID":"03592906-9343-483f-9448-a8caaa7b59ea","Type":"ContainerStarted","Data":"6182c0e0f79eeb45cbf5d3a8088d5aed2fa5f6dfab193cc52110f7c5083329af"}
Sep 09 16:12:57.813349 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.813252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.813517 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:57.813420    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:12:57.813517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:57.813440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:57.813517 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:57.813493    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:58.81347218 +0000 UTC m=+276.584563417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:12:57.813691 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:57.813526    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:12:57.813691 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:57.813573    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:12:58.813560565 +0000 UTC m=+276.584651788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : configmap "kube-rbac-proxy" not found
Sep 09 16:12:58.484259 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:58.484221    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2" event={"ID":"03592906-9343-483f-9448-a8caaa7b59ea","Type":"ContainerStarted","Data":"184cd6e7d211033472ec2a2b64ccddb00be593053e649773c64a53088d2b1959"}
Sep 09 16:12:58.484624 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:58.484282    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2" event={"ID":"03592906-9343-483f-9448-a8caaa7b59ea","Type":"ContainerStarted","Data":"aa33abfb3885616fe978288dd56b7e9ba63ccc79398a92ca12668135f748841c"}
Sep 09 16:12:58.504378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:58.502299    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-27cl2" podStartSLOduration=2.088229416 podStartE2EDuration="3.502277597s" totalImagesPullingTime="1.414048181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:12:58.499563409 +0000 UTC m=+276.270654672" watchObservedRunningTime="2026-09-09 16:12:58.502277597 +0000 UTC m=+276.273368846"
Sep 09 16:12:58.822385 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:58.822306    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:58.822385 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:58.822368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:12:58.822547 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:58.822390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:12:58.822547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:58.822453    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:12:58.822547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:58.822484    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:58.822547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:58.822514    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:00.822498536 +0000 UTC m=+278.593589774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:12:58.822547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:58.822515    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:12:58.822547 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:58.822528    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls podName:e70db848-4b03-483a-b7a5-5bb1ca178da3 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:06.822522265 +0000 UTC m=+284.593613490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-shxqk" (UID: "e70db848-4b03-483a-b7a5-5bb1ca178da3") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:12:58.822734 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:58.822565    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:00.822548435 +0000 UTC m=+278.593639659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : configmap "kube-rbac-proxy" not found
Sep 09 16:12:58.922893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:58.922858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:12:58.923054 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:58.923012    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:12:58.923119 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:12:58.923083    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert podName:2dc19098-673b-4f8e-907c-222c0fa46c18 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:06.923063338 +0000 UTC m=+284.694154563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c2s7d" (UID: "2dc19098-673b-4f8e-907c-222c0fa46c18") : secret "networking-console-plugin-cert" not found
Sep 09 16:12:59.084164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:59.084096    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:12:59.186072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:12:59.186037    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:00.146213 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.146184    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mc4sp_57d8707f-7f36-4b05-b159-83a6d3bf2987/dns-node-resolver/0.log"
Sep 09 16:13:00.341068 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.341031    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-fgc6m"]
Sep 09 16:13:00.344161 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.344139    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.346289 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.346264    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 09 16:13:00.346449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.346434    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 09 16:13:00.347311 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.347290    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kdprp\""
Sep 09 16:13:00.347402 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.347291    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 09 16:13:00.347402 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.347330    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 09 16:13:00.351332 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.351314    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-fgc6m"]
Sep 09 16:13:00.374682 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.374662    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:00.434159 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.434103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxcbd\" (UniqueName: \"kubernetes.io/projected/988e7574-1c55-4da9-9b71-55a56c11d998-kube-api-access-xxcbd\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.434242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.434170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/988e7574-1c55-4da9-9b71-55a56c11d998-signing-cabundle\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.434242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.434226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/988e7574-1c55-4da9-9b71-55a56c11d998-signing-key\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.441012 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.440991    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:00.535087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.535064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/988e7574-1c55-4da9-9b71-55a56c11d998-signing-cabundle\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.535206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.535103    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/988e7574-1c55-4da9-9b71-55a56c11d998-signing-key\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.535263 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.535245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxcbd\" (UniqueName: \"kubernetes.io/projected/988e7574-1c55-4da9-9b71-55a56c11d998-kube-api-access-xxcbd\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.535710 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.535682    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/988e7574-1c55-4da9-9b71-55a56c11d998-signing-cabundle\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.537522 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.537505    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/988e7574-1c55-4da9-9b71-55a56c11d998-signing-key\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.542870 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.542847    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxcbd\" (UniqueName: \"kubernetes.io/projected/988e7574-1c55-4da9-9b71-55a56c11d998-kube-api-access-xxcbd\") pod \"service-ca-75d99c484-fgc6m\" (UID: \"988e7574-1c55-4da9-9b71-55a56c11d998\") " pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.653281 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.653242    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-fgc6m"
Sep 09 16:13:00.837246 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.837213    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:00.837371 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.837278    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:00.837371 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:00.837319    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:13:00.837432 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:00.837373    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:13:00.837432 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:00.837380    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:04.83736325 +0000 UTC m=+282.608454474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:13:00.837432 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:00.837416    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:04.837404965 +0000 UTC m=+282.608496207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : configmap "kube-rbac-proxy" not found
Sep 09 16:13:00.919514 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:00.919353    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-fgc6m"]
Sep 09 16:13:00.921753 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:00.921720    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988e7574_1c55_4da9_9b71_55a56c11d998.slice/crio-34e39e403f576e5b3acc6a64ed3b5b66cc079d7459cfcc71dffb5e5c2bfa442d WatchSource:0}: Error finding container 34e39e403f576e5b3acc6a64ed3b5b66cc079d7459cfcc71dffb5e5c2bfa442d: Status 404 returned error can't find the container with id 34e39e403f576e5b3acc6a64ed3b5b66cc079d7459cfcc71dffb5e5c2bfa442d
Sep 09 16:13:01.145188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:01.145163    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvjw4_d299899c-8552-439f-a03d-0d643d9a3268/node-ca/0.log"
Sep 09 16:13:01.275716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:01.275626    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:01.496238 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:01.496205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-fgc6m" event={"ID":"988e7574-1c55-4da9-9b71-55a56c11d998","Type":"ContainerStarted","Data":"ac8fa65250a3e447cac3fc5f620c1c65875db8c98ef507923baf86cc5d900d87"}
Sep 09 16:13:01.496419 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:01.496254    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-fgc6m" event={"ID":"988e7574-1c55-4da9-9b71-55a56c11d998","Type":"ContainerStarted","Data":"34e39e403f576e5b3acc6a64ed3b5b66cc079d7459cfcc71dffb5e5c2bfa442d"}
Sep 09 16:13:01.547070 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:01.546976    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-fgc6m" podStartSLOduration=1.546959583 podStartE2EDuration="1.546959583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:01.546025221 +0000 UTC m=+279.317116467" watchObservedRunningTime="2026-09-09 16:13:01.546959583 +0000 UTC m=+279.318050877"
Sep 09 16:13:01.554304 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:01.554283    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gz8f_da78760a-b579-4a43-83cf-0a0f0a7bd11c/serve-healthcheck-canary/0.log"
Sep 09 16:13:02.146522 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:02.146494    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-27cl2_03592906-9343-483f-9448-a8caaa7b59ea/migrator/0.log"
Sep 09 16:13:02.186233 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:02.186199    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" podUID="5cb7d6f9-896f-4de3-b644-02091a56a39a"
Sep 09 16:13:02.186390 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:02.186199    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cmlbz" podUID="ad3d00b2-26db-4cd6-ab74-9a284e6552a6"
Sep 09 16:13:02.294180 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:02.294149    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:02.345571 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:02.345540    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-27cl2_03592906-9343-483f-9448-a8caaa7b59ea/graceful-termination/0.log"
Sep 09 16:13:02.500443 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:02.500354    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:13:02.500595 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:02.500362    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:13:02.546482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:02.546453    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-xlrkw_1e74fbbd-d60f-49f4-a7a9-842799743d6a/kube-storage-version-migrator-operator/0.log"
Sep 09 16:13:03.547189 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:03.547155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:03.646640 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:03.646598    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:03.711646 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:03.711619    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:04.870274 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:04.870240    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:04.870735 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:04.870301    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:04.870735 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:04.870374    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:13:04.870735 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:04.870401    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:13:04.870735 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:04.870438    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:12.870422738 +0000 UTC m=+290.641513965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:13:04.870735 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:04.870452    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm podName:67a83495-fd18-446f-aa7b-cafcfba2d846 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:12.87044645 +0000 UTC m=+290.641537674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k59c2" (UID: "67a83495-fd18-446f-aa7b-cafcfba2d846") : configmap "kube-rbac-proxy" not found
Sep 09 16:13:05.860221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:05.860191    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:05.919466 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:05.919435    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:05.987289 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:05.987256    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:06.037712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.037671    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:06.079864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.079832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:13:06.079992 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.079976    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:13:06.082170 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.082147    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad3d00b2-26db-4cd6-ab74-9a284e6552a6-metrics-tls\") pod \"dns-default-cmlbz\" (UID: \"ad3d00b2-26db-4cd6-ab74-9a284e6552a6\") " pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:13:06.082316 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.082300    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"image-registry-96b8bb895-tldfb\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") " pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:13:06.104533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.104509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jv6x\""
Sep 09 16:13:06.104533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.104528    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgn4p\""
Sep 09 16:13:06.112000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.111944    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:13:06.112083 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.112033    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:13:06.183637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.183591    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:06.385689 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.385657    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:06.397053 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.397024    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmlbz"]
Sep 09 16:13:06.399855 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.399811    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96b8bb895-tldfb"]
Sep 09 16:13:06.400896 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:06.400868    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3d00b2_26db_4cd6_ab74_9a284e6552a6.slice/crio-92314eaa9d09c06468fc5cb45c5fe142f77f18c642feb5071a2d8c621d4e95a2 WatchSource:0}: Error finding container 92314eaa9d09c06468fc5cb45c5fe142f77f18c642feb5071a2d8c621d4e95a2: Status 404 returned error can't find the container with id 92314eaa9d09c06468fc5cb45c5fe142f77f18c642feb5071a2d8c621d4e95a2
Sep 09 16:13:06.402384 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:06.402343    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb7d6f9_896f_4de3_b644_02091a56a39a.slice/crio-f2490bf32539cfa57cf285ebd067ccf6c968b9503596a39af521bef9e72d85fc WatchSource:0}: Error finding container f2490bf32539cfa57cf285ebd067ccf6c968b9503596a39af521bef9e72d85fc: Status 404 returned error can't find the container with id f2490bf32539cfa57cf285ebd067ccf6c968b9503596a39af521bef9e72d85fc
Sep 09 16:13:06.514210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.514170    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmlbz" event={"ID":"ad3d00b2-26db-4cd6-ab74-9a284e6552a6","Type":"ContainerStarted","Data":"92314eaa9d09c06468fc5cb45c5fe142f77f18c642feb5071a2d8c621d4e95a2"}
Sep 09 16:13:06.515910 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.515882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" event={"ID":"5cb7d6f9-896f-4de3-b644-02091a56a39a","Type":"ContainerStarted","Data":"7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8"}
Sep 09 16:13:06.516025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.515930    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" event={"ID":"5cb7d6f9-896f-4de3-b644-02091a56a39a","Type":"ContainerStarted","Data":"f2490bf32539cfa57cf285ebd067ccf6c968b9503596a39af521bef9e72d85fc"}
Sep 09 16:13:06.516025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.515972    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:13:06.536860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.536810    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" podStartSLOduration=262.536794981 podStartE2EDuration="4m22.536794981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:06.535671699 +0000 UTC m=+284.306762945" watchObservedRunningTime="2026-09-09 16:13:06.536794981 +0000 UTC m=+284.307886229"
Sep 09 16:13:06.587949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.587918    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:06.746378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.746293    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:06.805722 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.805686    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:06.890273 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.890238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:13:06.890490 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:06.890360    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:13:06.890490 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:06.890419    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls podName:e70db848-4b03-483a-b7a5-5bb1ca178da3 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:22.890406469 +0000 UTC m=+300.661497692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-shxqk" (UID: "e70db848-4b03-483a-b7a5-5bb1ca178da3") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:13:06.984817 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.984764    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:06.991009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:06.990969    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:13:06.991114 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:06.991091    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:13:06.991165 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:06.991140    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert podName:2dc19098-673b-4f8e-907c-222c0fa46c18 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:22.991127364 +0000 UTC m=+300.762218612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c2s7d" (UID: "2dc19098-673b-4f8e-907c-222c0fa46c18") : secret "networking-console-plugin-cert" not found
Sep 09 16:13:07.784820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:07.784783    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:08.380571 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:08.380529    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:08.654022 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:08.653941    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:08.789630 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:08.789599    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:08.862086 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:08.862055    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:09.137753 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:09.137724    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:09.236723 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:09.236682    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:09.790738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:09.790705    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:10.188542 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:10.188507    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:10.403690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:10.403660    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:10.533450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:10.533358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmlbz" event={"ID":"ad3d00b2-26db-4cd6-ab74-9a284e6552a6","Type":"ContainerStarted","Data":"9ac05b7681076f2e7acd7d94b9d181cc6a604c72a346378ec641e9ce36dc078d"}
Sep 09 16:13:10.533450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:10.533407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmlbz" event={"ID":"ad3d00b2-26db-4cd6-ab74-9a284e6552a6","Type":"ContainerStarted","Data":"51fe060acdbd41a017d14d3ddf6462ad7b1b1e68f6675f37dbf27bbb58050569"}
Sep 09 16:13:10.533633 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:10.533469    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:13:10.565600 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:10.565551    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cmlbz" podStartSLOduration=250.807280375 podStartE2EDuration="4m14.565536285s" totalImagesPullingTime="3.75825591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:10.56472913 +0000 UTC m=+288.335820387" watchObservedRunningTime="2026-09-09 16:13:10.565536285 +0000 UTC m=+288.336627530"
Sep 09 16:13:10.988418 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:10.988377    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:11.387373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:11.387342    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:11.591495 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:11.591462    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:11.983518 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:11.983491    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:12.616762 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:12.616729    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:12.792543 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:12.792493    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:12.940477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:12.940441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:12.940652 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:12.940501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:12.940988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:12.940972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67a83495-fd18-446f-aa7b-cafcfba2d846-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:12.942831 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:12.942812    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67a83495-fd18-446f-aa7b-cafcfba2d846-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k59c2\" (UID: \"67a83495-fd18-446f-aa7b-cafcfba2d846\") " pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:12.985485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:12.985449    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:13.090801 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:13.090753    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k59c2"
Sep 09 16:13:13.226587 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:13.226480    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:13.362282 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:13.362164    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k59c2"]
Sep 09 16:13:13.364878 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:13.364851    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a83495_fd18_446f_aa7b_cafcfba2d846.slice/crio-015d4e69a756ad7df722ba16ba41857955a13205d2bf0c9b331d0fcbd4c8663d WatchSource:0}: Error finding container 015d4e69a756ad7df722ba16ba41857955a13205d2bf0c9b331d0fcbd4c8663d: Status 404 returned error can't find the container with id 015d4e69a756ad7df722ba16ba41857955a13205d2bf0c9b331d0fcbd4c8663d
Sep 09 16:13:13.544876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:13.544805    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k59c2" event={"ID":"67a83495-fd18-446f-aa7b-cafcfba2d846","Type":"ContainerStarted","Data":"d50d781c751a61a483389865877ad6c38049e7a88a143def482abaa8dd38705d"}
Sep 09 16:13:13.544876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:13.544857    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k59c2" event={"ID":"67a83495-fd18-446f-aa7b-cafcfba2d846","Type":"ContainerStarted","Data":"015d4e69a756ad7df722ba16ba41857955a13205d2bf0c9b331d0fcbd4c8663d"}
Sep 09 16:13:14.549403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:14.549367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k59c2" event={"ID":"67a83495-fd18-446f-aa7b-cafcfba2d846","Type":"ContainerStarted","Data":"0df9a60d344879562f20cbcc38723b7475abc3537f602666af0c8e9cff9f52a6"}
Sep 09 16:13:16.558678 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:16.558647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k59c2" event={"ID":"67a83495-fd18-446f-aa7b-cafcfba2d846","Type":"ContainerStarted","Data":"7ad045dd12c6dabf2a2b9e35a77b716759ebe8fb32204b28fdbf0d67aa034342"}
Sep 09 16:13:16.576717 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:16.576666    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k59c2" podStartSLOduration=17.309743482000002 podStartE2EDuration="19.57665028s" totalImagesPullingTime="2.266906798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:12:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:16.575421716 +0000 UTC m=+294.346512961" watchObservedRunningTime="2026-09-09 16:13:16.57665028 +0000 UTC m=+294.347741527"
Sep 09 16:13:17.726747 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:17.726714    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:17.827657 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:17.827626    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:18.731821 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:18.731757    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4w9ps" podUID="1d4dc8b5-2a2a-4d02-9553-13e9b24c7468"
Sep 09 16:13:20.539227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:20.539195    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cmlbz"
Sep 09 16:13:20.912839 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:20.912806    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:21.021631 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:21.021602    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:22.657420 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:22.657394    2567 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 16:13:22.916744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:22.916662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:13:22.918931 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:22.918908    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e70db848-4b03-483a-b7a5-5bb1ca178da3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-shxqk\" (UID: \"e70db848-4b03-483a-b7a5-5bb1ca178da3\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:13:23.017795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.017752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:13:23.019888 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.019861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dc19098-673b-4f8e-907c-222c0fa46c18-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c2s7d\" (UID: \"2dc19098-673b-4f8e-907c-222c0fa46c18\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:13:23.141887 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.141854    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rf6sk\""
Sep 09 16:13:23.149993 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.149973    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"
Sep 09 16:13:23.231918 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.231888    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sxkkq\""
Sep 09 16:13:23.239846 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.239830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d"
Sep 09 16:13:23.415517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.415493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk"]
Sep 09 16:13:23.417767 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:23.417744    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70db848_4b03_483a_b7a5_5bb1ca178da3.slice/crio-c16cc7fcd75707560cd5e472b4baf8b44adf0f42575f984c1761fb20271c3e11 WatchSource:0}: Error finding container c16cc7fcd75707560cd5e472b4baf8b44adf0f42575f984c1761fb20271c3e11: Status 404 returned error can't find the container with id c16cc7fcd75707560cd5e472b4baf8b44adf0f42575f984c1761fb20271c3e11
Sep 09 16:13:23.507169 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.507101    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c2s7d"]
Sep 09 16:13:23.510134 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:23.510112    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc19098_673b_4f8e_907c_222c0fa46c18.slice/crio-a197095566405f3e12b8edc0f3df1c2a2a6a0b116eed8cd2bb608870fdfc2133 WatchSource:0}: Error finding container a197095566405f3e12b8edc0f3df1c2a2a6a0b116eed8cd2bb608870fdfc2133: Status 404 returned error can't find the container with id a197095566405f3e12b8edc0f3df1c2a2a6a0b116eed8cd2bb608870fdfc2133
Sep 09 16:13:23.582117 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.582083    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk" event={"ID":"e70db848-4b03-483a-b7a5-5bb1ca178da3","Type":"ContainerStarted","Data":"c16cc7fcd75707560cd5e472b4baf8b44adf0f42575f984c1761fb20271c3e11"}
Sep 09 16:13:23.583142 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:23.583121    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d" event={"ID":"2dc19098-673b-4f8e-907c-222c0fa46c18","Type":"ContainerStarted","Data":"a197095566405f3e12b8edc0f3df1c2a2a6a0b116eed8cd2bb608870fdfc2133"}
Sep 09 16:13:25.590962 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:25.590929    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk" event={"ID":"e70db848-4b03-483a-b7a5-5bb1ca178da3","Type":"ContainerStarted","Data":"751ae17aa8f08e2b7f9f86e5b0dac761af153b2fedf5ca39924b36c0f6dc4e2e"}
Sep 09 16:13:25.592455 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:25.592428    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d" event={"ID":"2dc19098-673b-4f8e-907c-222c0fa46c18","Type":"ContainerStarted","Data":"571c5b66b21b065d6c9ae32cba0f95e58d3c523e8ee70516e1a3f781a730c24e"}
Sep 09 16:13:25.607685 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:25.607641    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-shxqk" podStartSLOduration=32.634970827 podStartE2EDuration="34.607627837s" totalImagesPullingTime="1.97265701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:25.60681817 +0000 UTC m=+303.377909416" watchObservedRunningTime="2026-09-09 16:13:25.607627837 +0000 UTC m=+303.378719083"
Sep 09 16:13:25.620438 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:25.620395    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-c2s7d" podStartSLOduration=33.435799124 podStartE2EDuration="34.620380116s" totalImagesPullingTime="1.184580992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:25.620348334 +0000 UTC m=+303.391439580" watchObservedRunningTime="2026-09-09 16:13:25.620380116 +0000 UTC m=+303.391471363"
Sep 09 16:13:25.713786 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:25.713676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:26.116123 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:26.116036    2567 patch_prober.go:28] interesting pod/image-registry-96b8bb895-tldfb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 16:13:26.116123 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:26.116103    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" podUID="5cb7d6f9-896f-4de3-b644-02091a56a39a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:13:27.523767 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:27.523737    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:13:27.549399 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:27.549368    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:27.814541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:27.814435    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:27.986496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:27.986447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:28.077452 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:28.077376    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:29.942752 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:29.942707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:30.042063 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:30.042028    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:31.916669 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:31.916629    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:31.980172 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:31.980117    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:32.134320 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:32.134285    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:32.713145 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:32.713103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:32.736459 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:32.732943    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:13:32.780677 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:32.780647    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:35.012448 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:35.012397    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:37.044040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.043992    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:37.291809 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.291739    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:37.338707 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.338627    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"]
Sep 09 16:13:37.341718 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.341696    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.344072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.344045    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 16:13:37.344328 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.344304    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dl67l"]
Sep 09 16:13:37.344605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.344584    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9hx88\""
Sep 09 16:13:37.345020 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.345005    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 16:13:37.345393 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.345371    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 16:13:37.345487 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.345428    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 16:13:37.347076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.347055    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.350243 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.350175    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 16:13:37.350243 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.350180    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 16:13:37.350243 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.350222    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9hbdg\""
Sep 09 16:13:37.350763 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.350745    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 16:13:37.395075 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.395051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:37.400933 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.400907    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"]
Sep 09 16:13:37.430502 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-tls\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.430649 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-accelerators-collector-config\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.430649 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.430649 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-root\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.430766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.430766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430712    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-sys\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.430766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e6d0cb-8051-4bdb-a223-aff107b4a725-metrics-client-ca\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.430890 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.430890 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-wtmp\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.430890 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.430991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.430991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-textfile\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.430991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxph\" (UniqueName: \"kubernetes.io/projected/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-api-access-8zxph\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.430991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.430989    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.431133 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.431011    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q68l8\" (UniqueName: \"kubernetes.io/projected/03e6d0cb-8051-4bdb-a223-aff107b4a725-kube-api-access-q68l8\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.488295 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.488264    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:37.531905 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.531871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-sys\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.531918    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e6d0cb-8051-4bdb-a223-aff107b4a725-metrics-client-ca\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.531957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.532132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.531985    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-wtmp\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.532132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532044    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.532132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532095    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-textfile\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxph\" (UniqueName: \"kubernetes.io/projected/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-api-access-8zxph\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.532475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.532475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532177    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q68l8\" (UniqueName: \"kubernetes.io/projected/03e6d0cb-8051-4bdb-a223-aff107b4a725-kube-api-access-q68l8\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532203    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-tls\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532230    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-accelerators-collector-config\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-root\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.532475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.532325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.533124 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.533102    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.533190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.533177    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-sys\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.533658 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.533640    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e6d0cb-8051-4bdb-a223-aff107b4a725-metrics-client-ca\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.534365 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.534341    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.534495 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.534477    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-wtmp\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.534583 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:37.534567    2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 09 16:13:37.534648 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:37.534634    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-tls podName:3a16b8c7-e17b-4877-ae7a-b49e90ce59f6 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:38.034615988 +0000 UTC m=+315.805707214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-f7mw5" (UID: "3a16b8c7-e17b-4877-ae7a-b49e90ce59f6") : secret "kube-state-metrics-tls" not found
Sep 09 16:13:37.535491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.535457    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.535720 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.535701    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-textfile\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.536407 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.536382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-accelerators-collector-config\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.536998 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:37.536847    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 16:13:37.536998 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:37.536932    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-tls podName:03e6d0cb-8051-4bdb-a223-aff107b4a725 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:38.036888427 +0000 UTC m=+315.807979658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-tls") pod "node-exporter-dl67l" (UID: "03e6d0cb-8051-4bdb-a223-aff107b4a725") : secret "node-exporter-tls" not found
Sep 09 16:13:37.536998 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.536974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03e6d0cb-8051-4bdb-a223-aff107b4a725-root\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.538207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.538159    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.544303 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.544246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q68l8\" (UniqueName: \"kubernetes.io/projected/03e6d0cb-8051-4bdb-a223-aff107b4a725-kube-api-access-q68l8\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.546348 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.546303    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxph\" (UniqueName: \"kubernetes.io/projected/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-api-access-8zxph\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:37.547111 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.546999    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:37.588824 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.588714    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:37.708464 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.708419    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:37.811330 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.811297    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:37.907606 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:37.907568    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:38.035997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.035959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:38.038483 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.038456    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a16b8c7-e17b-4877-ae7a-b49e90ce59f6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-f7mw5\" (UID: \"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:38.136846 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.136809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-tls\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:38.139068 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.139049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03e6d0cb-8051-4bdb-a223-aff107b4a725-node-exporter-tls\") pod \"node-exporter-dl67l\" (UID: \"03e6d0cb-8051-4bdb-a223-aff107b4a725\") " pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:38.164764 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.164702    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:38.254309 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.254217    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"
Sep 09 16:13:38.261217 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.261194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dl67l"
Sep 09 16:13:38.273370 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:38.273339    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e6d0cb_8051_4bdb_a223_aff107b4a725.slice/crio-fa48869cfc68acb10bb65b3fdd3bfa1bda7ea3cf79581ca263feffcf53a08670 WatchSource:0}: Error finding container fa48869cfc68acb10bb65b3fdd3bfa1bda7ea3cf79581ca263feffcf53a08670: Status 404 returned error can't find the container with id fa48869cfc68acb10bb65b3fdd3bfa1bda7ea3cf79581ca263feffcf53a08670
Sep 09 16:13:38.276213 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.275792    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:13:38.286565 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.286534    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:38.389816 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.389755    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:38.390021 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.389838    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:13:38.393091 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.393070    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.395385 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.395361    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 16:13:38.395596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.395575    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 16:13:38.395668 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.395602    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 16:13:38.395668 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.395658    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 16:13:38.395785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.395760    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 16:13:38.395828 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.395813    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 16:13:38.395885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.395871    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 16:13:38.395998 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.395971    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 16:13:38.396064 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.396047    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-f8j8r\""
Sep 09 16:13:38.396126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.396107    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 16:13:38.412534 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.412515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:13:38.505786 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.505692    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:38.534938 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.534916    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5"]
Sep 09 16:13:38.537345 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:38.537314    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a16b8c7_e17b_4877_ae7a_b49e90ce59f6.slice/crio-47acfb1ca70084aaba1ef4bb06096a8a6fbbdc229cfa3c8cd0b189016e608772 WatchSource:0}: Error finding container 47acfb1ca70084aaba1ef4bb06096a8a6fbbdc229cfa3c8cd0b189016e608772: Status 404 returned error can't find the container with id 47acfb1ca70084aaba1ef4bb06096a8a6fbbdc229cfa3c8cd0b189016e608772
Sep 09 16:13:38.539249 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539249 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539249 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539203    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-web-config\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539292    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxvck\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-kube-api-access-gxvck\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539319    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-config-out\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.539877 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.539611    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.635488 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.635451    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5" event={"ID":"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6","Type":"ContainerStarted","Data":"47acfb1ca70084aaba1ef4bb06096a8a6fbbdc229cfa3c8cd0b189016e608772"}
Sep 09 16:13:38.636632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.636603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dl67l" event={"ID":"03e6d0cb-8051-4bdb-a223-aff107b4a725","Type":"ContainerStarted","Data":"fa48869cfc68acb10bb65b3fdd3bfa1bda7ea3cf79581ca263feffcf53a08670"}
Sep 09 16:13:38.640979 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.640960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.640994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641291 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-config-out\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641331    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641521 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641406    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641521 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641618 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641618 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641594    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-web-config\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxvck\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-kube-api-access-gxvck\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.641886 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.641721    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.643531 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.643004    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.643531 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.643482    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.644183 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.644139    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.644285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.644222    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.644473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.644431    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-web-config\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.644939 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.644918    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.645168 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.645144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.645496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.645476    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.646067 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.646048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.646391 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.646372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.646496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.646480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-config-out\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.651483 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.651460    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxvck\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-kube-api-access-gxvck\") pod \"alertmanager-main-0\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.704967 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.704932    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:13:38.984231 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:38.984186    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:13:38.986331 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:38.986303    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fee4f87_8441_49d7_ab85_dd347361f8be.slice/crio-34a57a618204a785b1103cf7a7040e64007e86c6a47cb2bcae00a1464db93140 WatchSource:0}: Error finding container 34a57a618204a785b1103cf7a7040e64007e86c6a47cb2bcae00a1464db93140: Status 404 returned error can't find the container with id 34a57a618204a785b1103cf7a7040e64007e86c6a47cb2bcae00a1464db93140
Sep 09 16:13:39.642100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:39.642060    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerStarted","Data":"34a57a618204a785b1103cf7a7040e64007e86c6a47cb2bcae00a1464db93140"}
Sep 09 16:13:40.200435 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.200401    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:40.288521 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.288496    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"]
Sep 09 16:13:40.295321 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.295271    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.299164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.298004    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 16:13:40.299164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.298282    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-slbtq\""
Sep 09 16:13:40.299164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.298758    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 16:13:40.299164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.298831    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 16:13:40.299164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.298762    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 16:13:40.299461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.298633    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 16:13:40.300546 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.300520    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7betcc6qgjq8v\""
Sep 09 16:13:40.304205 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.304187    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"]
Sep 09 16:13:40.323515 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.323478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:40.457818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.457761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-tls\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.457982 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.457827    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.457982 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.457876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.457982 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.457901    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-grpc-tls\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.458167 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.457989    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576ef001-48b9-464d-b166-07515afe75e9-metrics-client-ca\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.458167 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.458056    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72gx7\" (UniqueName: \"kubernetes.io/projected/576ef001-48b9-464d-b166-07515afe75e9-kube-api-access-72gx7\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.458167 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.458087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.458289 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.458166    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.559089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.558992    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.559089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.559066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-tls\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.559287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.559093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.559287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.559139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.559393 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.559280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-grpc-tls\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.559441 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.559412    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576ef001-48b9-464d-b166-07515afe75e9-metrics-client-ca\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.559827 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.559712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72gx7\" (UniqueName: \"kubernetes.io/projected/576ef001-48b9-464d-b166-07515afe75e9-kube-api-access-72gx7\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.560138 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.560115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.560314 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.560262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576ef001-48b9-464d-b166-07515afe75e9-metrics-client-ca\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.562458 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.562406    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.562713 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.562462    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.562713 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.562569    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-tls\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.563227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.563205    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.563328 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.563257    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.564285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.564264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/576ef001-48b9-464d-b166-07515afe75e9-secret-grpc-tls\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.566676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.566654    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72gx7\" (UniqueName: \"kubernetes.io/projected/576ef001-48b9-464d-b166-07515afe75e9-kube-api-access-72gx7\") pod \"thanos-querier-7b6b5dc6b4-69b88\" (UID: \"576ef001-48b9-464d-b166-07515afe75e9\") " pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.610733 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.610703    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:40.650152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.649944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5" event={"ID":"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6","Type":"ContainerStarted","Data":"a9c7844143398c715c5b24643f3285be053f1b20570ad2e04658f914d74a9819"}
Sep 09 16:13:40.650152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.650070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5" event={"ID":"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6","Type":"ContainerStarted","Data":"76c442cc793029bf002ede28251b9405011d9235c4c44c0596746943b71dc63a"}
Sep 09 16:13:40.650152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.650103    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5" event={"ID":"3a16b8c7-e17b-4877-ae7a-b49e90ce59f6","Type":"ContainerStarted","Data":"a7155d548b00513f222f1e5b036403c0f367bbd3618a5c592158afb9194a9743"}
Sep 09 16:13:40.651576 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.651546    2567 generic.go:356] "Generic (PLEG): container finished" podID="03e6d0cb-8051-4bdb-a223-aff107b4a725" containerID="e115258f21df4125262bf6b125ada207bb306c3f9b429d223839963157ae74d9" exitCode=0
Sep 09 16:13:40.651708 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.651618    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dl67l" event={"ID":"03e6d0cb-8051-4bdb-a223-aff107b4a725","Type":"ContainerDied","Data":"e115258f21df4125262bf6b125ada207bb306c3f9b429d223839963157ae74d9"}
Sep 09 16:13:40.668353 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.668182    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-f7mw5" podStartSLOduration=2.123067978 podStartE2EDuration="3.668160603s" totalImagesPullingTime="1.545092625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:40.666355929 +0000 UTC m=+318.437447177" watchObservedRunningTime="2026-09-09 16:13:40.668160603 +0000 UTC m=+318.439251862"
Sep 09 16:13:40.673148 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.673079    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:40.887052 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:40.886945    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"]
Sep 09 16:13:40.889026 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:40.888997    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576ef001_48b9_464d_b166_07515afe75e9.slice/crio-ef5cac66503b0ce46e469edf9525e98cc8ed9e9a95ceca145c4d33d489f64bf3 WatchSource:0}: Error finding container ef5cac66503b0ce46e469edf9525e98cc8ed9e9a95ceca145c4d33d489f64bf3: Status 404 returned error can't find the container with id ef5cac66503b0ce46e469edf9525e98cc8ed9e9a95ceca145c4d33d489f64bf3
Sep 09 16:13:41.409795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:41.409742    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:41.657058 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:41.657028    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88" event={"ID":"576ef001-48b9-464d-b166-07515afe75e9","Type":"ContainerStarted","Data":"ef5cac66503b0ce46e469edf9525e98cc8ed9e9a95ceca145c4d33d489f64bf3"}
Sep 09 16:13:41.659309 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:41.659281    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dl67l" event={"ID":"03e6d0cb-8051-4bdb-a223-aff107b4a725","Type":"ContainerStarted","Data":"8ab73b9489a0a40c72a959e368f3b0f1c21e19db05643a6fbe43dbdcbec1d185"}
Sep 09 16:13:41.659411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:41.659332    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dl67l" event={"ID":"03e6d0cb-8051-4bdb-a223-aff107b4a725","Type":"ContainerStarted","Data":"9fb4806f94a8abe7eaf1fdb60d61be0f3099b452ac8380d4cdbe1967073b60d8"}
Sep 09 16:13:41.678010 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:41.677922    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dl67l" podStartSLOduration=3.151598579 podStartE2EDuration="4.677907775s" totalImagesPullingTime="1.4579533s" totalInitContainerRuntime="68.355896ms" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:41.676557076 +0000 UTC m=+319.447648324" watchObservedRunningTime="2026-09-09 16:13:41.677907775 +0000 UTC m=+319.448999046"
Sep 09 16:13:41.771467 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:41.771434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:41.873498 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:41.873459    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:42.056376 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.056294    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"]
Sep 09 16:13:42.059940 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.059574    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:42.059940 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.059716    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:42.061807 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.061783    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 16:13:42.061807 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.061796    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gvw9x\""
Sep 09 16:13:42.068318 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.067973    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"]
Sep 09 16:13:42.175338 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.175303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b531072a-e697-4c09-b2d8-ecebb0a94ed0-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-vclc2\" (UID: \"b531072a-e697-4c09-b2d8-ecebb0a94ed0\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:42.175478 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.175371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq49c\" (UniqueName: \"kubernetes.io/projected/b531072a-e697-4c09-b2d8-ecebb0a94ed0-kube-api-access-lq49c\") pod \"monitoring-plugin-85bbbbbf4-vclc2\" (UID: \"b531072a-e697-4c09-b2d8-ecebb0a94ed0\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:42.276492 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.276449    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b531072a-e697-4c09-b2d8-ecebb0a94ed0-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-vclc2\" (UID: \"b531072a-e697-4c09-b2d8-ecebb0a94ed0\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:42.276676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.276521    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq49c\" (UniqueName: \"kubernetes.io/projected/b531072a-e697-4c09-b2d8-ecebb0a94ed0-kube-api-access-lq49c\") pod \"monitoring-plugin-85bbbbbf4-vclc2\" (UID: \"b531072a-e697-4c09-b2d8-ecebb0a94ed0\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:42.276676 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:42.276619    2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 09 16:13:42.276815 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:13:42.276696    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531072a-e697-4c09-b2d8-ecebb0a94ed0-monitoring-plugin-cert podName:b531072a-e697-4c09-b2d8-ecebb0a94ed0 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:42.776674702 +0000 UTC m=+320.547765931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b531072a-e697-4c09-b2d8-ecebb0a94ed0-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-vclc2" (UID: "b531072a-e697-4c09-b2d8-ecebb0a94ed0") : secret "monitoring-plugin-cert" not found
Sep 09 16:13:42.285895 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.285868    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq49c\" (UniqueName: \"kubernetes.io/projected/b531072a-e697-4c09-b2d8-ecebb0a94ed0-kube-api-access-lq49c\") pod \"monitoring-plugin-85bbbbbf4-vclc2\" (UID: \"b531072a-e697-4c09-b2d8-ecebb0a94ed0\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:42.533453 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.533419    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d56958bb7-kkmsg"]
Sep 09 16:13:42.537526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.537495    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.540005 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.539722    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 16:13:42.540005 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.539852    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 16:13:42.540005 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.539852    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 16:13:42.540005 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.539926    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 16:13:42.540267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.540231    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-67bqp\""
Sep 09 16:13:42.540366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.540351    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 16:13:42.545490 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.545461    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 16:13:42.551983 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.551931    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d56958bb7-kkmsg"]
Sep 09 16:13:42.625117 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.625083    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:42.681032 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.680994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-secret-telemeter-client\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.681496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.681044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-federate-client-tls\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.681496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.681158    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qhtx\" (UniqueName: \"kubernetes.io/projected/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-kube-api-access-4qhtx\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.681496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.681204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-serving-certs-ca-bundle\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.681496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.681240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.681496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.681292    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-metrics-client-ca\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.681496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.681357    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-telemeter-client-tls\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.681496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.681399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.782751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.782716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b531072a-e697-4c09-b2d8-ecebb0a94ed0-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-vclc2\" (UID: \"b531072a-e697-4c09-b2d8-ecebb0a94ed0\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:42.782926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.782767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qhtx\" (UniqueName: \"kubernetes.io/projected/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-kube-api-access-4qhtx\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.782926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.782821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-serving-certs-ca-bundle\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.782926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.782878    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.783150 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.783126    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-metrics-client-ca\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.783659 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.783595    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-serving-certs-ca-bundle\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.783760 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.783685    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-telemeter-client-tls\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.783760 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.783731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.783894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.783849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-secret-telemeter-client\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.783945 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.783930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-federate-client-tls\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.783995 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.783968    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.784589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.783853    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-metrics-client-ca\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.786514 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.786486    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b531072a-e697-4c09-b2d8-ecebb0a94ed0-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-vclc2\" (UID: \"b531072a-e697-4c09-b2d8-ecebb0a94ed0\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:42.786718 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.786689    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-secret-telemeter-client\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.786995 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.786950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.786995 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.786989    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-telemeter-client-tls\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.787661 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.787621    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-federate-client-tls\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.790716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.790697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qhtx\" (UniqueName: \"kubernetes.io/projected/f5815a7b-5e85-4d28-9231-f1f3c294f9e5-kube-api-access-4qhtx\") pod \"telemeter-client-d56958bb7-kkmsg\" (UID: \"f5815a7b-5e85-4d28-9231-f1f3c294f9e5\") " pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.849693 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.849656    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg"
Sep 09 16:13:42.972286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:42.972247    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:43.471860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:43.471813    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96b8bb895-tldfb"]
Sep 09 16:13:43.533939 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:43.533898    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:43.880143 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:43.880117    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"]
Sep 09 16:13:43.881502 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:43.881417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d56958bb7-kkmsg"]
Sep 09 16:13:43.883310 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:43.883288    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5815a7b_5e85_4d28_9231_f1f3c294f9e5.slice/crio-71148ad58f373a22934b6c9de8db73bb65f2a569505b23313739ffcfdbd6baf3 WatchSource:0}: Error finding container 71148ad58f373a22934b6c9de8db73bb65f2a569505b23313739ffcfdbd6baf3: Status 404 returned error can't find the container with id 71148ad58f373a22934b6c9de8db73bb65f2a569505b23313739ffcfdbd6baf3
Sep 09 16:13:43.883829 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:43.883810    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb531072a_e697_4c09_b2d8_ecebb0a94ed0.slice/crio-4f49527ef18c61560f4e512c17c33b372192535752656b723a218abf19ce5401 WatchSource:0}: Error finding container 4f49527ef18c61560f4e512c17c33b372192535752656b723a218abf19ce5401: Status 404 returned error can't find the container with id 4f49527ef18c61560f4e512c17c33b372192535752656b723a218abf19ce5401
Sep 09 16:13:44.691245 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:44.691207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88" event={"ID":"576ef001-48b9-464d-b166-07515afe75e9","Type":"ContainerStarted","Data":"05caad33f099c0c7293ee44fc04290fa1570f4c2e689a9a969d799a6ec3baa21"}
Sep 09 16:13:44.691415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:44.691298    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88" event={"ID":"576ef001-48b9-464d-b166-07515afe75e9","Type":"ContainerStarted","Data":"32c9e6ba58fc66d4277b5abf82cb2344b26a78c3c479209a85d01e57e288e769"}
Sep 09 16:13:44.691415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:44.691346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88" event={"ID":"576ef001-48b9-464d-b166-07515afe75e9","Type":"ContainerStarted","Data":"a77d172e4a627e4868c9f0d0000a1d377ab288d3213a94802f47c8e4195ce63a"}
Sep 09 16:13:44.693003 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:44.692974    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerID="45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748" exitCode=0
Sep 09 16:13:44.693125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:44.693067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerDied","Data":"45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748"}
Sep 09 16:13:44.694555 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:44.694527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2" event={"ID":"b531072a-e697-4c09-b2d8-ecebb0a94ed0","Type":"ContainerStarted","Data":"4f49527ef18c61560f4e512c17c33b372192535752656b723a218abf19ce5401"}
Sep 09 16:13:44.695908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:44.695886    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg" event={"ID":"f5815a7b-5e85-4d28-9231-f1f3c294f9e5","Type":"ContainerStarted","Data":"71148ad58f373a22934b6c9de8db73bb65f2a569505b23313739ffcfdbd6baf3"}
Sep 09 16:13:45.702967 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.702787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2" event={"ID":"b531072a-e697-4c09-b2d8-ecebb0a94ed0","Type":"ContainerStarted","Data":"3a7219693195bfbb9d62df3fcb9882634234768effbab6de7823b2ebfa5bfe9c"}
Sep 09 16:13:45.703403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.703147    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:45.707434 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.707316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88" event={"ID":"576ef001-48b9-464d-b166-07515afe75e9","Type":"ContainerStarted","Data":"8a7e19f7c26e15950062ecdc9a95bbd91bcf1ecfb053131e00dc211a2a64c72a"}
Sep 09 16:13:45.707434 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.707388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88" event={"ID":"576ef001-48b9-464d-b166-07515afe75e9","Type":"ContainerStarted","Data":"b7436b165e5ee08831a95af3be511b096c908b0349c18c81af09aefcc829eb5e"}
Sep 09 16:13:45.709361 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.709338    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2"
Sep 09 16:13:45.721408 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.721354    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-vclc2" podStartSLOduration=2.148409789 podStartE2EDuration="3.721337433s" totalImagesPullingTime="1.572927644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:45.720874656 +0000 UTC m=+323.491965905" watchObservedRunningTime="2026-09-09 16:13:45.721337433 +0000 UTC m=+323.492428679"
Sep 09 16:13:45.983835 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.983739    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-9fjxs"]
Sep 09 16:13:45.987352 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.987328    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-9fjxs"
Sep 09 16:13:45.992849 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.992824    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 16:13:45.992968 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.992908    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ttfq7\""
Sep 09 16:13:45.993024 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:45.993000    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 16:13:46.004976 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.004930    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-9fjxs"]
Sep 09 16:13:46.112184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.112150    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v25f\" (UniqueName: \"kubernetes.io/projected/be4a802c-6f54-465f-af20-9ce7b4f52fa5-kube-api-access-8v25f\") pod \"downloads-85d98c998f-9fjxs\" (UID: \"be4a802c-6f54-465f-af20-9ce7b4f52fa5\") " pod="openshift-console/downloads-85d98c998f-9fjxs"
Sep 09 16:13:46.212558 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.212526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v25f\" (UniqueName: \"kubernetes.io/projected/be4a802c-6f54-465f-af20-9ce7b4f52fa5-kube-api-access-8v25f\") pod \"downloads-85d98c998f-9fjxs\" (UID: \"be4a802c-6f54-465f-af20-9ce7b4f52fa5\") " pod="openshift-console/downloads-85d98c998f-9fjxs"
Sep 09 16:13:46.220595 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.220576    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v25f\" (UniqueName: \"kubernetes.io/projected/be4a802c-6f54-465f-af20-9ce7b4f52fa5-kube-api-access-8v25f\") pod \"downloads-85d98c998f-9fjxs\" (UID: \"be4a802c-6f54-465f-af20-9ce7b4f52fa5\") " pod="openshift-console/downloads-85d98c998f-9fjxs"
Sep 09 16:13:46.298880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.298857    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-9fjxs"
Sep 09 16:13:46.401398 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.401362    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:46.468083 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.468044    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:46.577887 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.577812    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-9fjxs"]
Sep 09 16:13:46.581436 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:46.581404    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4a802c_6f54_465f_af20_9ce7b4f52fa5.slice/crio-3f468e81b399f13c87350b542c56d52550825f6285ba71d0c4ec7d8c3a75b707 WatchSource:0}: Error finding container 3f468e81b399f13c87350b542c56d52550825f6285ba71d0c4ec7d8c3a75b707: Status 404 returned error can't find the container with id 3f468e81b399f13c87350b542c56d52550825f6285ba71d0c4ec7d8c3a75b707
Sep 09 16:13:46.629060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.629028    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:46.699844 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.699816    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:46.715255 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.715223    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88" event={"ID":"576ef001-48b9-464d-b166-07515afe75e9","Type":"ContainerStarted","Data":"3904dba7e5a8e4d091628a00baee8133d5e5fc145f6d0e1efe4857ae1a1bd2f9"}
Sep 09 16:13:46.715673 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.715313    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:46.716646 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.716622    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-9fjxs" event={"ID":"be4a802c-6f54-465f-af20-9ce7b4f52fa5","Type":"ContainerStarted","Data":"3f468e81b399f13c87350b542c56d52550825f6285ba71d0c4ec7d8c3a75b707"}
Sep 09 16:13:46.718480 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.718460    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg" event={"ID":"f5815a7b-5e85-4d28-9231-f1f3c294f9e5","Type":"ContainerStarted","Data":"8e0c89c481f50f0ddf48ed3341a938046eb54fd3e8f1386ae5d80c96cf444509"}
Sep 09 16:13:46.718566 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.718500    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg" event={"ID":"f5815a7b-5e85-4d28-9231-f1f3c294f9e5","Type":"ContainerStarted","Data":"0d750166774949cbc16cdec55130f584ef58255b96ea4926072a284913842e82"}
Sep 09 16:13:46.718566 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.718518    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg" event={"ID":"f5815a7b-5e85-4d28-9231-f1f3c294f9e5","Type":"ContainerStarted","Data":"3540799e03cd7119ee4b39be10329fc037fbb75886dbe5ac622a0a2268a2d8a0"}
Sep 09 16:13:46.744120 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.744069    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88" podStartSLOduration=2.472742653 podStartE2EDuration="6.744055006s" totalImagesPullingTime="4.271312353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:46.742662717 +0000 UTC m=+324.513753962" watchObservedRunningTime="2026-09-09 16:13:46.744055006 +0000 UTC m=+324.515146253"
Sep 09 16:13:46.768717 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:46.768669    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d56958bb7-kkmsg" podStartSLOduration=2.561647239 podStartE2EDuration="4.768654561s" totalImagesPullingTime="2.207007322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:46.766186125 +0000 UTC m=+324.537277371" watchObservedRunningTime="2026-09-09 16:13:46.768654561 +0000 UTC m=+324.539745806"
Sep 09 16:13:47.024269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.024233    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:47.083975 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.083945    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:47.626629 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.626593    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:47.726276 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.726234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerStarted","Data":"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2"}
Sep 09 16:13:47.726637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.726335    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerStarted","Data":"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a"}
Sep 09 16:13:47.726637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.726373    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerStarted","Data":"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491"}
Sep 09 16:13:47.726637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.726409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerStarted","Data":"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199"}
Sep 09 16:13:47.726637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.726445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerStarted","Data":"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3"}
Sep 09 16:13:47.726637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.726481    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerStarted","Data":"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d"}
Sep 09 16:13:47.756296 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.756245    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.710877315 podStartE2EDuration="9.756226547s" totalImagesPullingTime="7.018657268s" totalInitContainerRuntime="26.691964ms" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:47.755222866 +0000 UTC m=+325.526314137" watchObservedRunningTime="2026-09-09 16:13:47.756226547 +0000 UTC m=+325.527317794"
Sep 09 16:13:47.759876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.759685    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:47.830223 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.830189    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:47.930137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:47.930047    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:48.665701 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:48.665670    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:48.763998 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:48.763959    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:51.556922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.556888    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f6c97b8bc-nc4n5"]
Sep 09 16:13:51.560378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.560360    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.562706 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.562684    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 16:13:51.563414 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.563210    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 16:13:51.563414 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.563214    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 16:13:51.563414 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.563280    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 16:13:51.568024 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.563835    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 16:13:51.568024 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.564305    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8xztk\""
Sep 09 16:13:51.571569 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.571545    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f6c97b8bc-nc4n5"]
Sep 09 16:13:51.589296 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.589261    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:51.642297 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.642258    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:51.657379 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.657348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-service-ca\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.657542 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.657389    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-serving-cert\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.657542 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.657462    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-oauth-serving-cert\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.657542 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.657527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-oauth-config\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.657699 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.657566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4gqm\" (UniqueName: \"kubernetes.io/projected/02af37c4-aa31-45e1-a88c-00cab8be3e77-kube-api-access-z4gqm\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.657699 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.657649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-config\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.758755 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.758716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-config\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.758952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.758824    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-service-ca\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.758952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.758857    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-serving-cert\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.758952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.758881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-oauth-serving-cert\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.758952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.758929    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-oauth-config\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.758952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.758950    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4gqm\" (UniqueName: \"kubernetes.io/projected/02af37c4-aa31-45e1-a88c-00cab8be3e77-kube-api-access-z4gqm\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.759491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.759459    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-config\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.759595 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.759552    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-service-ca\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.759665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.759596    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-oauth-serving-cert\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.761235 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.761213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-oauth-config\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.761330 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.761234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-serving-cert\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.769991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.769969    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4gqm\" (UniqueName: \"kubernetes.io/projected/02af37c4-aa31-45e1-a88c-00cab8be3e77-kube-api-access-z4gqm\") pod \"console-f6c97b8bc-nc4n5\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") " pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:51.872246 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:51.872168    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:13:52.148026 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:52.148005    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f6c97b8bc-nc4n5"]
Sep 09 16:13:52.150488 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:13:52.150463    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02af37c4_aa31_45e1_a88c_00cab8be3e77.slice/crio-d8cf08dbe8ee2503f27f0c1baf50aeede5f9ad0a805af8e2cc707b51867bf1a1 WatchSource:0}: Error finding container d8cf08dbe8ee2503f27f0c1baf50aeede5f9ad0a805af8e2cc707b51867bf1a1: Status 404 returned error can't find the container with id d8cf08dbe8ee2503f27f0c1baf50aeede5f9ad0a805af8e2cc707b51867bf1a1
Sep 09 16:13:52.737282 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:52.737253    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b6b5dc6b4-69b88"
Sep 09 16:13:52.753430 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:52.753392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f6c97b8bc-nc4n5" event={"ID":"02af37c4-aa31-45e1-a88c-00cab8be3e77","Type":"ContainerStarted","Data":"d8cf08dbe8ee2503f27f0c1baf50aeede5f9ad0a805af8e2cc707b51867bf1a1"}
Sep 09 16:13:54.134712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:54.134678    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:54.233765 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:54.233727    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:55.771681 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:55.771647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f6c97b8bc-nc4n5" event={"ID":"02af37c4-aa31-45e1-a88c-00cab8be3e77","Type":"ContainerStarted","Data":"f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f"}
Sep 09 16:13:55.791350 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:55.791301    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f6c97b8bc-nc4n5" podStartSLOduration=1.396112833 podStartE2EDuration="4.791284486s" totalImagesPullingTime="3.395171653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:55.789690504 +0000 UTC m=+333.560781752" watchObservedRunningTime="2026-09-09 16:13:55.791284486 +0000 UTC m=+333.562375737"
Sep 09 16:13:59.850691 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:59.850658    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:13:59.951398 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:13:59.951372    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:00.042033 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.042001    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b6d99d5c-jttxg"]
Sep 09 16:14:00.051363 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.051332    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.059166 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.059138    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 16:14:00.059367 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.059322    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b6d99d5c-jttxg"]
Sep 09 16:14:00.139631 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.139594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-console-config\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.139821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.139645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-service-ca\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.139821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.139694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbg94\" (UniqueName: \"kubernetes.io/projected/4702de10-e8cf-4826-863a-5731b16f7b83-kube-api-access-cbg94\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.139821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.139726    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-trusted-ca-bundle\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.139821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.139752    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-serving-cert\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.139990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.139833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-oauth-config\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.139990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.139862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-oauth-serving-cert\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.240507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.240469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-console-config\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.240676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.240513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-service-ca\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.240676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.240558    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbg94\" (UniqueName: \"kubernetes.io/projected/4702de10-e8cf-4826-863a-5731b16f7b83-kube-api-access-cbg94\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.240676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.240596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-trusted-ca-bundle\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.240676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.240626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-serving-cert\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.240922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.240684    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-oauth-config\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.240922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.240719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-oauth-serving-cert\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.241351 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.241327    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-service-ca\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.241351 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.241328    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-console-config\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.241510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.241417    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-oauth-serving-cert\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.241568 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.241535    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-trusted-ca-bundle\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.243178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.243152    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-oauth-config\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.243276 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.243258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-serving-cert\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.248469 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.248440    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbg94\" (UniqueName: \"kubernetes.io/projected/4702de10-e8cf-4826-863a-5731b16f7b83-kube-api-access-cbg94\") pod \"console-54b6d99d5c-jttxg\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") " pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.361740 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.361701    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:00.589198 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.589154    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:00.636676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.636640    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b6d99d5c-jttxg"]
Sep 09 16:14:00.639379 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:14:00.639340    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4702de10_e8cf_4826_863a_5731b16f7b83.slice/crio-f1e759c17de1908ee15150c37b0f5f105c9e354f54540269f9686590928729da WatchSource:0}: Error finding container f1e759c17de1908ee15150c37b0f5f105c9e354f54540269f9686590928729da: Status 404 returned error can't find the container with id f1e759c17de1908ee15150c37b0f5f105c9e354f54540269f9686590928729da
Sep 09 16:14:00.690676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.690648    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:00.795108 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.795059    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b6d99d5c-jttxg" event={"ID":"4702de10-e8cf-4826-863a-5731b16f7b83","Type":"ContainerStarted","Data":"be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552"}
Sep 09 16:14:00.795268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.795121    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b6d99d5c-jttxg" event={"ID":"4702de10-e8cf-4826-863a-5731b16f7b83","Type":"ContainerStarted","Data":"f1e759c17de1908ee15150c37b0f5f105c9e354f54540269f9686590928729da"}
Sep 09 16:14:00.815550 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:00.815491    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b6d99d5c-jttxg" podStartSLOduration=0.815469842 podStartE2EDuration="815.469842ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:00.813791104 +0000 UTC m=+338.584882341" watchObservedRunningTime="2026-09-09 16:14:00.815469842 +0000 UTC m=+338.586561089"
Sep 09 16:14:01.872708 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:01.872667    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:14:01.873192 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:01.872745    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:14:01.878935 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:01.878902    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:14:02.732459 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:02.732425    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:02.793603 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:02.793568    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:02.808841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:02.808815    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:14:03.264156 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:03.264107    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:03.320222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:03.320188    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:05.040828 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:05.040789    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:05.141843 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:05.141793    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:06.642459 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:06.642421    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:06.701214 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:06.701179    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:07.829789 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:07.829736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-9fjxs" event={"ID":"be4a802c-6f54-465f-af20-9ce7b4f52fa5","Type":"ContainerStarted","Data":"9c00eb2e869c14a54a15a744a5b025da33706a9bbabaa879ffda73be0b37b7a0"}
Sep 09 16:14:07.830218 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:07.829986    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-9fjxs"
Sep 09 16:14:07.831621 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:07.831593    2567 patch_prober.go:28] interesting pod/downloads-85d98c998f-9fjxs container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.24:8080/\": dial tcp 10.132.0.24:8080: connect: connection refused" start-of-body=
Sep 09 16:14:07.831757 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:07.831645    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-9fjxs" podUID="be4a802c-6f54-465f-af20-9ce7b4f52fa5" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.24:8080/\": dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 09 16:14:07.848534 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:07.848485    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-9fjxs" podStartSLOduration=1.7710058979999999 podStartE2EDuration="22.848469877s" totalImagesPullingTime="21.077463979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:07.846598963 +0000 UTC m=+345.617690233" watchObservedRunningTime="2026-09-09 16:14:07.848469877 +0000 UTC m=+345.619561124"
Sep 09 16:14:08.056850 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.056746    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:08.118496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.118447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:08.497546 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.497500    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" podUID="5cb7d6f9-896f-4de3-b644-02091a56a39a" containerName="registry" containerID="cri-o://7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8" gracePeriod=30
Sep 09 16:14:08.770111 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.770084    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:14:08.829270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829238    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhp6p\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-kube-api-access-rhp6p\") pod \"5cb7d6f9-896f-4de3-b644-02091a56a39a\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") "
Sep 09 16:14:08.829447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829304    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-trusted-ca\") pod \"5cb7d6f9-896f-4de3-b644-02091a56a39a\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") "
Sep 09 16:14:08.829447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829346    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-image-registry-private-configuration\") pod \"5cb7d6f9-896f-4de3-b644-02091a56a39a\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") "
Sep 09 16:14:08.829447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829400    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cb7d6f9-896f-4de3-b644-02091a56a39a-ca-trust-extracted\") pod \"5cb7d6f9-896f-4de3-b644-02091a56a39a\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") "
Sep 09 16:14:08.829447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829435    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-certificates\") pod \"5cb7d6f9-896f-4de3-b644-02091a56a39a\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") "
Sep 09 16:14:08.829715 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829470    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") pod \"5cb7d6f9-896f-4de3-b644-02091a56a39a\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") "
Sep 09 16:14:08.829715 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829496    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-installation-pull-secrets\") pod \"5cb7d6f9-896f-4de3-b644-02091a56a39a\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") "
Sep 09 16:14:08.829715 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829540    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-bound-sa-token\") pod \"5cb7d6f9-896f-4de3-b644-02091a56a39a\" (UID: \"5cb7d6f9-896f-4de3-b644-02091a56a39a\") "
Sep 09 16:14:08.830204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829755    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5cb7d6f9-896f-4de3-b644-02091a56a39a" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:08.830204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.829958    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5cb7d6f9-896f-4de3-b644-02091a56a39a" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:08.830204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.830002    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-trusted-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:08.833922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.832600    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5cb7d6f9-896f-4de3-b644-02091a56a39a" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:08.833922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.833409    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5cb7d6f9-896f-4de3-b644-02091a56a39a" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:08.835046 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.835010    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5cb7d6f9-896f-4de3-b644-02091a56a39a" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:08.839494 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.839463    2567 generic.go:356] "Generic (PLEG): container finished" podID="5cb7d6f9-896f-4de3-b644-02091a56a39a" containerID="7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8" exitCode=0
Sep 09 16:14:08.840943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.840734    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96b8bb895-tldfb"
Sep 09 16:14:08.840943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.840904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" event={"ID":"5cb7d6f9-896f-4de3-b644-02091a56a39a","Type":"ContainerDied","Data":"7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8"}
Sep 09 16:14:08.841105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.840954    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96b8bb895-tldfb" event={"ID":"5cb7d6f9-896f-4de3-b644-02091a56a39a","Type":"ContainerDied","Data":"f2490bf32539cfa57cf285ebd067ccf6c968b9503596a39af521bef9e72d85fc"}
Sep 09 16:14:08.841105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.840982    2567 scope.go:117] "RemoveContainer" containerID="7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8"
Sep 09 16:14:08.843264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.843230    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-kube-api-access-rhp6p" (OuterVolumeSpecName: "kube-api-access-rhp6p") pod "5cb7d6f9-896f-4de3-b644-02091a56a39a" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a"). InnerVolumeSpecName "kube-api-access-rhp6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:08.843670 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.843639    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5cb7d6f9-896f-4de3-b644-02091a56a39a" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:08.843803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.843745    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cb7d6f9-896f-4de3-b644-02091a56a39a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5cb7d6f9-896f-4de3-b644-02091a56a39a" (UID: "5cb7d6f9-896f-4de3-b644-02091a56a39a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:14:08.849709 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.849676    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-9fjxs"
Sep 09 16:14:08.856726 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.856705    2567 scope.go:117] "RemoveContainer" containerID="7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8"
Sep 09 16:14:08.857096 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:08.857071    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8\": container with ID starting with 7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8 not found: ID does not exist" containerID="7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8"
Sep 09 16:14:08.857218 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.857106    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8"} err="failed to get container status \"7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8\": rpc error: code = NotFound desc = could not find container \"7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8\": container with ID starting with 7d09706789d9d84db5109499452eaf3d897008dd9c2b8f0d4520256e2e8c65c8 not found: ID does not exist"
Sep 09 16:14:08.931173 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.931139    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cb7d6f9-896f-4de3-b644-02091a56a39a-ca-trust-extracted\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:08.931173 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.931172    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-certificates\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:08.931428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.931186    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-registry-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:08.931428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.931200    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-installation-pull-secrets\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:08.931428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.931209    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-bound-sa-token\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:08.931428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.931220    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhp6p\" (UniqueName: \"kubernetes.io/projected/5cb7d6f9-896f-4de3-b644-02091a56a39a-kube-api-access-rhp6p\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:08.931428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:08.931235    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cb7d6f9-896f-4de3-b644-02091a56a39a-image-registry-private-configuration\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:09.165571 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:09.165538    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96b8bb895-tldfb"]
Sep 09 16:14:09.168920 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:09.168894    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-96b8bb895-tldfb"]
Sep 09 16:14:10.362331 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.362249    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:10.362914 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.362347    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:10.368015 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.367991    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:10.737613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.737579    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cb7d6f9-896f-4de3-b644-02091a56a39a" path="/var/lib/kubelet/pods/5cb7d6f9-896f-4de3-b644-02091a56a39a/volumes"
Sep 09 16:14:10.852675 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.852636    2567 generic.go:356] "Generic (PLEG): container finished" podID="1e74fbbd-d60f-49f4-a7a9-842799743d6a" containerID="d3407b55f7fc6c176a1b6f0da70aaccff01c80a0e6b0b53b8fa494c9989f1cbc" exitCode=0
Sep 09 16:14:10.852874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.852719    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw" event={"ID":"1e74fbbd-d60f-49f4-a7a9-842799743d6a","Type":"ContainerDied","Data":"d3407b55f7fc6c176a1b6f0da70aaccff01c80a0e6b0b53b8fa494c9989f1cbc"}
Sep 09 16:14:10.853337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.853310    2567 scope.go:117] "RemoveContainer" containerID="d3407b55f7fc6c176a1b6f0da70aaccff01c80a0e6b0b53b8fa494c9989f1cbc"
Sep 09 16:14:10.857518 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.857486    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:14:10.914199 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:10.914168    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f6c97b8bc-nc4n5"]
Sep 09 16:14:11.859851 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:11.859811    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-xlrkw" event={"ID":"1e74fbbd-d60f-49f4-a7a9-842799743d6a","Type":"ContainerStarted","Data":"06f25f6e7d1e2aad86ca4923e1f47052c2abff65ac9a5caff4b83b912d11ce0e"}
Sep 09 16:14:12.481869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:12.481834    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:12.607702 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:12.607664    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:13.052421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:13.052389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:13.155819 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:13.155766    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:16.884600 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:16.884561    2567 generic.go:356] "Generic (PLEG): container finished" podID="78278da3-be7a-4082-8193-47bf1351254d" containerID="3e74f2177c8a3fcbc6f92d03a6f78a7dfcc42b7ea3ee4c57f3c05c1b578665d7" exitCode=0
Sep 09 16:14:16.885020 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:16.884629    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn" event={"ID":"78278da3-be7a-4082-8193-47bf1351254d","Type":"ContainerDied","Data":"3e74f2177c8a3fcbc6f92d03a6f78a7dfcc42b7ea3ee4c57f3c05c1b578665d7"}
Sep 09 16:14:16.885020 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:16.884999    2567 scope.go:117] "RemoveContainer" containerID="3e74f2177c8a3fcbc6f92d03a6f78a7dfcc42b7ea3ee4c57f3c05c1b578665d7"
Sep 09 16:14:17.723307 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:17.723275    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:17.779194 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:17.779164    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:17.893449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:17.893333    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-w6mxn" event={"ID":"78278da3-be7a-4082-8193-47bf1351254d","Type":"ContainerStarted","Data":"3c8977a57e749e7046e23d5ad8629d4bc8dd762342fe646d70d8cbd8f13c546d"}
Sep 09 16:14:17.941014 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:17.940981    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gz8f_da78760a-b579-4a43-83cf-0a0f0a7bd11c/serve-healthcheck-canary/0.log"
Sep 09 16:14:25.413239 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:25.413195    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:25.514565 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:25.514523    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:25.568928 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:25.568899    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:26.930268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:26.930237    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d3c85a7-c177-44a7-86d1-451e99035b01" containerID="b46d6a297e3f20b76774851a48a2d0049fcbcc62047bffa175cebbb9df066bd3" exitCode=0
Sep 09 16:14:26.930626 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:26.930310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m" event={"ID":"1d3c85a7-c177-44a7-86d1-451e99035b01","Type":"ContainerDied","Data":"b46d6a297e3f20b76774851a48a2d0049fcbcc62047bffa175cebbb9df066bd3"}
Sep 09 16:14:26.930670 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:26.930651    2567 scope.go:117] "RemoveContainer" containerID="b46d6a297e3f20b76774851a48a2d0049fcbcc62047bffa175cebbb9df066bd3"
Sep 09 16:14:27.936695 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:27.936661    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-tv76m" event={"ID":"1d3c85a7-c177-44a7-86d1-451e99035b01","Type":"ContainerStarted","Data":"3dfbdf58d8ecaee051cc4489642c948be0f8c233931f7fc564d8fe012a3bf0d0"}
Sep 09 16:14:35.679368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:35.679332    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:14:35.681720 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:35.681694    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d4dc8b5-2a2a-4d02-9553-13e9b24c7468-metrics-certs\") pod \"network-metrics-daemon-4w9ps\" (UID: \"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468\") " pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:14:35.736739 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:35.736714    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zj7bv\""
Sep 09 16:14:35.744673 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:35.744654    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4w9ps"
Sep 09 16:14:35.942265 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:35.942187    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f6c97b8bc-nc4n5" podUID="02af37c4-aa31-45e1-a88c-00cab8be3e77" containerName="console" containerID="cri-o://f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f" gracePeriod=15
Sep 09 16:14:36.041182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.041155    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4w9ps"]
Sep 09 16:14:36.044034 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:14:36.044008    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d4dc8b5_2a2a_4d02_9553_13e9b24c7468.slice/crio-064a3972320335bb26e00eea2e119365156f4934f970a70a02c53638bdd3ed54 WatchSource:0}: Error finding container 064a3972320335bb26e00eea2e119365156f4934f970a70a02c53638bdd3ed54: Status 404 returned error can't find the container with id 064a3972320335bb26e00eea2e119365156f4934f970a70a02c53638bdd3ed54
Sep 09 16:14:36.226487 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.226461    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:14:36.284972 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.284942    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-oauth-config\") pod \"02af37c4-aa31-45e1-a88c-00cab8be3e77\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") "
Sep 09 16:14:36.284972 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.284977    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-serving-cert\") pod \"02af37c4-aa31-45e1-a88c-00cab8be3e77\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") "
Sep 09 16:14:36.285162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.285039    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-config\") pod \"02af37c4-aa31-45e1-a88c-00cab8be3e77\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") "
Sep 09 16:14:36.285162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.285070    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-service-ca\") pod \"02af37c4-aa31-45e1-a88c-00cab8be3e77\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") "
Sep 09 16:14:36.285162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.285108    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4gqm\" (UniqueName: \"kubernetes.io/projected/02af37c4-aa31-45e1-a88c-00cab8be3e77-kube-api-access-z4gqm\") pod \"02af37c4-aa31-45e1-a88c-00cab8be3e77\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") "
Sep 09 16:14:36.285162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.285147    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-oauth-serving-cert\") pod \"02af37c4-aa31-45e1-a88c-00cab8be3e77\" (UID: \"02af37c4-aa31-45e1-a88c-00cab8be3e77\") "
Sep 09 16:14:36.285568 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.285539    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-service-ca" (OuterVolumeSpecName: "service-ca") pod "02af37c4-aa31-45e1-a88c-00cab8be3e77" (UID: "02af37c4-aa31-45e1-a88c-00cab8be3e77"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:36.285568 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.285549    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-config" (OuterVolumeSpecName: "console-config") pod "02af37c4-aa31-45e1-a88c-00cab8be3e77" (UID: "02af37c4-aa31-45e1-a88c-00cab8be3e77"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:36.285727 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.285632    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02af37c4-aa31-45e1-a88c-00cab8be3e77" (UID: "02af37c4-aa31-45e1-a88c-00cab8be3e77"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:36.287202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.287182    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02af37c4-aa31-45e1-a88c-00cab8be3e77" (UID: "02af37c4-aa31-45e1-a88c-00cab8be3e77"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:36.287462 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.287447    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02af37c4-aa31-45e1-a88c-00cab8be3e77" (UID: "02af37c4-aa31-45e1-a88c-00cab8be3e77"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:36.287521 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.287466    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02af37c4-aa31-45e1-a88c-00cab8be3e77-kube-api-access-z4gqm" (OuterVolumeSpecName: "kube-api-access-z4gqm") pod "02af37c4-aa31-45e1-a88c-00cab8be3e77" (UID: "02af37c4-aa31-45e1-a88c-00cab8be3e77"). InnerVolumeSpecName "kube-api-access-z4gqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:36.385900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.385870    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:36.385900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.385895    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:36.386065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.385908    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4gqm\" (UniqueName: \"kubernetes.io/projected/02af37c4-aa31-45e1-a88c-00cab8be3e77-kube-api-access-z4gqm\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:36.386065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.385925    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02af37c4-aa31-45e1-a88c-00cab8be3e77-oauth-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:36.386065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.385937    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-oauth-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:36.386065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.385948    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02af37c4-aa31-45e1-a88c-00cab8be3e77-console-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:36.979011 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.978923    2567 generic.go:356] "Generic (PLEG): container finished" podID="02af37c4-aa31-45e1-a88c-00cab8be3e77" containerID="f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f" exitCode=0
Sep 09 16:14:36.979011 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.978966    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f6c97b8bc-nc4n5"
Sep 09 16:14:36.979465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.979008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f6c97b8bc-nc4n5" event={"ID":"02af37c4-aa31-45e1-a88c-00cab8be3e77","Type":"ContainerDied","Data":"f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f"}
Sep 09 16:14:36.979465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.979065    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f6c97b8bc-nc4n5" event={"ID":"02af37c4-aa31-45e1-a88c-00cab8be3e77","Type":"ContainerDied","Data":"d8cf08dbe8ee2503f27f0c1baf50aeede5f9ad0a805af8e2cc707b51867bf1a1"}
Sep 09 16:14:36.979465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.979094    2567 scope.go:117] "RemoveContainer" containerID="f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f"
Sep 09 16:14:36.980426 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.980304    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4w9ps" event={"ID":"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468","Type":"ContainerStarted","Data":"064a3972320335bb26e00eea2e119365156f4934f970a70a02c53638bdd3ed54"}
Sep 09 16:14:36.987475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.987457    2567 scope.go:117] "RemoveContainer" containerID="f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f"
Sep 09 16:14:36.987717 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:36.987697    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f\": container with ID starting with f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f not found: ID does not exist" containerID="f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f"
Sep 09 16:14:36.987800 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.987729    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f"} err="failed to get container status \"f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f\": rpc error: code = NotFound desc = could not find container \"f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f\": container with ID starting with f98f1d28b5f165c82614d791f485c535e88a733edbf682710e942953d0c4f27f not found: ID does not exist"
Sep 09 16:14:36.994816 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.994796    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f6c97b8bc-nc4n5"]
Sep 09 16:14:36.998701 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:36.998682    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f6c97b8bc-nc4n5"]
Sep 09 16:14:37.987028 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:37.986978    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4w9ps" event={"ID":"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468","Type":"ContainerStarted","Data":"0065245da6c33ce0a4ce6929498d0383c3416863ae4d32fc98e90d3aac753725"}
Sep 09 16:14:38.736134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:38.736102    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02af37c4-aa31-45e1-a88c-00cab8be3e77" path="/var/lib/kubelet/pods/02af37c4-aa31-45e1-a88c-00cab8be3e77/volumes"
Sep 09 16:14:38.992712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:38.992634    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4w9ps" event={"ID":"1d4dc8b5-2a2a-4d02-9553-13e9b24c7468","Type":"ContainerStarted","Data":"c301eff1c63c6b0b21e2f63d1ca69e4aac6b01fb58a1a4c3bdb71e7a8ec8ecd8"}
Sep 09 16:14:39.009858 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:39.009802    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4w9ps" podStartSLOduration=374.321128452 podStartE2EDuration="6m16.009788092s" totalImagesPullingTime="1.68865964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:39.008880231 +0000 UTC m=+376.779971477" watchObservedRunningTime="2026-09-09 16:14:39.009788092 +0000 UTC m=+376.780879332"
Sep 09 16:14:39.094846 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:39.094813    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:39.148911 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:39.148879    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:53.402072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:53.401988    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:53.464751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:53.464715    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:57.652272 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:57.652226    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:14:57.652766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:57.652596    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="alertmanager" containerID="cri-o://02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d" gracePeriod=120
Sep 09 16:14:57.652766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:57.652661    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy-metric" containerID="cri-o://6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a" gracePeriod=120
Sep 09 16:14:57.652766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:57.652688    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="prom-label-proxy" containerID="cri-o://2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2" gracePeriod=120
Sep 09 16:14:57.652766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:57.652700    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy" containerID="cri-o://fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491" gracePeriod=120
Sep 09 16:14:57.652766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:57.652721    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="config-reloader" containerID="cri-o://4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3" gracePeriod=120
Sep 09 16:14:57.653065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:57.652670    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy-web" containerID="cri-o://fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199" gracePeriod=120
Sep 09 16:14:58.075040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.074951    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerID="2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2" exitCode=0
Sep 09 16:14:58.075040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.074980    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerID="fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491" exitCode=0
Sep 09 16:14:58.075040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.074987    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerID="4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3" exitCode=0
Sep 09 16:14:58.075040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.074992    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerID="02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d" exitCode=0
Sep 09 16:14:58.075040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.075010    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerDied","Data":"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2"}
Sep 09 16:14:58.075285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.075086    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerDied","Data":"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491"}
Sep 09 16:14:58.075285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.075111    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerDied","Data":"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3"}
Sep 09 16:14:58.075285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.075135    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerDied","Data":"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d"}
Sep 09 16:14:58.898248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.898222    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:58.970670 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970600    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-web-config\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.970670 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970639    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-config-volume\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.970898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970671    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-config-out\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.970898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970698    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-main-tls\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.970898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970730    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-cluster-tls-config\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.970898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970781    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.970898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970837    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-main-db\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.970898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970869    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-tls-assets\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.971210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970907    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-web\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.971210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970948    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-metrics-client-ca\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.971210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.970977    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-trusted-ca-bundle\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.971210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.971008    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxvck\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-kube-api-access-gxvck\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.971210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.971066    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3fee4f87-8441-49d7-ab85-dd347361f8be\" (UID: \"3fee4f87-8441-49d7-ab85-dd347361f8be\") "
Sep 09 16:14:58.971766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.971727    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:58.972165 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.972016    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:14:58.972165 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.972137    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:14:58.973805 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.973745    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:58.974929 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.974900    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:58.975035 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.974922    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:58.975153 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.975119    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-config-out" (OuterVolumeSpecName: "config-out") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:14:58.975153 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.975130    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-config-volume" (OuterVolumeSpecName: "config-volume") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:58.975414 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.975378    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:58.975479 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.975466    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:58.975728 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.975699    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-kube-api-access-gxvck" (OuterVolumeSpecName: "kube-api-access-gxvck") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "kube-api-access-gxvck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:14:58.979174 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.979148    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:58.985486 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:58.985461    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-web-config" (OuterVolumeSpecName: "web-config") pod "3fee4f87-8441-49d7-ab85-dd347361f8be" (UID: "3fee4f87-8441-49d7-ab85-dd347361f8be"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:14:59.072089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072061    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072087    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-web-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072098    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072106    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-config-out\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072115    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-main-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072123    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-cluster-tls-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072132    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072141    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-main-db\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072149    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-tls-assets\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072157    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fee4f87-8441-49d7-ab85-dd347361f8be-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072164    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-metrics-client-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072173    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fee4f87-8441-49d7-ab85-dd347361f8be-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.072240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.072181    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxvck\" (UniqueName: \"kubernetes.io/projected/3fee4f87-8441-49d7-ab85-dd347361f8be-kube-api-access-gxvck\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:14:59.082328 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.082302    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerID="6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a" exitCode=0
Sep 09 16:14:59.082328 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.082323    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerID="fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199" exitCode=0
Sep 09 16:14:59.082491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.082347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerDied","Data":"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a"}
Sep 09 16:14:59.082491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.082393    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.082491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.082410    2567 scope.go:117] "RemoveContainer" containerID="2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2"
Sep 09 16:14:59.082649 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.082401    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerDied","Data":"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199"}
Sep 09 16:14:59.082649 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.082592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fee4f87-8441-49d7-ab85-dd347361f8be","Type":"ContainerDied","Data":"34a57a618204a785b1103cf7a7040e64007e86c6a47cb2bcae00a1464db93140"}
Sep 09 16:14:59.092232 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.092212    2567 scope.go:117] "RemoveContainer" containerID="6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a"
Sep 09 16:14:59.099204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.099188    2567 scope.go:117] "RemoveContainer" containerID="fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491"
Sep 09 16:14:59.106644 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.106623    2567 scope.go:117] "RemoveContainer" containerID="fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199"
Sep 09 16:14:59.107890 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.107873    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:14:59.114004 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.113982    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:14:59.114737 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.114722    2567 scope.go:117] "RemoveContainer" containerID="4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3"
Sep 09 16:14:59.121821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.121758    2567 scope.go:117] "RemoveContainer" containerID="02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d"
Sep 09 16:14:59.128782 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.128750    2567 scope.go:117] "RemoveContainer" containerID="45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748"
Sep 09 16:14:59.135503 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.135483    2567 scope.go:117] "RemoveContainer" containerID="2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2"
Sep 09 16:14:59.135759 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:59.135740    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2\": container with ID starting with 2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2 not found: ID does not exist" containerID="2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2"
Sep 09 16:14:59.135848 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.135766    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2"} err="failed to get container status \"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2\": rpc error: code = NotFound desc = could not find container \"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2\": container with ID starting with 2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2 not found: ID does not exist"
Sep 09 16:14:59.135848 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.135806    2567 scope.go:117] "RemoveContainer" containerID="6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a"
Sep 09 16:14:59.136027 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:59.136008    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a\": container with ID starting with 6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a not found: ID does not exist" containerID="6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a"
Sep 09 16:14:59.136088 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.136035    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a"} err="failed to get container status \"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a\": rpc error: code = NotFound desc = could not find container \"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a\": container with ID starting with 6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a not found: ID does not exist"
Sep 09 16:14:59.136088 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.136059    2567 scope.go:117] "RemoveContainer" containerID="fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491"
Sep 09 16:14:59.136329 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:59.136313    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491\": container with ID starting with fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491 not found: ID does not exist" containerID="fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491"
Sep 09 16:14:59.136387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.136336    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491"} err="failed to get container status \"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491\": rpc error: code = NotFound desc = could not find container \"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491\": container with ID starting with fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491 not found: ID does not exist"
Sep 09 16:14:59.136387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.136358    2567 scope.go:117] "RemoveContainer" containerID="fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199"
Sep 09 16:14:59.136598 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:59.136582    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199\": container with ID starting with fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199 not found: ID does not exist" containerID="fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199"
Sep 09 16:14:59.136635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.136602    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199"} err="failed to get container status \"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199\": rpc error: code = NotFound desc = could not find container \"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199\": container with ID starting with fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199 not found: ID does not exist"
Sep 09 16:14:59.136635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.136617    2567 scope.go:117] "RemoveContainer" containerID="4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3"
Sep 09 16:14:59.136844 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:59.136822    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3\": container with ID starting with 4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3 not found: ID does not exist" containerID="4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3"
Sep 09 16:14:59.136920 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.136883    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3"} err="failed to get container status \"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3\": rpc error: code = NotFound desc = could not find container \"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3\": container with ID starting with 4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3 not found: ID does not exist"
Sep 09 16:14:59.136962 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.136932    2567 scope.go:117] "RemoveContainer" containerID="02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d"
Sep 09 16:14:59.137324 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:59.137299    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d\": container with ID starting with 02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d not found: ID does not exist" containerID="02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d"
Sep 09 16:14:59.137421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.137332    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d"} err="failed to get container status \"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d\": rpc error: code = NotFound desc = could not find container \"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d\": container with ID starting with 02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d not found: ID does not exist"
Sep 09 16:14:59.137421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.137353    2567 scope.go:117] "RemoveContainer" containerID="45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748"
Sep 09 16:14:59.137680 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:14:59.137659    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748\": container with ID starting with 45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748 not found: ID does not exist" containerID="45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748"
Sep 09 16:14:59.137823 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.137760    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748"} err="failed to get container status \"45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748\": rpc error: code = NotFound desc = could not find container \"45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748\": container with ID starting with 45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748 not found: ID does not exist"
Sep 09 16:14:59.137823 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.137818    2567 scope.go:117] "RemoveContainer" containerID="2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2"
Sep 09 16:14:59.138135 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.138105    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2"} err="failed to get container status \"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2\": rpc error: code = NotFound desc = could not find container \"2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2\": container with ID starting with 2a353132929444b1a44e435aed77c4920a8d178bf2ef5a7414d180e8214724d2 not found: ID does not exist"
Sep 09 16:14:59.138135 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.138135    2567 scope.go:117] "RemoveContainer" containerID="6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a"
Sep 09 16:14:59.138419 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.138402    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a"} err="failed to get container status \"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a\": rpc error: code = NotFound desc = could not find container \"6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a\": container with ID starting with 6dfdf0628dbc537065eb6fee75da0c890742dcb0bceffdd9c5a1a6de301f460a not found: ID does not exist"
Sep 09 16:14:59.138419 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.138419    2567 scope.go:117] "RemoveContainer" containerID="fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491"
Sep 09 16:14:59.138638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.138623    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491"} err="failed to get container status \"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491\": rpc error: code = NotFound desc = could not find container \"fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491\": container with ID starting with fe8fdb1a17d20fb85a59369e13066e4fb99fa568865477194eaa759882482491 not found: ID does not exist"
Sep 09 16:14:59.138679 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.138637    2567 scope.go:117] "RemoveContainer" containerID="fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199"
Sep 09 16:14:59.138939 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.138922    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199"} err="failed to get container status \"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199\": rpc error: code = NotFound desc = could not find container \"fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199\": container with ID starting with fadd0b948939c4fae37ebf8fc86ffa9e98d62762b32d2dc9e86e940fd6cc1199 not found: ID does not exist"
Sep 09 16:14:59.138998 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.138941    2567 scope.go:117] "RemoveContainer" containerID="4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3"
Sep 09 16:14:59.139119 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139100    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:14:59.139195 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139179    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3"} err="failed to get container status \"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3\": rpc error: code = NotFound desc = could not find container \"4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3\": container with ID starting with 4829d53ed1c262fc92ac7cea173d5229b9cc307a1510afa262a5c4c9a08f2ba3 not found: ID does not exist"
Sep 09 16:14:59.139237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139195    2567 scope.go:117] "RemoveContainer" containerID="02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d"
Sep 09 16:14:59.139452 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139430    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d"} err="failed to get container status \"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d\": rpc error: code = NotFound desc = could not find container \"02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d\": container with ID starting with 02fe144ff7d4e9c1b46b6d178b108a70400e9eb09fcb2e934e0c52c35629688d not found: ID does not exist"
Sep 09 16:14:59.139493 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139458    2567 scope.go:117] "RemoveContainer" containerID="45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748"
Sep 09 16:14:59.139533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139441    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="config-reloader"
Sep 09 16:14:59.139533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139506    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="config-reloader"
Sep 09 16:14:59.139533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139527    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy-metric"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139537    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy-metric"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139553    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="prom-label-proxy"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139561    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="prom-label-proxy"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139575    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139584    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139599    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="init-config-reloader"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139607    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="init-config-reloader"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139617    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy-web"
Sep 09 16:14:59.139642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139625    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy-web"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139646    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02af37c4-aa31-45e1-a88c-00cab8be3e77" containerName="console"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139654    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="02af37c4-aa31-45e1-a88c-00cab8be3e77" containerName="console"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139665    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cb7d6f9-896f-4de3-b644-02091a56a39a" containerName="registry"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139673    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cb7d6f9-896f-4de3-b644-02091a56a39a" containerName="registry"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139686    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="alertmanager"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139694    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="alertmanager"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139755    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748"} err="failed to get container status \"45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748\": rpc error: code = NotFound desc = could not find container \"45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748\": container with ID starting with 45c6d6f39918e77c707cec3c1681eb8d635b0ecc12e00f0daa1df1e8626ad748 not found: ID does not exist"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139764    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="alertmanager"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139795    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy-metric"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139802    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="prom-label-proxy"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139808    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139818    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="config-reloader"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139823    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cb7d6f9-896f-4de3-b644-02091a56a39a" containerName="registry"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139829    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" containerName="kube-rbac-proxy-web"
Sep 09 16:14:59.140030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.139836    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="02af37c4-aa31-45e1-a88c-00cab8be3e77" containerName="console"
Sep 09 16:14:59.143332 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.143316    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.145801 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.145781    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 16:14:59.145993 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.145888    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 16:14:59.145993 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.145910    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-f8j8r\""
Sep 09 16:14:59.145993 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.145957    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 16:14:59.145993 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.145992    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 16:14:59.146240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.146010    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 16:14:59.146240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.146103    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 16:14:59.146240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.146205    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 16:14:59.146240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.146205    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 16:14:59.150898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.150881    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 16:14:59.159860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.159841    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:14:59.273070 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.272998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273070 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273070 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-config-out\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273173    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-web-config\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273230    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273467 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273467 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.273467 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.273313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blqn6\" (UniqueName: \"kubernetes.io/projected/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-kube-api-access-blqn6\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.373984 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.373952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.373984 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.373986    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374191 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374014    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374191 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374033    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blqn6\" (UniqueName: \"kubernetes.io/projected/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-kube-api-access-blqn6\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374191 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374259    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-config-out\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-web-config\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374689 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.374689 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.374469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.375411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.375020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.375411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.375126    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.375411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.375149    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.377053 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.377025    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.377204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.377183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.377302 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.377273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.377417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.377349    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.377484 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.377432    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.377544 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.377478    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.377704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.377685    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-web-config\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.377841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.377824    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-config-out\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.378929 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.378911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.381557 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.381539    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blqn6\" (UniqueName: \"kubernetes.io/projected/7a92e59e-bcec-4a06-87e9-80dcf5d003e6-kube-api-access-blqn6\") pod \"alertmanager-main-0\" (UID: \"7a92e59e-bcec-4a06-87e9-80dcf5d003e6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.452589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.452554    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:14:59.731629 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:14:59.731601    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:14:59.733025 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:14:59.732990    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a92e59e_bcec_4a06_87e9_80dcf5d003e6.slice/crio-b8480ac43492a72a4062499ccef6bfc7b857f0cea3d897b70c4c55176978e141 WatchSource:0}: Error finding container b8480ac43492a72a4062499ccef6bfc7b857f0cea3d897b70c4c55176978e141: Status 404 returned error can't find the container with id b8480ac43492a72a4062499ccef6bfc7b857f0cea3d897b70c4c55176978e141
Sep 09 16:15:00.089615 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:00.089528    2567 generic.go:356] "Generic (PLEG): container finished" podID="7a92e59e-bcec-4a06-87e9-80dcf5d003e6" containerID="41dd0401b322a82206b2c870d3cd28dad6febf53ce25dcea3c640912bc67a991" exitCode=0
Sep 09 16:15:00.090093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:00.089610    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a92e59e-bcec-4a06-87e9-80dcf5d003e6","Type":"ContainerDied","Data":"41dd0401b322a82206b2c870d3cd28dad6febf53ce25dcea3c640912bc67a991"}
Sep 09 16:15:00.090093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:00.089729    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a92e59e-bcec-4a06-87e9-80dcf5d003e6","Type":"ContainerStarted","Data":"b8480ac43492a72a4062499ccef6bfc7b857f0cea3d897b70c4c55176978e141"}
Sep 09 16:15:00.392220 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:00.392190    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:00.483487 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:00.483455    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:00.736899 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:00.736868    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fee4f87-8441-49d7-ab85-dd347361f8be" path="/var/lib/kubelet/pods/3fee4f87-8441-49d7-ab85-dd347361f8be/volumes"
Sep 09 16:15:00.851002 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:00.850971    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:00.951503 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:00.951469    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:01.097537 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.097451    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a92e59e-bcec-4a06-87e9-80dcf5d003e6","Type":"ContainerStarted","Data":"b1418be32757be9effcc07bace64b92b18f099ae5193942ad6316eb63b36fcec"}
Sep 09 16:15:01.097537 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.097527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a92e59e-bcec-4a06-87e9-80dcf5d003e6","Type":"ContainerStarted","Data":"917d000ee258708fa085cbd7ee9aff57a88e3fd93e72ff5003e46d61caf93462"}
Sep 09 16:15:01.097945 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.097556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a92e59e-bcec-4a06-87e9-80dcf5d003e6","Type":"ContainerStarted","Data":"04c1ca8cf9141709d0b584b01ccc92dbeb0e6caccd8fa805ab7ef0b20c1eb1d3"}
Sep 09 16:15:01.097945 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.097585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a92e59e-bcec-4a06-87e9-80dcf5d003e6","Type":"ContainerStarted","Data":"d6119da429d340f419b8b3132531713fb1875b372f5cd6e3a75e2e0e23862d93"}
Sep 09 16:15:01.097945 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.097625    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a92e59e-bcec-4a06-87e9-80dcf5d003e6","Type":"ContainerStarted","Data":"6e314bbbed16259827ffb37c158388426e365e0f6b28220c88a19a12e9ec4479"}
Sep 09 16:15:01.097945 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.097652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a92e59e-bcec-4a06-87e9-80dcf5d003e6","Type":"ContainerStarted","Data":"a33ed5fa8d0a00a0176d1870a0b78e09d06925e91f500b4912d4caba2a9fabdb"}
Sep 09 16:15:01.133237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.133178    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.11921639 podStartE2EDuration="2.133160677s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.944287ms" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:15:01.13185909 +0000 UTC m=+398.902950348" watchObservedRunningTime="2026-09-09 16:15:01.133160677 +0000 UTC m=+398.904251923"
Sep 09 16:15:01.331291 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.331257    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-686f6788fb-v24qm"]
Sep 09 16:15:01.334096 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.334075    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.347093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.347051    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686f6788fb-v24qm"]
Sep 09 16:15:01.392899 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.392859    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-trusted-ca-bundle\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.392899 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.392903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-config\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.393126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.392927    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-oauth-serving-cert\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.393126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.392949    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxznn\" (UniqueName: \"kubernetes.io/projected/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-kube-api-access-gxznn\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.393126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.393015    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-service-ca\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.393126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.393080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-oauth-config\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.393126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.393115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-serving-cert\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.404423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.404363    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:01.474944 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.474908    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:01.494116 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.494079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-oauth-config\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.494270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.494130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-serving-cert\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.494270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.494183    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-trusted-ca-bundle\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.494270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.494208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-config\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.494270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.494230    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-oauth-serving-cert\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.494270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.494253    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxznn\" (UniqueName: \"kubernetes.io/projected/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-kube-api-access-gxznn\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.494493 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.494290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-service-ca\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.494952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.494925    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-oauth-serving-cert\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.495104 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.495032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-config\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.495166 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.495108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-service-ca\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.495166 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.495126    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-trusted-ca-bundle\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.496651 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.496623    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-serving-cert\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.496740 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.496655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-oauth-config\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.504188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.504169    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxznn\" (UniqueName: \"kubernetes.io/projected/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-kube-api-access-gxznn\") pod \"console-686f6788fb-v24qm\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") " pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.567074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.567026    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:01.644084 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.643994    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:01.940736 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:01.940702    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686f6788fb-v24qm"]
Sep 09 16:15:01.943390 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:15:01.943365    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda436f9ca_c6f1_4c44_bde6_f3f5b97cef0d.slice/crio-c45e006071ea93730a5e280cf6eeea59d031350d1e88efb7c99c184d93376881 WatchSource:0}: Error finding container c45e006071ea93730a5e280cf6eeea59d031350d1e88efb7c99c184d93376881: Status 404 returned error can't find the container with id c45e006071ea93730a5e280cf6eeea59d031350d1e88efb7c99c184d93376881
Sep 09 16:15:02.107083 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:02.107037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f6788fb-v24qm" event={"ID":"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d","Type":"ContainerStarted","Data":"9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6"}
Sep 09 16:15:02.107478 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:02.107129    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f6788fb-v24qm" event={"ID":"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d","Type":"ContainerStarted","Data":"c45e006071ea93730a5e280cf6eeea59d031350d1e88efb7c99c184d93376881"}
Sep 09 16:15:02.125421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:02.125366    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-686f6788fb-v24qm" podStartSLOduration=1.12535163 podStartE2EDuration="1.12535163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:15:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:15:02.124067464 +0000 UTC m=+399.895158725" watchObservedRunningTime="2026-09-09 16:15:02.12535163 +0000 UTC m=+399.896442877"
Sep 09 16:15:02.128025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:02.128000    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:02.228808 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:02.228720    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:05.425086 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:05.425052    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:05.504874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:05.504843    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:11.644222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:11.644183    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:11.644646 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:11.644326    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:11.648909 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:11.648885    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:12.154646 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:12.154618    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:15:12.201553 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:12.201520    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b6d99d5c-jttxg"]
Sep 09 16:15:12.314638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:12.314603    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:12.414309 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:12.414228    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:12.470372 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:12.470344    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:17.737004 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:17.736966    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:17.834443 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:17.834409    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:28.296499 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:28.296461    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:37.221906 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.221846    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54b6d99d5c-jttxg" podUID="4702de10-e8cf-4826-863a-5731b16f7b83" containerName="console" containerID="cri-o://be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552" gracePeriod=15
Sep 09 16:15:37.462418 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.462395    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:15:37.502823 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.502750    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-oauth-config\") pod \"4702de10-e8cf-4826-863a-5731b16f7b83\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") "
Sep 09 16:15:37.502966 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.502824    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-oauth-serving-cert\") pod \"4702de10-e8cf-4826-863a-5731b16f7b83\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") "
Sep 09 16:15:37.502966 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.502852    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-console-config\") pod \"4702de10-e8cf-4826-863a-5731b16f7b83\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") "
Sep 09 16:15:37.502966 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.502927    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-trusted-ca-bundle\") pod \"4702de10-e8cf-4826-863a-5731b16f7b83\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") "
Sep 09 16:15:37.502966 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.502948    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-service-ca\") pod \"4702de10-e8cf-4826-863a-5731b16f7b83\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") "
Sep 09 16:15:37.503169 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.502968    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbg94\" (UniqueName: \"kubernetes.io/projected/4702de10-e8cf-4826-863a-5731b16f7b83-kube-api-access-cbg94\") pod \"4702de10-e8cf-4826-863a-5731b16f7b83\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") "
Sep 09 16:15:37.503169 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.502987    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-serving-cert\") pod \"4702de10-e8cf-4826-863a-5731b16f7b83\" (UID: \"4702de10-e8cf-4826-863a-5731b16f7b83\") "
Sep 09 16:15:37.503353 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.503325    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4702de10-e8cf-4826-863a-5731b16f7b83" (UID: "4702de10-e8cf-4826-863a-5731b16f7b83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:15:37.503415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.503334    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4702de10-e8cf-4826-863a-5731b16f7b83" (UID: "4702de10-e8cf-4826-863a-5731b16f7b83"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:15:37.503415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.503366    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-console-config" (OuterVolumeSpecName: "console-config") pod "4702de10-e8cf-4826-863a-5731b16f7b83" (UID: "4702de10-e8cf-4826-863a-5731b16f7b83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:15:37.503415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.503370    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-service-ca" (OuterVolumeSpecName: "service-ca") pod "4702de10-e8cf-4826-863a-5731b16f7b83" (UID: "4702de10-e8cf-4826-863a-5731b16f7b83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:15:37.504873 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.504842    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4702de10-e8cf-4826-863a-5731b16f7b83" (UID: "4702de10-e8cf-4826-863a-5731b16f7b83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:15:37.505027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.505008    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4702de10-e8cf-4826-863a-5731b16f7b83" (UID: "4702de10-e8cf-4826-863a-5731b16f7b83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:15:37.505072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.505011    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4702de10-e8cf-4826-863a-5731b16f7b83-kube-api-access-cbg94" (OuterVolumeSpecName: "kube-api-access-cbg94") pod "4702de10-e8cf-4826-863a-5731b16f7b83" (UID: "4702de10-e8cf-4826-863a-5731b16f7b83"). InnerVolumeSpecName "kube-api-access-cbg94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:15:37.603892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.603866    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-console-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:15:37.603892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.603890    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-trusted-ca-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:15:37.603892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.603899    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:15:37.604092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.603908    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbg94\" (UniqueName: \"kubernetes.io/projected/4702de10-e8cf-4826-863a-5731b16f7b83-kube-api-access-cbg94\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:15:37.604092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.603917    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:15:37.604092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.603925    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4702de10-e8cf-4826-863a-5731b16f7b83-console-oauth-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:15:37.604092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:37.603933    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4702de10-e8cf-4826-863a-5731b16f7b83-oauth-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:15:38.270606 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.270573    2567 generic.go:356] "Generic (PLEG): container finished" podID="4702de10-e8cf-4826-863a-5731b16f7b83" containerID="be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552" exitCode=0
Sep 09 16:15:38.271060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.270623    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b6d99d5c-jttxg"
Sep 09 16:15:38.271060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.270664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b6d99d5c-jttxg" event={"ID":"4702de10-e8cf-4826-863a-5731b16f7b83","Type":"ContainerDied","Data":"be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552"}
Sep 09 16:15:38.271060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.270716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b6d99d5c-jttxg" event={"ID":"4702de10-e8cf-4826-863a-5731b16f7b83","Type":"ContainerDied","Data":"f1e759c17de1908ee15150c37b0f5f105c9e354f54540269f9686590928729da"}
Sep 09 16:15:38.271060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.270740    2567 scope.go:117] "RemoveContainer" containerID="be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552"
Sep 09 16:15:38.279917 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.279900    2567 scope.go:117] "RemoveContainer" containerID="be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552"
Sep 09 16:15:38.280179 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:15:38.280161    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552\": container with ID starting with be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552 not found: ID does not exist" containerID="be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552"
Sep 09 16:15:38.280217 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.280188    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552"} err="failed to get container status \"be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552\": rpc error: code = NotFound desc = could not find container \"be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552\": container with ID starting with be422d7ac1d11f1b9d0349ead6fd91e3c7d5cdab8be3c3426b12d1c6d9816552 not found: ID does not exist"
Sep 09 16:15:38.292274 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.292249    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b6d99d5c-jttxg"]
Sep 09 16:15:38.294519 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.294499    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b6d99d5c-jttxg"]
Sep 09 16:15:38.736374 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:38.736344    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4702de10-e8cf-4826-863a-5731b16f7b83" path="/var/lib/kubelet/pods/4702de10-e8cf-4826-863a-5731b16f7b83/volumes"
Sep 09 16:15:48.101012 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:48.100938    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:48.180044 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:15:48.180011    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:09.357436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:09.357406    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:09.457120 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:09.457089    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:10.037878 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.037839    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"]
Sep 09 16:16:10.038276 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.038257    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4702de10-e8cf-4826-863a-5731b16f7b83" containerName="console"
Sep 09 16:16:10.038368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.038279    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4702de10-e8cf-4826-863a-5731b16f7b83" containerName="console"
Sep 09 16:16:10.038425 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.038395    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4702de10-e8cf-4826-863a-5731b16f7b83" containerName="console"
Sep 09 16:16:10.041747 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.041717    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.044391 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.044371    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:16:10.045280 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.045262    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g79mz\""
Sep 09 16:16:10.045368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.045263    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:16:10.051025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.051005    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"]
Sep 09 16:16:10.176196 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.176157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.176368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.176247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.176368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.176269    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frjsz\" (UniqueName: \"kubernetes.io/projected/a342ea95-6e3f-45c2-b354-69cca3c3bc12-kube-api-access-frjsz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.277053 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.277013    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.277190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.277056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frjsz\" (UniqueName: \"kubernetes.io/projected/a342ea95-6e3f-45c2-b354-69cca3c3bc12-kube-api-access-frjsz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.277190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.277102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.277476 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.277454    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.277512 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.277489    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.285553 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.285526    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frjsz\" (UniqueName: \"kubernetes.io/projected/a342ea95-6e3f-45c2-b354-69cca3c3bc12-kube-api-access-frjsz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.351300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.351214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:10.619908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:10.619885    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"]
Sep 09 16:16:10.622266 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:16:10.622233    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda342ea95_6e3f_45c2_b354_69cca3c3bc12.slice/crio-199ef73920f7637f8d01c76967c21b4429b4a73b2161cbe9d8733d3136dc1c55 WatchSource:0}: Error finding container 199ef73920f7637f8d01c76967c21b4429b4a73b2161cbe9d8733d3136dc1c55: Status 404 returned error can't find the container with id 199ef73920f7637f8d01c76967c21b4429b4a73b2161cbe9d8733d3136dc1c55
Sep 09 16:16:11.418751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:11.418715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52" event={"ID":"a342ea95-6e3f-45c2-b354-69cca3c3bc12","Type":"ContainerStarted","Data":"199ef73920f7637f8d01c76967c21b4429b4a73b2161cbe9d8733d3136dc1c55"}
Sep 09 16:16:17.450489 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:17.450450    2567 generic.go:356] "Generic (PLEG): container finished" podID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerID="89b66a06488f3e318445d830e855c965d50869c03c52f5a9979aea44b999567a" exitCode=0
Sep 09 16:16:17.450834 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:17.450535    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52" event={"ID":"a342ea95-6e3f-45c2-b354-69cca3c3bc12","Type":"ContainerDied","Data":"89b66a06488f3e318445d830e855c965d50869c03c52f5a9979aea44b999567a"}
Sep 09 16:16:20.468209 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:20.468175    2567 generic.go:356] "Generic (PLEG): container finished" podID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerID="798eb0b2cab8fa746b6f83aa140f4777dd7581d83189325e00e1379ffd35c2d4" exitCode=0
Sep 09 16:16:20.468676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:20.468234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52" event={"ID":"a342ea95-6e3f-45c2-b354-69cca3c3bc12","Type":"ContainerDied","Data":"798eb0b2cab8fa746b6f83aa140f4777dd7581d83189325e00e1379ffd35c2d4"}
Sep 09 16:16:29.516485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:29.516448    2567 generic.go:356] "Generic (PLEG): container finished" podID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerID="02936f97cdda3611fea899dd8a7aabc6db6783c3fb413c0fc183d03f8b42002c" exitCode=0
Sep 09 16:16:29.516894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:29.516526    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52" event={"ID":"a342ea95-6e3f-45c2-b354-69cca3c3bc12","Type":"ContainerDied","Data":"02936f97cdda3611fea899dd8a7aabc6db6783c3fb413c0fc183d03f8b42002c"}
Sep 09 16:16:30.650405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.650382    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:30.746616 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.746584    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-bundle\") pod \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") "
Sep 09 16:16:30.746804 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.746648    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-util\") pod \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") "
Sep 09 16:16:30.746804 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.746708    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frjsz\" (UniqueName: \"kubernetes.io/projected/a342ea95-6e3f-45c2-b354-69cca3c3bc12-kube-api-access-frjsz\") pod \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\" (UID: \"a342ea95-6e3f-45c2-b354-69cca3c3bc12\") "
Sep 09 16:16:30.747273 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.747241    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-bundle" (OuterVolumeSpecName: "bundle") pod "a342ea95-6e3f-45c2-b354-69cca3c3bc12" (UID: "a342ea95-6e3f-45c2-b354-69cca3c3bc12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:16:30.748913 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.748885    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a342ea95-6e3f-45c2-b354-69cca3c3bc12-kube-api-access-frjsz" (OuterVolumeSpecName: "kube-api-access-frjsz") pod "a342ea95-6e3f-45c2-b354-69cca3c3bc12" (UID: "a342ea95-6e3f-45c2-b354-69cca3c3bc12"). InnerVolumeSpecName "kube-api-access-frjsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:16:30.751399 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.751372    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-util" (OuterVolumeSpecName: "util") pod "a342ea95-6e3f-45c2-b354-69cca3c3bc12" (UID: "a342ea95-6e3f-45c2-b354-69cca3c3bc12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:16:30.847362 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.847283    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frjsz\" (UniqueName: \"kubernetes.io/projected/a342ea95-6e3f-45c2-b354-69cca3c3bc12-kube-api-access-frjsz\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:16:30.847362 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.847314    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:16:30.847362 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:30.847323    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a342ea95-6e3f-45c2-b354-69cca3c3bc12-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:16:31.526819 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:31.526765    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52" event={"ID":"a342ea95-6e3f-45c2-b354-69cca3c3bc12","Type":"ContainerDied","Data":"199ef73920f7637f8d01c76967c21b4429b4a73b2161cbe9d8733d3136dc1c55"}
Sep 09 16:16:31.527011 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:31.526822    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tqk52"
Sep 09 16:16:31.527011 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:31.526830    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="199ef73920f7637f8d01c76967c21b4429b4a73b2161cbe9d8733d3136dc1c55"
Sep 09 16:16:36.098609 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:36.098574    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:36.923948 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:36.923916    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:38.060192 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.060160    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"]
Sep 09 16:16:38.060549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.060476    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerName="pull"
Sep 09 16:16:38.060549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.060487    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerName="pull"
Sep 09 16:16:38.060549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.060496    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerName="extract"
Sep 09 16:16:38.060549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.060501    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerName="extract"
Sep 09 16:16:38.060549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.060513    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerName="util"
Sep 09 16:16:38.060549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.060518    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerName="util"
Sep 09 16:16:38.060736 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.060587    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a342ea95-6e3f-45c2-b354-69cca3c3bc12" containerName="extract"
Sep 09 16:16:38.066352 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.066331    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"
Sep 09 16:16:38.069465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.069442    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 16:16:38.069570 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.069475    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:16:38.069706 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.069688    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m5vrg\""
Sep 09 16:16:38.074657 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.074633    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"]
Sep 09 16:16:38.100492 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.100468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763ef828-3d01-4c63-8f5f-db83b7145de6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xtlt2\" (UID: \"763ef828-3d01-4c63-8f5f-db83b7145de6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"
Sep 09 16:16:38.100580 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.100524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qxbt\" (UniqueName: \"kubernetes.io/projected/763ef828-3d01-4c63-8f5f-db83b7145de6-kube-api-access-8qxbt\") pod \"cert-manager-operator-controller-manager-55c444bf86-xtlt2\" (UID: \"763ef828-3d01-4c63-8f5f-db83b7145de6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"
Sep 09 16:16:38.201935 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.201907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qxbt\" (UniqueName: \"kubernetes.io/projected/763ef828-3d01-4c63-8f5f-db83b7145de6-kube-api-access-8qxbt\") pod \"cert-manager-operator-controller-manager-55c444bf86-xtlt2\" (UID: \"763ef828-3d01-4c63-8f5f-db83b7145de6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"
Sep 09 16:16:38.202020 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.201966    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763ef828-3d01-4c63-8f5f-db83b7145de6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xtlt2\" (UID: \"763ef828-3d01-4c63-8f5f-db83b7145de6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"
Sep 09 16:16:38.202286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.202271    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763ef828-3d01-4c63-8f5f-db83b7145de6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xtlt2\" (UID: \"763ef828-3d01-4c63-8f5f-db83b7145de6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"
Sep 09 16:16:38.209310 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.209281    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qxbt\" (UniqueName: \"kubernetes.io/projected/763ef828-3d01-4c63-8f5f-db83b7145de6-kube-api-access-8qxbt\") pod \"cert-manager-operator-controller-manager-55c444bf86-xtlt2\" (UID: \"763ef828-3d01-4c63-8f5f-db83b7145de6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"
Sep 09 16:16:38.376340 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.376311    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"
Sep 09 16:16:38.652985 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:38.652913    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2"]
Sep 09 16:16:38.656532 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:16:38.656511    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763ef828_3d01_4c63_8f5f_db83b7145de6.slice/crio-147fa0aa1e2d19646a8976d8f46cefa0878788c6ff5e063090b99f07c19edc46 WatchSource:0}: Error finding container 147fa0aa1e2d19646a8976d8f46cefa0878788c6ff5e063090b99f07c19edc46: Status 404 returned error can't find the container with id 147fa0aa1e2d19646a8976d8f46cefa0878788c6ff5e063090b99f07c19edc46
Sep 09 16:16:39.561074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:39.561042    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2" event={"ID":"763ef828-3d01-4c63-8f5f-db83b7145de6","Type":"ContainerStarted","Data":"147fa0aa1e2d19646a8976d8f46cefa0878788c6ff5e063090b99f07c19edc46"}
Sep 09 16:16:39.713479 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:39.713444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:39.813448 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:39.813373    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:43.582332 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:43.582253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2" event={"ID":"763ef828-3d01-4c63-8f5f-db83b7145de6","Type":"ContainerStarted","Data":"b7bea5bda8ebebf155383fbcbb888a98216a8538f32c101959a3aafcade45042"}
Sep 09 16:16:43.603366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:43.603314    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xtlt2" podStartSLOduration=1.018818173 podStartE2EDuration="5.603296056s" totalImagesPullingTime="4.584477883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:16:43.600740776 +0000 UTC m=+501.371832078" watchObservedRunningTime="2026-09-09 16:16:43.603296056 +0000 UTC m=+501.374387302"
Sep 09 16:16:44.014349 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.014314    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:44.131252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.131223    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:44.240589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.240557    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:44.485607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.485572    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xgthr"]
Sep 09 16:16:44.489090 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.489072    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:44.491616 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.491594    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 16:16:44.492412 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.492397    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 16:16:44.492473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.492399    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pl25w\""
Sep 09 16:16:44.498478 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.498453    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xgthr"]
Sep 09 16:16:44.550545 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.550515    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdmj\" (UniqueName: \"kubernetes.io/projected/eb9cd214-fc0c-4202-98a2-d629fb2e3887-kube-api-access-2sdmj\") pod \"cert-manager-webhook-6486ffd997-xgthr\" (UID: \"eb9cd214-fc0c-4202-98a2-d629fb2e3887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:44.550686 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.550586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb9cd214-fc0c-4202-98a2-d629fb2e3887-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xgthr\" (UID: \"eb9cd214-fc0c-4202-98a2-d629fb2e3887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:44.650985 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.650948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb9cd214-fc0c-4202-98a2-d629fb2e3887-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xgthr\" (UID: \"eb9cd214-fc0c-4202-98a2-d629fb2e3887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:44.651443 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.651009    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdmj\" (UniqueName: \"kubernetes.io/projected/eb9cd214-fc0c-4202-98a2-d629fb2e3887-kube-api-access-2sdmj\") pod \"cert-manager-webhook-6486ffd997-xgthr\" (UID: \"eb9cd214-fc0c-4202-98a2-d629fb2e3887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:44.658791 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.658745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb9cd214-fc0c-4202-98a2-d629fb2e3887-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xgthr\" (UID: \"eb9cd214-fc0c-4202-98a2-d629fb2e3887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:44.658937 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.658919    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdmj\" (UniqueName: \"kubernetes.io/projected/eb9cd214-fc0c-4202-98a2-d629fb2e3887-kube-api-access-2sdmj\") pod \"cert-manager-webhook-6486ffd997-xgthr\" (UID: \"eb9cd214-fc0c-4202-98a2-d629fb2e3887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:44.817388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.817300    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:44.922423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.922388    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"]
Sep 09 16:16:44.926995 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.926978    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:44.929393 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.929371    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g79mz\""
Sep 09 16:16:44.929573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.929401    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:16:44.929645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.929609    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:16:44.934669 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.934642    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"]
Sep 09 16:16:44.953259 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.953229    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:44.953378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.953279    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:44.953378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:44.953335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7bz9\" (UniqueName: \"kubernetes.io/projected/f27afea6-12a4-422b-bfdb-4bbb889b03b5-kube-api-access-c7bz9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:45.054457 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.054409    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:45.054607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.054474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:45.054607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.054503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7bz9\" (UniqueName: \"kubernetes.io/projected/f27afea6-12a4-422b-bfdb-4bbb889b03b5-kube-api-access-c7bz9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:45.054812 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.054792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:45.054855 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.054821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:45.069896 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.069825    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7bz9\" (UniqueName: \"kubernetes.io/projected/f27afea6-12a4-422b-bfdb-4bbb889b03b5-kube-api-access-c7bz9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:45.089137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.089115    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xgthr"]
Sep 09 16:16:45.091062 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:16:45.091036    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb9cd214_fc0c_4202_98a2_d629fb2e3887.slice/crio-c06dc538200134f33462f9cb2e1fa973081fcb56aec6133759e18acae2646711 WatchSource:0}: Error finding container c06dc538200134f33462f9cb2e1fa973081fcb56aec6133759e18acae2646711: Status 404 returned error can't find the container with id c06dc538200134f33462f9cb2e1fa973081fcb56aec6133759e18acae2646711
Sep 09 16:16:45.106690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.106663    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:45.207509 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.207462    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:45.242570 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.242536    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:45.511450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.511426    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"]
Sep 09 16:16:45.513376 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:16:45.513355    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27afea6_12a4_422b_bfdb_4bbb889b03b5.slice/crio-0e6c57249d42edf870855b52154f4d5d4cf023c8267cfa58623d3cd8f5bff5ae WatchSource:0}: Error finding container 0e6c57249d42edf870855b52154f4d5d4cf023c8267cfa58623d3cd8f5bff5ae: Status 404 returned error can't find the container with id 0e6c57249d42edf870855b52154f4d5d4cf023c8267cfa58623d3cd8f5bff5ae
Sep 09 16:16:45.593051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.593008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7" event={"ID":"f27afea6-12a4-422b-bfdb-4bbb889b03b5","Type":"ContainerStarted","Data":"cc9f8f66832f3e240c258150caf61a4b306531103eaac40e792715d190745578"}
Sep 09 16:16:45.593221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.593068    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7" event={"ID":"f27afea6-12a4-422b-bfdb-4bbb889b03b5","Type":"ContainerStarted","Data":"0e6c57249d42edf870855b52154f4d5d4cf023c8267cfa58623d3cd8f5bff5ae"}
Sep 09 16:16:45.594330 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:45.594304    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr" event={"ID":"eb9cd214-fc0c-4202-98a2-d629fb2e3887","Type":"ContainerStarted","Data":"c06dc538200134f33462f9cb2e1fa973081fcb56aec6133759e18acae2646711"}
Sep 09 16:16:46.511206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:46.511169    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:46.602385 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:46.602350    2567 generic.go:356] "Generic (PLEG): container finished" podID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerID="cc9f8f66832f3e240c258150caf61a4b306531103eaac40e792715d190745578" exitCode=0
Sep 09 16:16:46.602556 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:46.602446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7" event={"ID":"f27afea6-12a4-422b-bfdb-4bbb889b03b5","Type":"ContainerDied","Data":"cc9f8f66832f3e240c258150caf61a4b306531103eaac40e792715d190745578"}
Sep 09 16:16:46.723651 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:46.723614    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:48.614100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:48.614053    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr" event={"ID":"eb9cd214-fc0c-4202-98a2-d629fb2e3887","Type":"ContainerStarted","Data":"5aad00a7060e9f4790ea64d6302b4d7d4fe31674ea879deced4052a07c23f7af"}
Sep 09 16:16:48.614527 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:48.614152    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:48.629761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:48.629701    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr" podStartSLOduration=1.824769391 podStartE2EDuration="4.629681298s" totalImagesPullingTime="2.804911907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:16:48.628866245 +0000 UTC m=+506.399957490" watchObservedRunningTime="2026-09-09 16:16:48.629681298 +0000 UTC m=+506.400772544"
Sep 09 16:16:49.620079 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:49.620050    2567 generic.go:356] "Generic (PLEG): container finished" podID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerID="9670a9df0226b722fe5922f2a9fc13df3887666b526a30a1c18d2b2f5ff0ff17" exitCode=0
Sep 09 16:16:49.620465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:49.620135    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7" event={"ID":"f27afea6-12a4-422b-bfdb-4bbb889b03b5","Type":"ContainerDied","Data":"9670a9df0226b722fe5922f2a9fc13df3887666b526a30a1c18d2b2f5ff0ff17"}
Sep 09 16:16:50.627218 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:50.627184    2567 generic.go:356] "Generic (PLEG): container finished" podID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerID="7c8dc388c5ff5607e8ca92437bee42f8132c06fff1d7ce77748d04492e809eba" exitCode=0
Sep 09 16:16:50.627621 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:50.627253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7" event={"ID":"f27afea6-12a4-422b-bfdb-4bbb889b03b5","Type":"ContainerDied","Data":"7c8dc388c5ff5607e8ca92437bee42f8132c06fff1d7ce77748d04492e809eba"}
Sep 09 16:16:51.277642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.277607    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"]
Sep 09 16:16:51.281720 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.281703    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"
Sep 09 16:16:51.283879 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.283861    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jc5sz\""
Sep 09 16:16:51.289812 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.289762    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"]
Sep 09 16:16:51.414315 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.414244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8cgj\" (UniqueName: \"kubernetes.io/projected/be8c922e-bf15-4a8d-9375-ad558a150f60-kube-api-access-w8cgj\") pod \"cert-manager-cainjector-559cdd8c87-g4km5\" (UID: \"be8c922e-bf15-4a8d-9375-ad558a150f60\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"
Sep 09 16:16:51.414480 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.414329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8c922e-bf15-4a8d-9375-ad558a150f60-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g4km5\" (UID: \"be8c922e-bf15-4a8d-9375-ad558a150f60\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"
Sep 09 16:16:51.515529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.515488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8cgj\" (UniqueName: \"kubernetes.io/projected/be8c922e-bf15-4a8d-9375-ad558a150f60-kube-api-access-w8cgj\") pod \"cert-manager-cainjector-559cdd8c87-g4km5\" (UID: \"be8c922e-bf15-4a8d-9375-ad558a150f60\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"
Sep 09 16:16:51.515529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.515531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8c922e-bf15-4a8d-9375-ad558a150f60-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g4km5\" (UID: \"be8c922e-bf15-4a8d-9375-ad558a150f60\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"
Sep 09 16:16:51.523758 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.523718    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be8c922e-bf15-4a8d-9375-ad558a150f60-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g4km5\" (UID: \"be8c922e-bf15-4a8d-9375-ad558a150f60\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"
Sep 09 16:16:51.524033 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.524011    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8cgj\" (UniqueName: \"kubernetes.io/projected/be8c922e-bf15-4a8d-9375-ad558a150f60-kube-api-access-w8cgj\") pod \"cert-manager-cainjector-559cdd8c87-g4km5\" (UID: \"be8c922e-bf15-4a8d-9375-ad558a150f60\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"
Sep 09 16:16:51.591076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.591000    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"
Sep 09 16:16:51.765184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.765159    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:51.818865 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.818836    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-util\") pod \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") "
Sep 09 16:16:51.818996 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.818871    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-bundle\") pod \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") "
Sep 09 16:16:51.818996 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.818949    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7bz9\" (UniqueName: \"kubernetes.io/projected/f27afea6-12a4-422b-bfdb-4bbb889b03b5-kube-api-access-c7bz9\") pod \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\" (UID: \"f27afea6-12a4-422b-bfdb-4bbb889b03b5\") "
Sep 09 16:16:51.819266 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.819245    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-bundle" (OuterVolumeSpecName: "bundle") pod "f27afea6-12a4-422b-bfdb-4bbb889b03b5" (UID: "f27afea6-12a4-422b-bfdb-4bbb889b03b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:16:51.820998 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.820965    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27afea6-12a4-422b-bfdb-4bbb889b03b5-kube-api-access-c7bz9" (OuterVolumeSpecName: "kube-api-access-c7bz9") pod "f27afea6-12a4-422b-bfdb-4bbb889b03b5" (UID: "f27afea6-12a4-422b-bfdb-4bbb889b03b5"). InnerVolumeSpecName "kube-api-access-c7bz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:16:51.823374 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.823357    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-util" (OuterVolumeSpecName: "util") pod "f27afea6-12a4-422b-bfdb-4bbb889b03b5" (UID: "f27afea6-12a4-422b-bfdb-4bbb889b03b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:16:51.860726 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.860691    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g4km5"]
Sep 09 16:16:51.863161 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:16:51.863133    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe8c922e_bf15_4a8d_9375_ad558a150f60.slice/crio-90ad852f25ef127496b9dc0164ead485b80704418469172c22a1251210ef26e8 WatchSource:0}: Error finding container 90ad852f25ef127496b9dc0164ead485b80704418469172c22a1251210ef26e8: Status 404 returned error can't find the container with id 90ad852f25ef127496b9dc0164ead485b80704418469172c22a1251210ef26e8
Sep 09 16:16:51.920137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.920113    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:16:51.920236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.920140    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7bz9\" (UniqueName: \"kubernetes.io/projected/f27afea6-12a4-422b-bfdb-4bbb889b03b5-kube-api-access-c7bz9\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:16:51.920236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:51.920154    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27afea6-12a4-422b-bfdb-4bbb889b03b5-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:16:52.633382 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:52.633343    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:52.638328 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:52.638297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5" event={"ID":"be8c922e-bf15-4a8d-9375-ad558a150f60","Type":"ContainerStarted","Data":"074e8d0a860cf722a1e5d2d8efb8e27d0de4c899f564a9686e5e150a8f4e8d48"}
Sep 09 16:16:52.638443 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:52.638345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5" event={"ID":"be8c922e-bf15-4a8d-9375-ad558a150f60","Type":"ContainerStarted","Data":"90ad852f25ef127496b9dc0164ead485b80704418469172c22a1251210ef26e8"}
Sep 09 16:16:52.640423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:52.640396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7" event={"ID":"f27afea6-12a4-422b-bfdb-4bbb889b03b5","Type":"ContainerDied","Data":"0e6c57249d42edf870855b52154f4d5d4cf023c8267cfa58623d3cd8f5bff5ae"}
Sep 09 16:16:52.640423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:52.640419    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8c5d7"
Sep 09 16:16:52.640567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:52.640474    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e6c57249d42edf870855b52154f4d5d4cf023c8267cfa58623d3cd8f5bff5ae"
Sep 09 16:16:52.654264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:52.654222    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4km5" podStartSLOduration=1.65420948 podStartE2EDuration="1.65420948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:16:52.653330395 +0000 UTC m=+510.424421651" watchObservedRunningTime="2026-09-09 16:16:52.65420948 +0000 UTC m=+510.425300725"
Sep 09 16:16:52.734555 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:52.734521    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:53.725238 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:53.725193    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:54.100001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:54.099912    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:54.198067 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:54.198029    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:54.468288 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:54.468253    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:54.525488 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:54.525457    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:54.622946 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:54.622915    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xgthr"
Sep 09 16:16:55.787359 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.787314    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"]
Sep 09 16:16:55.787716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.787684    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerName="util"
Sep 09 16:16:55.787716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.787695    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerName="util"
Sep 09 16:16:55.787716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.787712    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerName="extract"
Sep 09 16:16:55.787716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.787718    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerName="extract"
Sep 09 16:16:55.787862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.787726    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerName="pull"
Sep 09 16:16:55.787862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.787732    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerName="pull"
Sep 09 16:16:55.787862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.787801    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27afea6-12a4-422b-bfdb-4bbb889b03b5" containerName="extract"
Sep 09 16:16:55.792461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.792444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"
Sep 09 16:16:55.794785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.794755    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 16:16:55.794876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.794810    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:16:55.795843 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.795820    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nzh96\""
Sep 09 16:16:55.797766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.797739    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"]
Sep 09 16:16:55.852364 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.852335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdbfa4c-2f0b-4210-a043-bde75f00acf3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dnm2k\" (UID: \"cbdbfa4c-2f0b-4210-a043-bde75f00acf3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"
Sep 09 16:16:55.852477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.852379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6dl7\" (UniqueName: \"kubernetes.io/projected/cbdbfa4c-2f0b-4210-a043-bde75f00acf3-kube-api-access-l6dl7\") pod \"openshift-lws-operator-fd8ccff4c-dnm2k\" (UID: \"cbdbfa4c-2f0b-4210-a043-bde75f00acf3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"
Sep 09 16:16:55.953644 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.953612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6dl7\" (UniqueName: \"kubernetes.io/projected/cbdbfa4c-2f0b-4210-a043-bde75f00acf3-kube-api-access-l6dl7\") pod \"openshift-lws-operator-fd8ccff4c-dnm2k\" (UID: \"cbdbfa4c-2f0b-4210-a043-bde75f00acf3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"
Sep 09 16:16:55.953815 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.953691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdbfa4c-2f0b-4210-a043-bde75f00acf3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dnm2k\" (UID: \"cbdbfa4c-2f0b-4210-a043-bde75f00acf3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"
Sep 09 16:16:55.954055 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.954038    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdbfa4c-2f0b-4210-a043-bde75f00acf3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dnm2k\" (UID: \"cbdbfa4c-2f0b-4210-a043-bde75f00acf3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"
Sep 09 16:16:55.963270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:55.963247    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6dl7\" (UniqueName: \"kubernetes.io/projected/cbdbfa4c-2f0b-4210-a043-bde75f00acf3-kube-api-access-l6dl7\") pod \"openshift-lws-operator-fd8ccff4c-dnm2k\" (UID: \"cbdbfa4c-2f0b-4210-a043-bde75f00acf3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"
Sep 09 16:16:56.040486 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.040416    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:16:56.102027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.101993    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"
Sep 09 16:16:56.375220 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.375189    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k"]
Sep 09 16:16:56.378646 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:16:56.378616    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbdbfa4c_2f0b_4210_a043_bde75f00acf3.slice/crio-b1b700de726dee3e90a1e1e33694f35089835b20cb59ab0b3aac531d03972e5e WatchSource:0}: Error finding container b1b700de726dee3e90a1e1e33694f35089835b20cb59ab0b3aac531d03972e5e: Status 404 returned error can't find the container with id b1b700de726dee3e90a1e1e33694f35089835b20cb59ab0b3aac531d03972e5e
Sep 09 16:16:56.478118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.478085    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gtxs7"]
Sep 09 16:16:56.484363 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.484342    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gtxs7"
Sep 09 16:16:56.486668 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.486652    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2btl4\""
Sep 09 16:16:56.490456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.490436    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gtxs7"]
Sep 09 16:16:56.559605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.559570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be322e4b-509c-48bc-960d-96c0c32c1703-bound-sa-token\") pod \"cert-manager-55b4d954d5-gtxs7\" (UID: \"be322e4b-509c-48bc-960d-96c0c32c1703\") " pod="cert-manager/cert-manager-55b4d954d5-gtxs7"
Sep 09 16:16:56.559783 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.559650    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgj8c\" (UniqueName: \"kubernetes.io/projected/be322e4b-509c-48bc-960d-96c0c32c1703-kube-api-access-fgj8c\") pod \"cert-manager-55b4d954d5-gtxs7\" (UID: \"be322e4b-509c-48bc-960d-96c0c32c1703\") " pod="cert-manager/cert-manager-55b4d954d5-gtxs7"
Sep 09 16:16:56.660236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.660140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgj8c\" (UniqueName: \"kubernetes.io/projected/be322e4b-509c-48bc-960d-96c0c32c1703-kube-api-access-fgj8c\") pod \"cert-manager-55b4d954d5-gtxs7\" (UID: \"be322e4b-509c-48bc-960d-96c0c32c1703\") " pod="cert-manager/cert-manager-55b4d954d5-gtxs7"
Sep 09 16:16:56.660236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.660205    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be322e4b-509c-48bc-960d-96c0c32c1703-bound-sa-token\") pod \"cert-manager-55b4d954d5-gtxs7\" (UID: \"be322e4b-509c-48bc-960d-96c0c32c1703\") " pod="cert-manager/cert-manager-55b4d954d5-gtxs7"
Sep 09 16:16:56.661048 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.661015    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k" event={"ID":"cbdbfa4c-2f0b-4210-a043-bde75f00acf3","Type":"ContainerStarted","Data":"b1b700de726dee3e90a1e1e33694f35089835b20cb59ab0b3aac531d03972e5e"}
Sep 09 16:16:56.672259 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.672225    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be322e4b-509c-48bc-960d-96c0c32c1703-bound-sa-token\") pod \"cert-manager-55b4d954d5-gtxs7\" (UID: \"be322e4b-509c-48bc-960d-96c0c32c1703\") " pod="cert-manager/cert-manager-55b4d954d5-gtxs7"
Sep 09 16:16:56.672350 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.672327    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgj8c\" (UniqueName: \"kubernetes.io/projected/be322e4b-509c-48bc-960d-96c0c32c1703-kube-api-access-fgj8c\") pod \"cert-manager-55b4d954d5-gtxs7\" (UID: \"be322e4b-509c-48bc-960d-96c0c32c1703\") " pod="cert-manager/cert-manager-55b4d954d5-gtxs7"
Sep 09 16:16:56.794960 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:56.794899    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gtxs7"
Sep 09 16:16:57.064255 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:57.064232    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gtxs7"]
Sep 09 16:16:57.066055 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:16:57.066024    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe322e4b_509c_48bc_960d_96c0c32c1703.slice/crio-f528c2b059c8775e1f8f864e1478fc8dfc57ecb115f708f71d4f015c1780dbf2 WatchSource:0}: Error finding container f528c2b059c8775e1f8f864e1478fc8dfc57ecb115f708f71d4f015c1780dbf2: Status 404 returned error can't find the container with id f528c2b059c8775e1f8f864e1478fc8dfc57ecb115f708f71d4f015c1780dbf2
Sep 09 16:16:57.667148 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:57.667112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gtxs7" event={"ID":"be322e4b-509c-48bc-960d-96c0c32c1703","Type":"ContainerStarted","Data":"6bae7ef13c3449bfb0444b6f44f7bd36c723345c230903ab28ad7db6e080646d"}
Sep 09 16:16:57.667148 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:57.667154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gtxs7" event={"ID":"be322e4b-509c-48bc-960d-96c0c32c1703","Type":"ContainerStarted","Data":"f528c2b059c8775e1f8f864e1478fc8dfc57ecb115f708f71d4f015c1780dbf2"}
Sep 09 16:16:57.682957 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:16:57.682914    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-gtxs7" podStartSLOduration=1.682898022 podStartE2EDuration="1.682898022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:16:57.682055968 +0000 UTC m=+515.453147215" watchObservedRunningTime="2026-09-09 16:16:57.682898022 +0000 UTC m=+515.453989269"
Sep 09 16:17:01.688967 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:01.688931    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k" event={"ID":"cbdbfa4c-2f0b-4210-a043-bde75f00acf3","Type":"ContainerStarted","Data":"399391d26bd8eeeecf11e096d7c9e8bc3a35a6c7bd9d336a83a598cb811a1ddf"}
Sep 09 16:17:01.713873 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:01.713817    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dnm2k" podStartSLOduration=1.554787744 podStartE2EDuration="6.713801119s" totalImagesPullingTime="5.159013375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:17:01.711081011 +0000 UTC m=+519.482172258" watchObservedRunningTime="2026-09-09 16:17:01.713801119 +0000 UTC m=+519.484892361"
Sep 09 16:17:02.390178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:02.390144    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:02.492673 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:02.492644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:04.107971 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.107928    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"]
Sep 09 16:17:04.131338 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.128268    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"]
Sep 09 16:17:04.131338 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.128410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.132001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.131978    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:17:04.132908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.132884    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:17:04.132997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.132950    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g79mz\""
Sep 09 16:17:04.231292 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.231262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.231425 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.231303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.231425 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.231343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjjjk\" (UniqueName: \"kubernetes.io/projected/26b60677-63f7-4f68-8c61-eca1c2494d8f-kube-api-access-gjjjk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.332105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.332075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjjjk\" (UniqueName: \"kubernetes.io/projected/26b60677-63f7-4f68-8c61-eca1c2494d8f-kube-api-access-gjjjk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.332220 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.332135    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.332220 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.332179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.332518 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.332498    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.332554 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.332530    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.340137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.340111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjjjk\" (UniqueName: \"kubernetes.io/projected/26b60677-63f7-4f68-8c61-eca1c2494d8f-kube-api-access-gjjjk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.440865 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.440834    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:04.739916 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.739793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"]
Sep 09 16:17:04.742397 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:17:04.742373    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b60677_63f7_4f68_8c61_eca1c2494d8f.slice/crio-f649c8dc8bcc318611f3ea153693ab06212006e548ab2d9a3994f61131131449 WatchSource:0}: Error finding container f649c8dc8bcc318611f3ea153693ab06212006e548ab2d9a3994f61131131449: Status 404 returned error can't find the container with id f649c8dc8bcc318611f3ea153693ab06212006e548ab2d9a3994f61131131449
Sep 09 16:17:04.817245 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:04.817219    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:05.713272 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:05.713237    2567 generic.go:356] "Generic (PLEG): container finished" podID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerID="462d4b0458a3176afbac5dd004ac417c8a69aa9c81500da50bb5047523872520" exitCode=0
Sep 09 16:17:05.713661 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:05.713290    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27" event={"ID":"26b60677-63f7-4f68-8c61-eca1c2494d8f","Type":"ContainerDied","Data":"462d4b0458a3176afbac5dd004ac417c8a69aa9c81500da50bb5047523872520"}
Sep 09 16:17:05.713661 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:05.713334    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27" event={"ID":"26b60677-63f7-4f68-8c61-eca1c2494d8f","Type":"ContainerStarted","Data":"f649c8dc8bcc318611f3ea153693ab06212006e548ab2d9a3994f61131131449"}
Sep 09 16:17:09.734312 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:09.734274    2567 generic.go:356] "Generic (PLEG): container finished" podID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerID="97b1b7d97192764ecfa834091b9ed2866c25175e4e60e3d9e197b2b6fe7a7e44" exitCode=0
Sep 09 16:17:09.734718 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:09.734349    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27" event={"ID":"26b60677-63f7-4f68-8c61-eca1c2494d8f","Type":"ContainerDied","Data":"97b1b7d97192764ecfa834091b9ed2866c25175e4e60e3d9e197b2b6fe7a7e44"}
Sep 09 16:17:10.740741 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:10.740707    2567 generic.go:356] "Generic (PLEG): container finished" podID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerID="277053e48fc6deb0c7eaf0617e8677924ead71ae4573b4a32efe7b2b796f640e" exitCode=0
Sep 09 16:17:10.740741 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:10.740741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27" event={"ID":"26b60677-63f7-4f68-8c61-eca1c2494d8f","Type":"ContainerDied","Data":"277053e48fc6deb0c7eaf0617e8677924ead71ae4573b4a32efe7b2b796f640e"}
Sep 09 16:17:11.873706 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:11.873681    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:12.000894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.000816    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-util\") pod \"26b60677-63f7-4f68-8c61-eca1c2494d8f\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") "
Sep 09 16:17:12.000894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.000880    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjjjk\" (UniqueName: \"kubernetes.io/projected/26b60677-63f7-4f68-8c61-eca1c2494d8f-kube-api-access-gjjjk\") pod \"26b60677-63f7-4f68-8c61-eca1c2494d8f\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") "
Sep 09 16:17:12.001073 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.000906    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-bundle\") pod \"26b60677-63f7-4f68-8c61-eca1c2494d8f\" (UID: \"26b60677-63f7-4f68-8c61-eca1c2494d8f\") "
Sep 09 16:17:12.001673 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.001637    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-bundle" (OuterVolumeSpecName: "bundle") pod "26b60677-63f7-4f68-8c61-eca1c2494d8f" (UID: "26b60677-63f7-4f68-8c61-eca1c2494d8f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:17:12.002995 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.002969    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b60677-63f7-4f68-8c61-eca1c2494d8f-kube-api-access-gjjjk" (OuterVolumeSpecName: "kube-api-access-gjjjk") pod "26b60677-63f7-4f68-8c61-eca1c2494d8f" (UID: "26b60677-63f7-4f68-8c61-eca1c2494d8f"). InnerVolumeSpecName "kube-api-access-gjjjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:17:12.007130 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.007087    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-util" (OuterVolumeSpecName: "util") pod "26b60677-63f7-4f68-8c61-eca1c2494d8f" (UID: "26b60677-63f7-4f68-8c61-eca1c2494d8f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:17:12.101610 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.101582    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:17:12.101610 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.101607    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjjjk\" (UniqueName: \"kubernetes.io/projected/26b60677-63f7-4f68-8c61-eca1c2494d8f-kube-api-access-gjjjk\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:17:12.101759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.101617    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b60677-63f7-4f68-8c61-eca1c2494d8f-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:17:12.754552 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.754522    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27"
Sep 09 16:17:12.754685 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.754526    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcnp27" event={"ID":"26b60677-63f7-4f68-8c61-eca1c2494d8f","Type":"ContainerDied","Data":"f649c8dc8bcc318611f3ea153693ab06212006e548ab2d9a3994f61131131449"}
Sep 09 16:17:12.754685 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:12.754644    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f649c8dc8bcc318611f3ea153693ab06212006e548ab2d9a3994f61131131449"
Sep 09 16:17:17.003416 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:17.002736    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:17.121028 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:17.120993    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:21.856607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.856572    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"]
Sep 09 16:17:21.857001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.856934    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerName="pull"
Sep 09 16:17:21.857001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.856946    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerName="pull"
Sep 09 16:17:21.857001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.856952    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerName="extract"
Sep 09 16:17:21.857001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.856958    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerName="extract"
Sep 09 16:17:21.857001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.856978    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerName="util"
Sep 09 16:17:21.857001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.856984    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerName="util"
Sep 09 16:17:21.857184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.857042    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b60677-63f7-4f68-8c61-eca1c2494d8f" containerName="extract"
Sep 09 16:17:21.860314 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.860295    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:21.863262 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.863239    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:17:21.863760 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.863742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:17:21.864365 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.864348    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g79mz\""
Sep 09 16:17:21.873323 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.873301    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"]
Sep 09 16:17:21.984665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.984637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtqpx\" (UniqueName: \"kubernetes.io/projected/dec73a82-98e4-432d-b499-418e81d4d2d9-kube-api-access-jtqpx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:21.984665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.984669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:21.984888 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:21.984708    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:22.085558 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.085525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtqpx\" (UniqueName: \"kubernetes.io/projected/dec73a82-98e4-432d-b499-418e81d4d2d9-kube-api-access-jtqpx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:22.085558 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.085559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:22.085746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.085603    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:22.085955 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.085937    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:22.086000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.085963    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:22.117964 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.117904    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtqpx\" (UniqueName: \"kubernetes.io/projected/dec73a82-98e4-432d-b499-418e81d4d2d9-kube-api-access-jtqpx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:22.171997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.171968    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:22.457999 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.457678    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"]
Sep 09 16:17:22.663131 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.663097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:22.771360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.771291    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:22.805549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.805517    2567 generic.go:356] "Generic (PLEG): container finished" podID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerID="e3f764f00aad2d0c21a357e345c96ae7cbe2a63226b909aa30e4e4b6b518a60d" exitCode=0
Sep 09 16:17:22.805726 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.805552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr" event={"ID":"dec73a82-98e4-432d-b499-418e81d4d2d9","Type":"ContainerDied","Data":"e3f764f00aad2d0c21a357e345c96ae7cbe2a63226b909aa30e4e4b6b518a60d"}
Sep 09 16:17:22.805726 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.805605    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr" event={"ID":"dec73a82-98e4-432d-b499-418e81d4d2d9","Type":"ContainerStarted","Data":"62578c2d5060bfa3887086f8f90acd9e3480074f8695dd82912d1ecd61c66a6b"}
Sep 09 16:17:22.966336 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:22.966307    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:23.812399 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:23.812302    2567 generic.go:356] "Generic (PLEG): container finished" podID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerID="c3dcd1b35be4f8f9965c1829c89fcdd78bae0bd444954bd91b80ba225a859531" exitCode=0
Sep 09 16:17:23.812399 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:23.812387    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr" event={"ID":"dec73a82-98e4-432d-b499-418e81d4d2d9","Type":"ContainerDied","Data":"c3dcd1b35be4f8f9965c1829c89fcdd78bae0bd444954bd91b80ba225a859531"}
Sep 09 16:17:23.949464 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:23.949434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:24.067990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.067900    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:24.124792 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.124754    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"]
Sep 09 16:17:24.128150 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.128135    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.135835 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.135792    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vdnpc\""
Sep 09 16:17:24.136084 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.136068    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 16:17:24.136427 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.136410    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 16:17:24.136807 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.136789    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 16:17:24.136937 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.136920    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 16:17:24.166201 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.166178    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"]
Sep 09 16:17:24.200378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.200355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxld6\" (UniqueName: \"kubernetes.io/projected/8a459374-9835-4b99-963e-0e698680e7b1-kube-api-access-hxld6\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.200499 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.200463    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a459374-9835-4b99-963e-0e698680e7b1-tmp\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.200499 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.200492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a459374-9835-4b99-963e-0e698680e7b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.200599 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.200513    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a459374-9835-4b99-963e-0e698680e7b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.200599 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.200548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a459374-9835-4b99-963e-0e698680e7b1-manifests\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.301620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.301591    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxld6\" (UniqueName: \"kubernetes.io/projected/8a459374-9835-4b99-963e-0e698680e7b1-kube-api-access-hxld6\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.301818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.301646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a459374-9835-4b99-963e-0e698680e7b1-tmp\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.301818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.301678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a459374-9835-4b99-963e-0e698680e7b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.301818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.301703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a459374-9835-4b99-963e-0e698680e7b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.301818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.301727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a459374-9835-4b99-963e-0e698680e7b1-manifests\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.302116 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.302097    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a459374-9835-4b99-963e-0e698680e7b1-manifests\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.303990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.303962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a459374-9835-4b99-963e-0e698680e7b1-tmp\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.304133 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.304115    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a459374-9835-4b99-963e-0e698680e7b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.304219 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.304203    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a459374-9835-4b99-963e-0e698680e7b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.313002 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.312981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxld6\" (UniqueName: \"kubernetes.io/projected/8a459374-9835-4b99-963e-0e698680e7b1-kube-api-access-hxld6\") pod \"opendatahub-operator-controller-manager-67c7bcf47f-cm9dh\" (UID: \"8a459374-9835-4b99-963e-0e698680e7b1\") " pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.390140 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.390115    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:24.438525 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.438498    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:24.514463 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.514438    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:24.607611 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.607583    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:24.708180 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.708116    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:24.725712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.725685    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"]
Sep 09 16:17:24.727460 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:17:24.727435    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a459374_9835_4b99_963e_0e698680e7b1.slice/crio-7ed9f8cba2a772a64270a8964378ab496538c9e96fd7590f19578832313b8e26 WatchSource:0}: Error finding container 7ed9f8cba2a772a64270a8964378ab496538c9e96fd7590f19578832313b8e26: Status 404 returned error can't find the container with id 7ed9f8cba2a772a64270a8964378ab496538c9e96fd7590f19578832313b8e26
Sep 09 16:17:24.819167 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.819136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh" event={"ID":"8a459374-9835-4b99-963e-0e698680e7b1","Type":"ContainerStarted","Data":"7ed9f8cba2a772a64270a8964378ab496538c9e96fd7590f19578832313b8e26"}
Sep 09 16:17:24.821221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.821194    2567 generic.go:356] "Generic (PLEG): container finished" podID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerID="24f37b04a91f679aa3b8cec83eca0bb78fca7c23ff8b1678c3db561931191c9c" exitCode=0
Sep 09 16:17:24.821323 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.821257    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr" event={"ID":"dec73a82-98e4-432d-b499-418e81d4d2d9","Type":"ContainerDied","Data":"24f37b04a91f679aa3b8cec83eca0bb78fca7c23ff8b1678c3db561931191c9c"}
Sep 09 16:17:24.859483 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:24.859459    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:25.996244 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:25.996213    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:26.014087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.014055    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtqpx\" (UniqueName: \"kubernetes.io/projected/dec73a82-98e4-432d-b499-418e81d4d2d9-kube-api-access-jtqpx\") pod \"dec73a82-98e4-432d-b499-418e81d4d2d9\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") "
Sep 09 16:17:26.014291 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.014275    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-util\") pod \"dec73a82-98e4-432d-b499-418e81d4d2d9\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") "
Sep 09 16:17:26.014728 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.014433    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-bundle\") pod \"dec73a82-98e4-432d-b499-418e81d4d2d9\" (UID: \"dec73a82-98e4-432d-b499-418e81d4d2d9\") "
Sep 09 16:17:26.015436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.015380    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-bundle" (OuterVolumeSpecName: "bundle") pod "dec73a82-98e4-432d-b499-418e81d4d2d9" (UID: "dec73a82-98e4-432d-b499-418e81d4d2d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:17:26.018378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.018341    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec73a82-98e4-432d-b499-418e81d4d2d9-kube-api-access-jtqpx" (OuterVolumeSpecName: "kube-api-access-jtqpx") pod "dec73a82-98e4-432d-b499-418e81d4d2d9" (UID: "dec73a82-98e4-432d-b499-418e81d4d2d9"). InnerVolumeSpecName "kube-api-access-jtqpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:17:26.025081 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.025051    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-util" (OuterVolumeSpecName: "util") pod "dec73a82-98e4-432d-b499-418e81d4d2d9" (UID: "dec73a82-98e4-432d-b499-418e81d4d2d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:17:26.116454 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.116371    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtqpx\" (UniqueName: \"kubernetes.io/projected/dec73a82-98e4-432d-b499-418e81d4d2d9-kube-api-access-jtqpx\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:17:26.116454 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.116404    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:17:26.116454 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.116421    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec73a82-98e4-432d-b499-418e81d4d2d9-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:17:26.837997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.837964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr" event={"ID":"dec73a82-98e4-432d-b499-418e81d4d2d9","Type":"ContainerDied","Data":"62578c2d5060bfa3887086f8f90acd9e3480074f8695dd82912d1ecd61c66a6b"}
Sep 09 16:17:26.837997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.837991    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p8tgr"
Sep 09 16:17:26.838195 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:26.838017    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62578c2d5060bfa3887086f8f90acd9e3480074f8695dd82912d1ecd61c66a6b"
Sep 09 16:17:28.848852 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:28.848813    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh" event={"ID":"8a459374-9835-4b99-963e-0e698680e7b1","Type":"ContainerStarted","Data":"c6ce8f37c06aefbb8c00ef4a98b94ba440ef0e250d39a49c5d99426c7a0e16ea"}
Sep 09 16:17:29.855754 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:29.855718    2567 generic.go:356] "Generic (PLEG): container finished" podID="8a459374-9835-4b99-963e-0e698680e7b1" containerID="c6ce8f37c06aefbb8c00ef4a98b94ba440ef0e250d39a49c5d99426c7a0e16ea" exitCode=0
Sep 09 16:17:29.856248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:29.855802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh" event={"ID":"8a459374-9835-4b99-963e-0e698680e7b1","Type":"ContainerDied","Data":"c6ce8f37c06aefbb8c00ef4a98b94ba440ef0e250d39a49c5d99426c7a0e16ea"}
Sep 09 16:17:30.862532 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:30.862498    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh" event={"ID":"8a459374-9835-4b99-963e-0e698680e7b1","Type":"ContainerStarted","Data":"c07f997351159d786e47a44eb40e9f6bd22f58232471e7bc444890492e77a080"}
Sep 09 16:17:30.862942 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:30.862642    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:30.887367 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:30.887309    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh" podStartSLOduration=2.333070597 podStartE2EDuration="6.887293038s" totalImagesPullingTime="3.474864605s" totalInitContainerRuntime="1.079357836s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:17:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:17:30.884378111 +0000 UTC m=+548.655469358" watchObservedRunningTime="2026-09-09 16:17:30.887293038 +0000 UTC m=+548.658384284"
Sep 09 16:17:41.870567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:41.870534    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67c7bcf47f-cm9dh"
Sep 09 16:17:43.479082 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:43.479045    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:43.591801 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:43.591722    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:44.052190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.052149    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"]
Sep 09 16:17:44.052517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.052505    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerName="util"
Sep 09 16:17:44.052564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.052518    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerName="util"
Sep 09 16:17:44.052564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.052528    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerName="pull"
Sep 09 16:17:44.052564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.052533    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerName="pull"
Sep 09 16:17:44.052564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.052548    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerName="extract"
Sep 09 16:17:44.052564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.052555    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerName="extract"
Sep 09 16:17:44.052717 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.052615    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec73a82-98e4-432d-b499-418e81d4d2d9" containerName="extract"
Sep 09 16:17:44.060549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.060527    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.063223 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.063199    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 16:17:44.063382 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.063297    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 16:17:44.063382 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.063339    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 16:17:44.063555 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.063540    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 16:17:44.074751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.074730    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"]
Sep 09 16:17:44.076369 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.076345    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:44.182403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.182372    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-tls-certs\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.182572 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.182430    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt49w\" (UniqueName: \"kubernetes.io/projected/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-kube-api-access-jt49w\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.182572 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.182493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-tmp\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.241934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.241900    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:44.283302 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.283271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-tmp\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.283475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.283345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-tls-certs\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.283475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.283391    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt49w\" (UniqueName: \"kubernetes.io/projected/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-kube-api-access-jt49w\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.285407 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.285378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-tmp\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.285765 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.285743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-tls-certs\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.292584 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.292561    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt49w\" (UniqueName: \"kubernetes.io/projected/5bf761a4-0c32-4d5c-bc11-a81fc826ab75-kube-api-access-jt49w\") pod \"kube-auth-proxy-54fc5d6dc5-bcpm7\" (UID: \"5bf761a4-0c32-4d5c-bc11-a81fc826ab75\") " pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.371083 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.371004    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"
Sep 09 16:17:44.657689 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.657648    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7"]
Sep 09 16:17:44.663548 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:17:44.663521    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf761a4_0c32_4d5c_bc11_a81fc826ab75.slice/crio-8bcc869bc4b76cf69a6416c494308ab7b457bf1f4c3af3867b6147b7cf7ed71e WatchSource:0}: Error finding container 8bcc869bc4b76cf69a6416c494308ab7b457bf1f4c3af3867b6147b7cf7ed71e: Status 404 returned error can't find the container with id 8bcc869bc4b76cf69a6416c494308ab7b457bf1f4c3af3867b6147b7cf7ed71e
Sep 09 16:17:44.935801 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:44.935699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7" event={"ID":"5bf761a4-0c32-4d5c-bc11-a81fc826ab75","Type":"ContainerStarted","Data":"8bcc869bc4b76cf69a6416c494308ab7b457bf1f4c3af3867b6147b7cf7ed71e"}
Sep 09 16:17:45.721914 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.721879    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:45.723147 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.723126    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"]
Sep 09 16:17:45.727994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.727973    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.730678 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.730657    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 16:17:45.730855 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.730820    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 16:17:45.730855 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.730820    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 16:17:45.731030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.730877    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 16:17:45.731030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.730987    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-s6w2w\""
Sep 09 16:17:45.745248 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.745225    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"]
Sep 09 16:17:45.796860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.796821    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.796860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.796860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.797087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.796897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.797087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.796972    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.797087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.797033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f009d872-fdea-4455-b361-90536b09aeff-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.797087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.797070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.797236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.797090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlhds\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-kube-api-access-tlhds\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.798987 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.798965    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:45.897675 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.897634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.897889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.897684    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.897889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.897723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f009d872-fdea-4455-b361-90536b09aeff-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.897889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.897744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.897889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.897761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlhds\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-kube-api-access-tlhds\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.897889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.897833    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.898164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.897947    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.898672 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.898647    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.900365 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.900333    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.900470 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.900443    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.900524 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.900504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f009d872-fdea-4455-b361-90536b09aeff-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.900673 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.900656    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.905583 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.905555    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:45.905949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:45.905932    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlhds\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-kube-api-access-tlhds\") pod \"istiod-openshift-gateway-7b7995d5cd-5vwg7\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:46.037992 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:46.037903    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:46.313793 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:46.313676    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"]
Sep 09 16:17:46.318069 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:17:46.318044    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf009d872_fdea_4455_b361_90536b09aeff.slice/crio-691173951dd7398f89d949a7a34d15ec29a4a444e1c42260b24ae6f9c9956db3 WatchSource:0}: Error finding container 691173951dd7398f89d949a7a34d15ec29a4a444e1c42260b24ae6f9c9956db3: Status 404 returned error can't find the container with id 691173951dd7398f89d949a7a34d15ec29a4a444e1c42260b24ae6f9c9956db3
Sep 09 16:17:46.805931 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:46.805898    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:46.947522 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:46.947490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7" event={"ID":"f009d872-fdea-4455-b361-90536b09aeff","Type":"ContainerStarted","Data":"691173951dd7398f89d949a7a34d15ec29a4a444e1c42260b24ae6f9c9956db3"}
Sep 09 16:17:49.967444 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:49.967409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7" event={"ID":"5bf761a4-0c32-4d5c-bc11-a81fc826ab75","Type":"ContainerStarted","Data":"970b83912f3a836b76bff7be9d22b4b12ff1c2865647576c21eedf9c2cb3fa46"}
Sep 09 16:17:49.985637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:49.985587    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54fc5d6dc5-bcpm7" podStartSLOduration=0.761188807 podStartE2EDuration="5.985570848s" totalImagesPullingTime="5.224382041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:17:49.981893118 +0000 UTC m=+567.752984364" watchObservedRunningTime="2026-09-09 16:17:49.985570848 +0000 UTC m=+567.756662093"
Sep 09 16:17:51.685096 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:51.685059    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:17:51.685366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:51.685129    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:17:51.987265 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:51.987153    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7" event={"ID":"f009d872-fdea-4455-b361-90536b09aeff","Type":"ContainerStarted","Data":"97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e"}
Sep 09 16:17:51.987265 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:51.987255    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:52.009179 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:52.009133    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7" podStartSLOduration=1.64458423 podStartE2EDuration="7.009119332s" totalImagesPullingTime="5.364535102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:17:52.007648502 +0000 UTC m=+569.778739747" watchObservedRunningTime="2026-09-09 16:17:52.009119332 +0000 UTC m=+569.780210578"
Sep 09 16:17:52.445765 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:52.445731    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:52.506331 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:52.506299    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:52.721113 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:52.721040    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:52.847592 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:52.847563    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:52.947089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:52.947051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:52.994572 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:52.994493    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:17:54.475069 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:54.475031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:54.574133 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:54.574103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:54.847975 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:54.847882    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:54.951633 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:54.951595    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:55.683721 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:17:55.683685    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:03.396916 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:03.396872    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:03.502793 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:03.502729    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:04.627801 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.626959    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"]
Sep 09 16:18:04.635997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.635968    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:04.641880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.641845    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 09 16:18:04.643034 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.643010    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pj4sn\""
Sep 09 16:18:04.645559 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.645530    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"]
Sep 09 16:18:04.670485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.670441    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"]
Sep 09 16:18:04.672503 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.672472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f94d706f-84ae-479d-a33f-2b74f580b953-cert\") pod \"kserve-controller-manager-d6f4b65b8-wv9ck\" (UID: \"f94d706f-84ae-479d-a33f-2b74f580b953\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:04.672630 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.672526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9c4k\" (UniqueName: \"kubernetes.io/projected/f94d706f-84ae-479d-a33f-2b74f580b953-kube-api-access-k9c4k\") pod \"kserve-controller-manager-d6f4b65b8-wv9ck\" (UID: \"f94d706f-84ae-479d-a33f-2b74f580b953\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:04.674209 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.674191    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:04.677665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.677619    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 16:18:04.678109 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.678086    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vz9vn\""
Sep 09 16:18:04.704126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.704099    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"]
Sep 09 16:18:04.773944 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.773906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9c4k\" (UniqueName: \"kubernetes.io/projected/f94d706f-84ae-479d-a33f-2b74f580b953-kube-api-access-k9c4k\") pod \"kserve-controller-manager-d6f4b65b8-wv9ck\" (UID: \"f94d706f-84ae-479d-a33f-2b74f580b953\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:04.774118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.774022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f94d706f-84ae-479d-a33f-2b74f580b953-cert\") pod \"kserve-controller-manager-d6f4b65b8-wv9ck\" (UID: \"f94d706f-84ae-479d-a33f-2b74f580b953\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:04.776630 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.776600    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f94d706f-84ae-479d-a33f-2b74f580b953-cert\") pod \"kserve-controller-manager-d6f4b65b8-wv9ck\" (UID: \"f94d706f-84ae-479d-a33f-2b74f580b953\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:04.786164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.786134    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9c4k\" (UniqueName: \"kubernetes.io/projected/f94d706f-84ae-479d-a33f-2b74f580b953-kube-api-access-k9c4k\") pod \"kserve-controller-manager-d6f4b65b8-wv9ck\" (UID: \"f94d706f-84ae-479d-a33f-2b74f580b953\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:04.874879 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.874833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kfqtq\" (UID: \"23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:04.875074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.874959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfdb\" (UniqueName: \"kubernetes.io/projected/23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca-kube-api-access-cnfdb\") pod \"llmisvc-controller-manager-777c6bd7d5-kfqtq\" (UID: \"23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:04.951182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.951080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:04.976052 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.976016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfdb\" (UniqueName: \"kubernetes.io/projected/23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca-kube-api-access-cnfdb\") pod \"llmisvc-controller-manager-777c6bd7d5-kfqtq\" (UID: \"23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:04.976178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.976127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kfqtq\" (UID: \"23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:04.978632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.978607    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kfqtq\" (UID: \"23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:04.995041 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:04.995015    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfdb\" (UniqueName: \"kubernetes.io/projected/23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca-kube-api-access-cnfdb\") pod \"llmisvc-controller-manager-777c6bd7d5-kfqtq\" (UID: \"23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:05.242589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:05.242557    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"]
Sep 09 16:18:05.245229 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:18:05.245199    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94d706f_84ae_479d_a33f_2b74f580b953.slice/crio-e4cc0b289bacdf32cd48bd77a93224d3d0608e47d9a22b2914b654bd11c10569 WatchSource:0}: Error finding container e4cc0b289bacdf32cd48bd77a93224d3d0608e47d9a22b2914b654bd11c10569: Status 404 returned error can't find the container with id e4cc0b289bacdf32cd48bd77a93224d3d0608e47d9a22b2914b654bd11c10569
Sep 09 16:18:05.285830 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:05.285800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:05.558226 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:05.558198    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"]
Sep 09 16:18:05.559891 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:18:05.559864    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod23eba5d0_bc47_4de9_9a9c_85b2c6ce8aca.slice/crio-51dfb6443374b62a06a837251bde4d4f8231e00ffee3203d6522100b7a793c43 WatchSource:0}: Error finding container 51dfb6443374b62a06a837251bde4d4f8231e00ffee3203d6522100b7a793c43: Status 404 returned error can't find the container with id 51dfb6443374b62a06a837251bde4d4f8231e00ffee3203d6522100b7a793c43
Sep 09 16:18:06.071862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.071804    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck" event={"ID":"f94d706f-84ae-479d-a33f-2b74f580b953","Type":"ContainerStarted","Data":"e4cc0b289bacdf32cd48bd77a93224d3d0608e47d9a22b2914b654bd11c10569"}
Sep 09 16:18:06.073414 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.073385    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq" event={"ID":"23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca","Type":"ContainerStarted","Data":"51dfb6443374b62a06a837251bde4d4f8231e00ffee3203d6522100b7a793c43"}
Sep 09 16:18:06.094268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.094230    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"]
Sep 09 16:18:06.094826 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.094482    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7" podUID="f009d872-fdea-4455-b361-90536b09aeff" containerName="discovery" containerID="cri-o://97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e" gracePeriod=30
Sep 09 16:18:06.357465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.357438    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:18:06.392605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.392577    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-kubeconfig\") pod \"f009d872-fdea-4455-b361-90536b09aeff\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") "
Sep 09 16:18:06.392803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.392631    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-istio-token\") pod \"f009d872-fdea-4455-b361-90536b09aeff\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") "
Sep 09 16:18:06.392803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.392648    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-cacerts\") pod \"f009d872-fdea-4455-b361-90536b09aeff\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") "
Sep 09 16:18:06.392803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.392676    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-ca-configmap\") pod \"f009d872-fdea-4455-b361-90536b09aeff\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") "
Sep 09 16:18:06.392803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.392705    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlhds\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-kube-api-access-tlhds\") pod \"f009d872-fdea-4455-b361-90536b09aeff\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") "
Sep 09 16:18:06.392803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.392736    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-dns-cert\") pod \"f009d872-fdea-4455-b361-90536b09aeff\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") "
Sep 09 16:18:06.392803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.392761    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f009d872-fdea-4455-b361-90536b09aeff-local-certs\") pod \"f009d872-fdea-4455-b361-90536b09aeff\" (UID: \"f009d872-fdea-4455-b361-90536b09aeff\") "
Sep 09 16:18:06.393458 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.393425    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f009d872-fdea-4455-b361-90536b09aeff" (UID: "f009d872-fdea-4455-b361-90536b09aeff"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:18:06.395717 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.395692    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f009d872-fdea-4455-b361-90536b09aeff-local-certs" (OuterVolumeSpecName: "local-certs") pod "f009d872-fdea-4455-b361-90536b09aeff" (UID: "f009d872-fdea-4455-b361-90536b09aeff"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:18:06.395845 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.395709    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f009d872-fdea-4455-b361-90536b09aeff" (UID: "f009d872-fdea-4455-b361-90536b09aeff"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:18:06.395845 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.395682    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f009d872-fdea-4455-b361-90536b09aeff" (UID: "f009d872-fdea-4455-b361-90536b09aeff"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:18:06.395845 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.395747    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-cacerts" (OuterVolumeSpecName: "cacerts") pod "f009d872-fdea-4455-b361-90536b09aeff" (UID: "f009d872-fdea-4455-b361-90536b09aeff"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:18:06.395845 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.395792    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-kube-api-access-tlhds" (OuterVolumeSpecName: "kube-api-access-tlhds") pod "f009d872-fdea-4455-b361-90536b09aeff" (UID: "f009d872-fdea-4455-b361-90536b09aeff"). InnerVolumeSpecName "kube-api-access-tlhds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:18:06.396039 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.396006    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-istio-token" (OuterVolumeSpecName: "istio-token") pod "f009d872-fdea-4455-b361-90536b09aeff" (UID: "f009d872-fdea-4455-b361-90536b09aeff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:18:06.493689 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.493642    2567 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-kubeconfig\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:18:06.493689 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.493680    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-istio-token\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:18:06.493689 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.493690    2567 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-cacerts\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:18:06.493954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.493704    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-ca-configmap\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:18:06.493954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.493719    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlhds\" (UniqueName: \"kubernetes.io/projected/f009d872-fdea-4455-b361-90536b09aeff-kube-api-access-tlhds\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:18:06.493954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.493733    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f009d872-fdea-4455-b361-90536b09aeff-istio-csr-dns-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:18:06.493954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.493744    2567 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f009d872-fdea-4455-b361-90536b09aeff-local-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:18:06.820219 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.820187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:06.920315 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:06.920278    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:07.086547 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.086457    2567 generic.go:356] "Generic (PLEG): container finished" podID="f009d872-fdea-4455-b361-90536b09aeff" containerID="97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e" exitCode=0
Sep 09 16:18:07.086547 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.086509    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"
Sep 09 16:18:07.086547 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.086534    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7" event={"ID":"f009d872-fdea-4455-b361-90536b09aeff","Type":"ContainerDied","Data":"97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e"}
Sep 09 16:18:07.087106 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.086622    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7" event={"ID":"f009d872-fdea-4455-b361-90536b09aeff","Type":"ContainerDied","Data":"691173951dd7398f89d949a7a34d15ec29a4a444e1c42260b24ae6f9c9956db3"}
Sep 09 16:18:07.087106 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.086652    2567 scope.go:117] "RemoveContainer" containerID="97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e"
Sep 09 16:18:07.116749 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.116718    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"]
Sep 09 16:18:07.122860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.122821    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5vwg7"]
Sep 09 16:18:07.767872 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.767663    2567 scope.go:117] "RemoveContainer" containerID="97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e"
Sep 09 16:18:07.768108 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:18:07.768085    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e\": container with ID starting with 97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e not found: ID does not exist" containerID="97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e"
Sep 09 16:18:07.768182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:07.768123    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e"} err="failed to get container status \"97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e\": rpc error: code = NotFound desc = could not find container \"97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e\": container with ID starting with 97765eb42bdb07e673e8ffc5d3ab850167ac06798ccd5b284d46dd152731e95e not found: ID does not exist"
Sep 09 16:18:08.094172 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:08.094078    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck" event={"ID":"f94d706f-84ae-479d-a33f-2b74f580b953","Type":"ContainerStarted","Data":"1cd1aab6d34f00f7165f761a8dea79d4be26b3ab36bdd6860a2bd9c57c7e3d18"}
Sep 09 16:18:08.094555 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:08.094213    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:08.120280 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:08.120232    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck" podStartSLOduration=1.544966179 podStartE2EDuration="4.120215955s" totalImagesPullingTime="2.575249776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:08.118610593 +0000 UTC m=+585.889701839" watchObservedRunningTime="2026-09-09 16:18:08.120215955 +0000 UTC m=+585.891307200"
Sep 09 16:18:08.738151 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:08.738119    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f009d872-fdea-4455-b361-90536b09aeff" path="/var/lib/kubelet/pods/f009d872-fdea-4455-b361-90536b09aeff/volumes"
Sep 09 16:18:10.107585 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:10.107551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq" event={"ID":"23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca","Type":"ContainerStarted","Data":"8d6bab978424220d944cd071139c69f02d0ffa708a4c0b6ff8818a345d5043fb"}
Sep 09 16:18:10.107983 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:10.107622    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:10.142990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:10.142940    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq" podStartSLOduration=1.8329605629999999 podStartE2EDuration="6.142921049s" totalImagesPullingTime="4.309960486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:10.14120996 +0000 UTC m=+587.912301206" watchObservedRunningTime="2026-09-09 16:18:10.142921049 +0000 UTC m=+587.914012316"
Sep 09 16:18:12.390676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:12.390637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:12.443304 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:12.443271    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:39.106362 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:39.106331    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv9ck"
Sep 09 16:18:41.115092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:41.115064    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfqtq"
Sep 09 16:18:41.155269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:41.155236    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:55.836994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:55.836905    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:55.911187 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:55.911156    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:59.452128 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.452089    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"]
Sep 09 16:18:59.452514 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.452456    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f009d872-fdea-4455-b361-90536b09aeff" containerName="discovery"
Sep 09 16:18:59.452514 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.452467    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f009d872-fdea-4455-b361-90536b09aeff" containerName="discovery"
Sep 09 16:18:59.452587 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.452564    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f009d872-fdea-4455-b361-90536b09aeff" containerName="discovery"
Sep 09 16:18:59.455488 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.455471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.458036 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.458006    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 16:18:59.458191 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.458057    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 16:18:59.458869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.458854    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g79mz\""
Sep 09 16:18:59.463344 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.463317    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"]
Sep 09 16:18:59.555541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.555503    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"]
Sep 09 16:18:59.559220 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.559201    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.559600 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.559578    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.559651 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.559613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1e0ebb55-2572-4d3b-aa35-eb0541498c21-kube-api-access-qtvm9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.559651 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.559643    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.566801 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.566763    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"]
Sep 09 16:18:59.652422 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.652387    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"]
Sep 09 16:18:59.656297 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.656274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.660574 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.660550    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1e0ebb55-2572-4d3b-aa35-eb0541498c21-kube-api-access-qtvm9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.660798 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.660752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.660947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.660928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g2vv\" (UniqueName: \"kubernetes.io/projected/a16286dc-1930-4574-ae95-e6453158e759-kube-api-access-4g2vv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.661102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.661084    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.661176 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.661154    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.661315 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.661295    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.661430 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.661333    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.661621 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.661604    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.664389 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.664367    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"]
Sep 09 16:18:59.668525 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.668504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1e0ebb55-2572-4d3b-aa35-eb0541498c21-kube-api-access-qtvm9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.756965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.756882    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"]
Sep 09 16:18:59.760826 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.760809    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.761992 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.761963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.762102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.762000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.762102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.762033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq7wg\" (UniqueName: \"kubernetes.io/projected/735a0cd5-0b92-4faa-b6e3-46ec582592b9-kube-api-access-gq7wg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.762102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.762086    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g2vv\" (UniqueName: \"kubernetes.io/projected/a16286dc-1930-4574-ae95-e6453158e759-kube-api-access-4g2vv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.762224 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.762178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.762267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.762237    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.762450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.762431    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.762546 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.762525    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.765035 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.765011    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:18:59.768598 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.768092    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"]
Sep 09 16:18:59.770652 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.770614    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g2vv\" (UniqueName: \"kubernetes.io/projected/a16286dc-1930-4574-ae95-e6453158e759-kube-api-access-4g2vv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.863174 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.863120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.863373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.863207    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.863373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.863241    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.863373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.863277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq7wg\" (UniqueName: \"kubernetes.io/projected/735a0cd5-0b92-4faa-b6e3-46ec582592b9-kube-api-access-gq7wg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.863373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.863313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.863591 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.863418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqgb9\" (UniqueName: \"kubernetes.io/projected/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-kube-api-access-hqgb9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.863591 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.863534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.863591 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.863555    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.869213 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.869193    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:18:59.871494 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.871475    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq7wg\" (UniqueName: \"kubernetes.io/projected/735a0cd5-0b92-4faa-b6e3-46ec582592b9-kube-api-access-gq7wg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.964172 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.964130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.964370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.964215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqgb9\" (UniqueName: \"kubernetes.io/projected/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-kube-api-access-hqgb9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.964370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.964314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.964533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.964512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.964646 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.964628    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:18:59.966955 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.966936    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:18:59.972760 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:18:59.972734    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqgb9\" (UniqueName: \"kubernetes.io/projected/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-kube-api-access-hqgb9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:19:00.037703 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.037663    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"]
Sep 09 16:19:00.038484 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:00.038458    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0ebb55_2572_4d3b_aa35_eb0541498c21.slice/crio-b4e2339d17f115ecceac46d819993e1a66066ab16b096c7cb83d05f8094bd1f6 WatchSource:0}: Error finding container b4e2339d17f115ecceac46d819993e1a66066ab16b096c7cb83d05f8094bd1f6: Status 404 returned error can't find the container with id b4e2339d17f115ecceac46d819993e1a66066ab16b096c7cb83d05f8094bd1f6
Sep 09 16:19:00.071925 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.071887    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:19:00.144166 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.144135    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"]
Sep 09 16:19:00.145222 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:00.145196    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16286dc_1930_4574_ae95_e6453158e759.slice/crio-040886d7ec1ff50536bb645eb6e5acbbc5880f40ae05bca53c5dbd47bfb41290 WatchSource:0}: Error finding container 040886d7ec1ff50536bb645eb6e5acbbc5880f40ae05bca53c5dbd47bfb41290: Status 404 returned error can't find the container with id 040886d7ec1ff50536bb645eb6e5acbbc5880f40ae05bca53c5dbd47bfb41290
Sep 09 16:19:00.243568 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:00.243535    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735a0cd5_0b92_4faa_b6e3_46ec582592b9.slice/crio-9aa116412b17a42623c908eacc5974a2ce63e71a532eced40e08ed97be4778d8 WatchSource:0}: Error finding container 9aa116412b17a42623c908eacc5974a2ce63e71a532eced40e08ed97be4778d8: Status 404 returned error can't find the container with id 9aa116412b17a42623c908eacc5974a2ce63e71a532eced40e08ed97be4778d8
Sep 09 16:19:00.243794 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.243750    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"]
Sep 09 16:19:00.350887 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.350862    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"]
Sep 09 16:19:00.352612 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:00.352587    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bb1a5b_e96f_4c80_ab03_bec24c736b0b.slice/crio-29ae0d8b9812741bea48efc105a03044a62d585960542fa262aebac4e7debc77 WatchSource:0}: Error finding container 29ae0d8b9812741bea48efc105a03044a62d585960542fa262aebac4e7debc77: Status 404 returned error can't find the container with id 29ae0d8b9812741bea48efc105a03044a62d585960542fa262aebac4e7debc77
Sep 09 16:19:00.371988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.371957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5" event={"ID":"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b","Type":"ContainerStarted","Data":"29ae0d8b9812741bea48efc105a03044a62d585960542fa262aebac4e7debc77"}
Sep 09 16:19:00.373900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.373866    2567 generic.go:356] "Generic (PLEG): container finished" podID="a16286dc-1930-4574-ae95-e6453158e759" containerID="44a7cd6dbec49f64279f22581f6c46d740f29e22ad8532440b1a77c28d5c7315" exitCode=0
Sep 09 16:19:00.374039 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.374011    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm" event={"ID":"a16286dc-1930-4574-ae95-e6453158e759","Type":"ContainerDied","Data":"44a7cd6dbec49f64279f22581f6c46d740f29e22ad8532440b1a77c28d5c7315"}
Sep 09 16:19:00.374149 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.374067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm" event={"ID":"a16286dc-1930-4574-ae95-e6453158e759","Type":"ContainerStarted","Data":"040886d7ec1ff50536bb645eb6e5acbbc5880f40ae05bca53c5dbd47bfb41290"}
Sep 09 16:19:00.375405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.375385    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:19:00.376387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.376363    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld" event={"ID":"735a0cd5-0b92-4faa-b6e3-46ec582592b9","Type":"ContainerStarted","Data":"3bbeda4a9912a5ab98ebe6d49c8683651ef4bd2c9d8f9ff91378ffee9c7279fd"}
Sep 09 16:19:00.376493 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.376412    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld" event={"ID":"735a0cd5-0b92-4faa-b6e3-46ec582592b9","Type":"ContainerStarted","Data":"9aa116412b17a42623c908eacc5974a2ce63e71a532eced40e08ed97be4778d8"}
Sep 09 16:19:00.378260 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.378237    2567 generic.go:356] "Generic (PLEG): container finished" podID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerID="fe3fdd432ccabe32dfb0283cf0e51f29d4f33f0ff3c0866892b4f96fb17091ba" exitCode=0
Sep 09 16:19:00.378354 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.378285    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft" event={"ID":"1e0ebb55-2572-4d3b-aa35-eb0541498c21","Type":"ContainerDied","Data":"fe3fdd432ccabe32dfb0283cf0e51f29d4f33f0ff3c0866892b4f96fb17091ba"}
Sep 09 16:19:00.378354 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:00.378309    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft" event={"ID":"1e0ebb55-2572-4d3b-aa35-eb0541498c21","Type":"ContainerStarted","Data":"b4e2339d17f115ecceac46d819993e1a66066ab16b096c7cb83d05f8094bd1f6"}
Sep 09 16:19:01.386266 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:01.386234    2567 generic.go:356] "Generic (PLEG): container finished" podID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerID="9b0751b32102d8107dde6bffa5740abe009a504736561acc342a8310960d3b46" exitCode=0
Sep 09 16:19:01.386660 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:01.386315    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5" event={"ID":"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b","Type":"ContainerDied","Data":"9b0751b32102d8107dde6bffa5740abe009a504736561acc342a8310960d3b46"}
Sep 09 16:19:01.388267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:01.388176    2567 generic.go:356] "Generic (PLEG): container finished" podID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerID="3bbeda4a9912a5ab98ebe6d49c8683651ef4bd2c9d8f9ff91378ffee9c7279fd" exitCode=0
Sep 09 16:19:01.388390 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:01.388265    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld" event={"ID":"735a0cd5-0b92-4faa-b6e3-46ec582592b9","Type":"ContainerDied","Data":"3bbeda4a9912a5ab98ebe6d49c8683651ef4bd2c9d8f9ff91378ffee9c7279fd"}
Sep 09 16:19:02.400999 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:02.400966    2567 generic.go:356] "Generic (PLEG): container finished" podID="a16286dc-1930-4574-ae95-e6453158e759" containerID="2eaed5b244eef24edddac31a85657e4b09355f0b9d6cd845d5300495d60e6905" exitCode=0
Sep 09 16:19:02.401339 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:02.401081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm" event={"ID":"a16286dc-1930-4574-ae95-e6453158e759","Type":"ContainerDied","Data":"2eaed5b244eef24edddac31a85657e4b09355f0b9d6cd845d5300495d60e6905"}
Sep 09 16:19:03.408456 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:03.408422    2567 generic.go:356] "Generic (PLEG): container finished" podID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerID="ffa5b26eed5f81d41ccea20b84936e59d0e7a0866327485290eee16ffa927c2b" exitCode=0
Sep 09 16:19:03.408918 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:03.408515    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5" event={"ID":"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b","Type":"ContainerDied","Data":"ffa5b26eed5f81d41ccea20b84936e59d0e7a0866327485290eee16ffa927c2b"}
Sep 09 16:19:03.410904 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:03.410880    2567 generic.go:356] "Generic (PLEG): container finished" podID="a16286dc-1930-4574-ae95-e6453158e759" containerID="755e5b5747c89b4a3d227fddd6262d7d67b74583538570b7a0f20de8ea1d599b" exitCode=0
Sep 09 16:19:03.411008 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:03.410965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm" event={"ID":"a16286dc-1930-4574-ae95-e6453158e759","Type":"ContainerDied","Data":"755e5b5747c89b4a3d227fddd6262d7d67b74583538570b7a0f20de8ea1d599b"}
Sep 09 16:19:03.412893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:03.412875    2567 generic.go:356] "Generic (PLEG): container finished" podID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerID="e4ba221555900f809e9c3b3d1aa9641bec3c284896ecadd8f1c74db6ab52e560" exitCode=0
Sep 09 16:19:03.412992 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:03.412956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld" event={"ID":"735a0cd5-0b92-4faa-b6e3-46ec582592b9","Type":"ContainerDied","Data":"e4ba221555900f809e9c3b3d1aa9641bec3c284896ecadd8f1c74db6ab52e560"}
Sep 09 16:19:04.427391 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.427360    2567 generic.go:356] "Generic (PLEG): container finished" podID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerID="bf6566124c63839d0459930005a21e5ef76b6edae60e41dc62a5c09cf03bdbea" exitCode=0
Sep 09 16:19:04.427744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.427440    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld" event={"ID":"735a0cd5-0b92-4faa-b6e3-46ec582592b9","Type":"ContainerDied","Data":"bf6566124c63839d0459930005a21e5ef76b6edae60e41dc62a5c09cf03bdbea"}
Sep 09 16:19:04.429340 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.429318    2567 generic.go:356] "Generic (PLEG): container finished" podID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerID="ddd18bca06ba03bca2a13ebcb2cf1d400d1dbb609331595d9a9ed0985f94f9f4" exitCode=0
Sep 09 16:19:04.429446 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.429401    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft" event={"ID":"1e0ebb55-2572-4d3b-aa35-eb0541498c21","Type":"ContainerDied","Data":"ddd18bca06ba03bca2a13ebcb2cf1d400d1dbb609331595d9a9ed0985f94f9f4"}
Sep 09 16:19:04.431645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.431623    2567 generic.go:356] "Generic (PLEG): container finished" podID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerID="5b9e4fc8769c3b5c4e4e39dd0fd53c7d954b6fdb7a73ba1c6b1d547b67e60e3b" exitCode=0
Sep 09 16:19:04.431727 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.431683    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5" event={"ID":"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b","Type":"ContainerDied","Data":"5b9e4fc8769c3b5c4e4e39dd0fd53c7d954b6fdb7a73ba1c6b1d547b67e60e3b"}
Sep 09 16:19:04.570303 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.570276    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:19:04.606782 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.606739    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-bundle\") pod \"a16286dc-1930-4574-ae95-e6453158e759\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") "
Sep 09 16:19:04.607233 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.607208    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-bundle" (OuterVolumeSpecName: "bundle") pod "a16286dc-1930-4574-ae95-e6453158e759" (UID: "a16286dc-1930-4574-ae95-e6453158e759"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:04.607471 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.607450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-util\") pod \"a16286dc-1930-4574-ae95-e6453158e759\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") "
Sep 09 16:19:04.607570 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.607483    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g2vv\" (UniqueName: \"kubernetes.io/projected/a16286dc-1930-4574-ae95-e6453158e759-kube-api-access-4g2vv\") pod \"a16286dc-1930-4574-ae95-e6453158e759\" (UID: \"a16286dc-1930-4574-ae95-e6453158e759\") "
Sep 09 16:19:04.607868 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.607845    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:04.609526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.609503    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16286dc-1930-4574-ae95-e6453158e759-kube-api-access-4g2vv" (OuterVolumeSpecName: "kube-api-access-4g2vv") pod "a16286dc-1930-4574-ae95-e6453158e759" (UID: "a16286dc-1930-4574-ae95-e6453158e759"). InnerVolumeSpecName "kube-api-access-4g2vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:04.613097 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.613071    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-util" (OuterVolumeSpecName: "util") pod "a16286dc-1930-4574-ae95-e6453158e759" (UID: "a16286dc-1930-4574-ae95-e6453158e759"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:04.708932 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.708836    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16286dc-1930-4574-ae95-e6453158e759-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:04.708932 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:04.708872    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g2vv\" (UniqueName: \"kubernetes.io/projected/a16286dc-1930-4574-ae95-e6453158e759-kube-api-access-4g2vv\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:05.442366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.442337    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm"
Sep 09 16:19:05.442366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.442359    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t4nvm" event={"ID":"a16286dc-1930-4574-ae95-e6453158e759","Type":"ContainerDied","Data":"040886d7ec1ff50536bb645eb6e5acbbc5880f40ae05bca53c5dbd47bfb41290"}
Sep 09 16:19:05.442829 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.442413    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="040886d7ec1ff50536bb645eb6e5acbbc5880f40ae05bca53c5dbd47bfb41290"
Sep 09 16:19:05.445193 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.445164    2567 generic.go:356] "Generic (PLEG): container finished" podID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerID="2f1671090b5466b67a9383039f96529fc90c8a7fc1630f7279e0cfd206394358" exitCode=0
Sep 09 16:19:05.445339 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.445207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft" event={"ID":"1e0ebb55-2572-4d3b-aa35-eb0541498c21","Type":"ContainerDied","Data":"2f1671090b5466b67a9383039f96529fc90c8a7fc1630f7279e0cfd206394358"}
Sep 09 16:19:05.592878 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.592856    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:19:05.616865 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.616834    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq7wg\" (UniqueName: \"kubernetes.io/projected/735a0cd5-0b92-4faa-b6e3-46ec582592b9-kube-api-access-gq7wg\") pod \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") "
Sep 09 16:19:05.617037 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.616926    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-bundle\") pod \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") "
Sep 09 16:19:05.617037 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.616982    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-util\") pod \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\" (UID: \"735a0cd5-0b92-4faa-b6e3-46ec582592b9\") "
Sep 09 16:19:05.617534 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.617503    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-bundle" (OuterVolumeSpecName: "bundle") pod "735a0cd5-0b92-4faa-b6e3-46ec582592b9" (UID: "735a0cd5-0b92-4faa-b6e3-46ec582592b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:05.618029 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.618007    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:19:05.618924 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.618903    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/735a0cd5-0b92-4faa-b6e3-46ec582592b9-kube-api-access-gq7wg" (OuterVolumeSpecName: "kube-api-access-gq7wg") pod "735a0cd5-0b92-4faa-b6e3-46ec582592b9" (UID: "735a0cd5-0b92-4faa-b6e3-46ec582592b9"). InnerVolumeSpecName "kube-api-access-gq7wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:05.621814 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.621791    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-util" (OuterVolumeSpecName: "util") pod "735a0cd5-0b92-4faa-b6e3-46ec582592b9" (UID: "735a0cd5-0b92-4faa-b6e3-46ec582592b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:05.717920 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.717831    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-bundle\") pod \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") "
Sep 09 16:19:05.717920 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.717864    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-util\") pod \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") "
Sep 09 16:19:05.717920 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.717905    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqgb9\" (UniqueName: \"kubernetes.io/projected/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-kube-api-access-hqgb9\") pod \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\" (UID: \"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b\") "
Sep 09 16:19:05.718165 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.718148    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:05.718208 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.718171    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/735a0cd5-0b92-4faa-b6e3-46ec582592b9-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:05.718208 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.718185    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq7wg\" (UniqueName: \"kubernetes.io/projected/735a0cd5-0b92-4faa-b6e3-46ec582592b9-kube-api-access-gq7wg\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:05.718347 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.718330    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-bundle" (OuterVolumeSpecName: "bundle") pod "b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" (UID: "b1bb1a5b-e96f-4c80-ab03-bec24c736b0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:05.720019 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.719994    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-kube-api-access-hqgb9" (OuterVolumeSpecName: "kube-api-access-hqgb9") pod "b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" (UID: "b1bb1a5b-e96f-4c80-ab03-bec24c736b0b"). InnerVolumeSpecName "kube-api-access-hqgb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:05.723560 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.723533    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-util" (OuterVolumeSpecName: "util") pod "b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" (UID: "b1bb1a5b-e96f-4c80-ab03-bec24c736b0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:05.819229 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.819195    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:05.819229 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.819229    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:05.819429 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:05.819243    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqgb9\" (UniqueName: \"kubernetes.io/projected/b1bb1a5b-e96f-4c80-ab03-bec24c736b0b-kube-api-access-hqgb9\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:06.452702 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.452675    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld"
Sep 09 16:19:06.453182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.452700    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csdnld" event={"ID":"735a0cd5-0b92-4faa-b6e3-46ec582592b9","Type":"ContainerDied","Data":"9aa116412b17a42623c908eacc5974a2ce63e71a532eced40e08ed97be4778d8"}
Sep 09 16:19:06.453182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.452744    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9aa116412b17a42623c908eacc5974a2ce63e71a532eced40e08ed97be4778d8"
Sep 09 16:19:06.454698 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.454671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5" event={"ID":"b1bb1a5b-e96f-4c80-ab03-bec24c736b0b","Type":"ContainerDied","Data":"29ae0d8b9812741bea48efc105a03044a62d585960542fa262aebac4e7debc77"}
Sep 09 16:19:06.454826 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.454710    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29ae0d8b9812741bea48efc105a03044a62d585960542fa262aebac4e7debc77"
Sep 09 16:19:06.454881 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.454857    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6wlmg5"
Sep 09 16:19:06.588757 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.588729    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:19:06.626578 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.626547    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-util\") pod \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") "
Sep 09 16:19:06.626755 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.626646    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1e0ebb55-2572-4d3b-aa35-eb0541498c21-kube-api-access-qtvm9\") pod \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") "
Sep 09 16:19:06.626755 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.626684    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-bundle\") pod \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\" (UID: \"1e0ebb55-2572-4d3b-aa35-eb0541498c21\") "
Sep 09 16:19:06.627438 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.627409    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-bundle" (OuterVolumeSpecName: "bundle") pod "1e0ebb55-2572-4d3b-aa35-eb0541498c21" (UID: "1e0ebb55-2572-4d3b-aa35-eb0541498c21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:06.628810 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.628756    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e0ebb55-2572-4d3b-aa35-eb0541498c21-kube-api-access-qtvm9" (OuterVolumeSpecName: "kube-api-access-qtvm9") pod "1e0ebb55-2572-4d3b-aa35-eb0541498c21" (UID: "1e0ebb55-2572-4d3b-aa35-eb0541498c21"). InnerVolumeSpecName "kube-api-access-qtvm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:06.631679 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.631651    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-util" (OuterVolumeSpecName: "util") pod "1e0ebb55-2572-4d3b-aa35-eb0541498c21" (UID: "1e0ebb55-2572-4d3b-aa35-eb0541498c21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:06.727482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.727367    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:06.727482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.727416    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e0ebb55-2572-4d3b-aa35-eb0541498c21-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:06.727482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:06.727430    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1e0ebb55-2572-4d3b-aa35-eb0541498c21-kube-api-access-qtvm9\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:07.468851 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:07.462052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft" event={"ID":"1e0ebb55-2572-4d3b-aa35-eb0541498c21","Type":"ContainerDied","Data":"b4e2339d17f115ecceac46d819993e1a66066ab16b096c7cb83d05f8094bd1f6"}
Sep 09 16:19:07.468851 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:07.462599    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847am6rft"
Sep 09 16:19:07.468851 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:07.462600    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4e2339d17f115ecceac46d819993e1a66066ab16b096c7cb83d05f8094bd1f6"
Sep 09 16:19:09.652125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:09.652093    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:11.712155 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712118    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"]
Sep 09 16:19:11.712524 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712498    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerName="pull"
Sep 09 16:19:11.712524 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712510    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerName="pull"
Sep 09 16:19:11.712524 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712520    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerName="util"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712527    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerName="util"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712534    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerName="extract"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712539    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerName="extract"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712549    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerName="util"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712555    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerName="util"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712563    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerName="extract"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712568    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerName="extract"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712578    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16286dc-1930-4574-ae95-e6453158e759" containerName="pull"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712583    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16286dc-1930-4574-ae95-e6453158e759" containerName="pull"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712589    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerName="pull"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712594    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerName="pull"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712603    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerName="util"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712608    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerName="util"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712614    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16286dc-1930-4574-ae95-e6453158e759" containerName="util"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712620    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16286dc-1930-4574-ae95-e6453158e759" containerName="util"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712625    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16286dc-1930-4574-ae95-e6453158e759" containerName="extract"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712629    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16286dc-1930-4574-ae95-e6453158e759" containerName="extract"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712635    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerName="pull"
Sep 09 16:19:11.712635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712639    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerName="pull"
Sep 09 16:19:11.713239 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712647    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerName="extract"
Sep 09 16:19:11.713239 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712651    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerName="extract"
Sep 09 16:19:11.713239 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712711    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16286dc-1930-4574-ae95-e6453158e759" containerName="extract"
Sep 09 16:19:11.713239 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712719    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="735a0cd5-0b92-4faa-b6e3-46ec582592b9" containerName="extract"
Sep 09 16:19:11.713239 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712726    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e0ebb55-2572-4d3b-aa35-eb0541498c21" containerName="extract"
Sep 09 16:19:11.713239 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.712734    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bb1a5b-e96f-4c80-ab03-bec24c736b0b" containerName="extract"
Sep 09 16:19:11.717533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.717511    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:11.724761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.724737    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 16:19:11.725836 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.725808    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qr2h2\""
Sep 09 16:19:11.731887 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.731860    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 16:19:11.741651 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.741621    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"]
Sep 09 16:19:11.776959 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.776914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z6qs\" (UniqueName: \"kubernetes.io/projected/6e6895a8-1042-4137-9755-fb1f8a6a4221-kube-api-access-5z6qs\") pod \"limitador-operator-controller-manager-74495c69f8-ns444\" (UID: \"6e6895a8-1042-4137-9755-fb1f8a6a4221\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:11.877813 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.877749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z6qs\" (UniqueName: \"kubernetes.io/projected/6e6895a8-1042-4137-9755-fb1f8a6a4221-kube-api-access-5z6qs\") pod \"limitador-operator-controller-manager-74495c69f8-ns444\" (UID: \"6e6895a8-1042-4137-9755-fb1f8a6a4221\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:11.903267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:11.903232    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z6qs\" (UniqueName: \"kubernetes.io/projected/6e6895a8-1042-4137-9755-fb1f8a6a4221-kube-api-access-5z6qs\") pod \"limitador-operator-controller-manager-74495c69f8-ns444\" (UID: \"6e6895a8-1042-4137-9755-fb1f8a6a4221\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:12.028082 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:12.027972    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:12.308061 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:12.308033    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"]
Sep 09 16:19:12.309704 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:12.309676    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6895a8_1042_4137_9755_fb1f8a6a4221.slice/crio-ff8a5dac634d66bde3431ddfbca1e6d52ff9c2f02fafaf633e8aaf09cc3a8db8 WatchSource:0}: Error finding container ff8a5dac634d66bde3431ddfbca1e6d52ff9c2f02fafaf633e8aaf09cc3a8db8: Status 404 returned error can't find the container with id ff8a5dac634d66bde3431ddfbca1e6d52ff9c2f02fafaf633e8aaf09cc3a8db8
Sep 09 16:19:12.495571 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:12.495534    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444" event={"ID":"6e6895a8-1042-4137-9755-fb1f8a6a4221","Type":"ContainerStarted","Data":"ff8a5dac634d66bde3431ddfbca1e6d52ff9c2f02fafaf633e8aaf09cc3a8db8"}
Sep 09 16:19:12.554256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:12.554221    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:12.862463 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:12.862433    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:13.272206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.272166    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:13.844017 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.843974    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-695754c747-ngvf4"]
Sep 09 16:19:13.847953 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.847919    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.862537 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.862506    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-695754c747-ngvf4"]
Sep 09 16:19:13.895325 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.895285    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-service-ca\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.895493 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.895340    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-serving-cert\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.895493 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.895366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-config\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.895493 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.895447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-trusted-ca-bundle\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.895662 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.895501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-oauth-config\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.895662 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.895558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q89tp\" (UniqueName: \"kubernetes.io/projected/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-kube-api-access-q89tp\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.895662 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.895637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-oauth-serving-cert\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.996564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.996525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-oauth-serving-cert\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.996759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.996608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-service-ca\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.996759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.996635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-serving-cert\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.996759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.996653    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-config\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.996759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.996688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-trusted-ca-bundle\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.996759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.996732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-oauth-config\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.997060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.996786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q89tp\" (UniqueName: \"kubernetes.io/projected/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-kube-api-access-q89tp\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.997468 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.997438    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-oauth-serving-cert\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.997561 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.997446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-config\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.997561 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.997442    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-service-ca\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.997683 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.997556    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-trusted-ca-bundle\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.999554 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.999529    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-oauth-config\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:13.999761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:13.999742    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-console-serving-cert\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:14.006727 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:14.006702    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q89tp\" (UniqueName: \"kubernetes.io/projected/65e017ec-72c6-4bf8-9b8f-40b6493f92d9-kube-api-access-q89tp\") pod \"console-695754c747-ngvf4\" (UID: \"65e017ec-72c6-4bf8-9b8f-40b6493f92d9\") " pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:14.161632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:14.161587    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:14.440241 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:14.440212    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-695754c747-ngvf4"]
Sep 09 16:19:14.441080 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:14.441050    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e017ec_72c6_4bf8_9b8f_40b6493f92d9.slice/crio-7450422b3744172f3399ce9ba188938a9853299537fca04622de847d873926a5 WatchSource:0}: Error finding container 7450422b3744172f3399ce9ba188938a9853299537fca04622de847d873926a5: Status 404 returned error can't find the container with id 7450422b3744172f3399ce9ba188938a9853299537fca04622de847d873926a5
Sep 09 16:19:14.508582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:14.508552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695754c747-ngvf4" event={"ID":"65e017ec-72c6-4bf8-9b8f-40b6493f92d9","Type":"ContainerStarted","Data":"7450422b3744172f3399ce9ba188938a9853299537fca04622de847d873926a5"}
Sep 09 16:19:15.516194 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:15.516152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695754c747-ngvf4" event={"ID":"65e017ec-72c6-4bf8-9b8f-40b6493f92d9","Type":"ContainerStarted","Data":"51c56ff5f6cc0fb7f53460c6abcd1812b3be239e843d833bfb66454a7e3353d8"}
Sep 09 16:19:15.539271 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:15.539210    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-695754c747-ngvf4" podStartSLOduration=2.539190602 podStartE2EDuration="2.539190602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:15.536074799 +0000 UTC m=+653.307166047" watchObservedRunningTime="2026-09-09 16:19:15.539190602 +0000 UTC m=+653.310281932"
Sep 09 16:19:15.990490 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:15.990450    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:16.060000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.059962    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"]
Sep 09 16:19:16.063971 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.063943    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:16.066392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.066365    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-plhqf\""
Sep 09 16:19:16.076942 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.076914    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"]
Sep 09 16:19:16.083290 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.083213    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:16.116265 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.116230    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51c87f90-e4fc-4165-9f76-121cf5e19f9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" (UID: \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:16.116418 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.116354    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmd9w\" (UniqueName: \"kubernetes.io/projected/51c87f90-e4fc-4165-9f76-121cf5e19f9c-kube-api-access-hmd9w\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" (UID: \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:16.217599 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.217545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51c87f90-e4fc-4165-9f76-121cf5e19f9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" (UID: \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:16.217799 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.217718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmd9w\" (UniqueName: \"kubernetes.io/projected/51c87f90-e4fc-4165-9f76-121cf5e19f9c-kube-api-access-hmd9w\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" (UID: \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:16.218093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.218049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51c87f90-e4fc-4165-9f76-121cf5e19f9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" (UID: \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:16.230929 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.230891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmd9w\" (UniqueName: \"kubernetes.io/projected/51c87f90-e4fc-4165-9f76-121cf5e19f9c-kube-api-access-hmd9w\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" (UID: \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:16.378763 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.378723    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:16.444762 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.444723    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:16.759727 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.759580    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:16.844430 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:16.844396    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:17.531308 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:17.531269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444" event={"ID":"6e6895a8-1042-4137-9755-fb1f8a6a4221","Type":"ContainerStarted","Data":"a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c"}
Sep 09 16:19:17.531527 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:17.531416    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:17.548844 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:17.548789    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444" podStartSLOduration=1.459339983 podStartE2EDuration="6.548758606s" totalImagesPullingTime="5.089418623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:17.546688522 +0000 UTC m=+655.317779768" watchObservedRunningTime="2026-09-09 16:19:17.548758606 +0000 UTC m=+655.319849851"
Sep 09 16:19:17.601423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:17.601389    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"]
Sep 09 16:19:17.602931 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:17.602899    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c87f90_e4fc_4165_9f76_121cf5e19f9c.slice/crio-de022d5a9bfa325b0fbf71f0a8b26ebfc35d4ba6207e96eee20a21f7dcc6b192 WatchSource:0}: Error finding container de022d5a9bfa325b0fbf71f0a8b26ebfc35d4ba6207e96eee20a21f7dcc6b192: Status 404 returned error can't find the container with id de022d5a9bfa325b0fbf71f0a8b26ebfc35d4ba6207e96eee20a21f7dcc6b192
Sep 09 16:19:18.508811 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.508759    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:18.537830 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.537794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw" event={"ID":"51c87f90-e4fc-4165-9f76-121cf5e19f9c","Type":"ContainerStarted","Data":"de022d5a9bfa325b0fbf71f0a8b26ebfc35d4ba6207e96eee20a21f7dcc6b192"}
Sep 09 16:19:18.776317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.776236    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bc8vj"]
Sep 09 16:19:18.780360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.780341    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj"
Sep 09 16:19:18.787836 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.787548    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8whmh\""
Sep 09 16:19:18.796706 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.796672    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bc8vj"]
Sep 09 16:19:18.843718 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.843677    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-624vq\" (UniqueName: \"kubernetes.io/projected/2775f5b0-477d-467a-8c7f-6966bb1c53b7-kube-api-access-624vq\") pod \"authorino-operator-76b478bd78-bc8vj\" (UID: \"2775f5b0-477d-467a-8c7f-6966bb1c53b7\") " pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj"
Sep 09 16:19:18.944821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.944760    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-624vq\" (UniqueName: \"kubernetes.io/projected/2775f5b0-477d-467a-8c7f-6966bb1c53b7-kube-api-access-624vq\") pod \"authorino-operator-76b478bd78-bc8vj\" (UID: \"2775f5b0-477d-467a-8c7f-6966bb1c53b7\") " pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj"
Sep 09 16:19:18.954340 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:18.954301    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-624vq\" (UniqueName: \"kubernetes.io/projected/2775f5b0-477d-467a-8c7f-6966bb1c53b7-kube-api-access-624vq\") pod \"authorino-operator-76b478bd78-bc8vj\" (UID: \"2775f5b0-477d-467a-8c7f-6966bb1c53b7\") " pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj"
Sep 09 16:19:19.091607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:19.091511    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj"
Sep 09 16:19:19.379382 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:19.379331    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bc8vj"]
Sep 09 16:19:19.383736 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:19.383701    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2775f5b0_477d_467a_8c7f_6966bb1c53b7.slice/crio-133e3f5bf832820e42615fe67902160c8d9a75fcab05a9cdca3fdca158d7344d WatchSource:0}: Error finding container 133e3f5bf832820e42615fe67902160c8d9a75fcab05a9cdca3fdca158d7344d: Status 404 returned error can't find the container with id 133e3f5bf832820e42615fe67902160c8d9a75fcab05a9cdca3fdca158d7344d
Sep 09 16:19:19.472800 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:19.472751    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:19.546972 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:19.546934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj" event={"ID":"2775f5b0-477d-467a-8c7f-6966bb1c53b7","Type":"ContainerStarted","Data":"133e3f5bf832820e42615fe67902160c8d9a75fcab05a9cdca3fdca158d7344d"}
Sep 09 16:19:19.749367 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:19.749266    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:21.132018 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.131979    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"]
Sep 09 16:19:21.136401 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.136366    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"
Sep 09 16:19:21.139010 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.138982    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 16:19:21.139166 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.139033    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-t6qw9\""
Sep 09 16:19:21.155999 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.155909    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"]
Sep 09 16:19:21.269133 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.269098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4btz\" (UniqueName: \"kubernetes.io/projected/7011f5e6-1ebb-4bd5-b5d6-52640a7de0af-kube-api-access-q4btz\") pod \"dns-operator-controller-manager-7b84cd7c9c-kxbm6\" (UID: \"7011f5e6-1ebb-4bd5-b5d6-52640a7de0af\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"
Sep 09 16:19:21.370244 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.370202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4btz\" (UniqueName: \"kubernetes.io/projected/7011f5e6-1ebb-4bd5-b5d6-52640a7de0af-kube-api-access-q4btz\") pod \"dns-operator-controller-manager-7b84cd7c9c-kxbm6\" (UID: \"7011f5e6-1ebb-4bd5-b5d6-52640a7de0af\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"
Sep 09 16:19:21.383390 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.383352    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4btz\" (UniqueName: \"kubernetes.io/projected/7011f5e6-1ebb-4bd5-b5d6-52640a7de0af-kube-api-access-q4btz\") pod \"dns-operator-controller-manager-7b84cd7c9c-kxbm6\" (UID: \"7011f5e6-1ebb-4bd5-b5d6-52640a7de0af\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"
Sep 09 16:19:21.450491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:21.450399    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"
Sep 09 16:19:22.090180 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:22.090144    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"]
Sep 09 16:19:22.091816 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:22.091737    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7011f5e6_1ebb_4bd5_b5d6_52640a7de0af.slice/crio-fad923fedd4f98ca31aacc17d2406407f24221a34f3be285af2524762a8dc406 WatchSource:0}: Error finding container fad923fedd4f98ca31aacc17d2406407f24221a34f3be285af2524762a8dc406: Status 404 returned error can't find the container with id fad923fedd4f98ca31aacc17d2406407f24221a34f3be285af2524762a8dc406
Sep 09 16:19:22.470298 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:22.470248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:22.567545 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:22.567506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw" event={"ID":"51c87f90-e4fc-4165-9f76-121cf5e19f9c","Type":"ContainerStarted","Data":"51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a"}
Sep 09 16:19:22.567726 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:22.567621    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:22.569051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:22.569029    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6" event={"ID":"7011f5e6-1ebb-4bd5-b5d6-52640a7de0af","Type":"ContainerStarted","Data":"fad923fedd4f98ca31aacc17d2406407f24221a34f3be285af2524762a8dc406"}
Sep 09 16:19:22.572129 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:22.572095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:22.592314 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:22.592263    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw" podStartSLOduration=2.329102142 podStartE2EDuration="6.592247291s" totalImagesPullingTime="4.263145149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:22.588764882 +0000 UTC m=+660.359856129" watchObservedRunningTime="2026-09-09 16:19:22.592247291 +0000 UTC m=+660.363338538"
Sep 09 16:19:23.577464 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:23.577422    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj" event={"ID":"2775f5b0-477d-467a-8c7f-6966bb1c53b7","Type":"ContainerStarted","Data":"3373e24367d198adf00bba630784c5a6d6cf0481eaf8b5b13de486ab846bb499"}
Sep 09 16:19:23.577960 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:23.577565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj"
Sep 09 16:19:23.598678 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:23.598609    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj" podStartSLOduration=2.381786374 podStartE2EDuration="5.598592936s" totalImagesPullingTime="3.216806562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:23.596409202 +0000 UTC m=+661.367500472" watchObservedRunningTime="2026-09-09 16:19:23.598592936 +0000 UTC m=+661.369684182"
Sep 09 16:19:23.865443 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:23.865415    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 16:19:24.162592 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.162553    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:24.162822 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.162621    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:24.168189 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.168162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:24.585341 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.585248    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6" event={"ID":"7011f5e6-1ebb-4bd5-b5d6-52640a7de0af","Type":"ContainerStarted","Data":"0f32600fb85b7d5affadf9c1153cd682e41261273e6861faeba09cc0010b0756"}
Sep 09 16:19:24.585813 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.585580    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"
Sep 09 16:19:24.589328 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.589305    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-695754c747-ngvf4"
Sep 09 16:19:24.602319 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.602267    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6" podStartSLOduration=1.8349494069999999 podStartE2EDuration="3.602253259s" totalImagesPullingTime="1.767303852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:24.600453218 +0000 UTC m=+662.371544464" watchObservedRunningTime="2026-09-09 16:19:24.602253259 +0000 UTC m=+662.373344505"
Sep 09 16:19:24.646511 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.646473    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686f6788fb-v24qm"]
Sep 09 16:19:24.746393 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.746362    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:24.860082 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.860003    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:24.952854 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:24.952821    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:25.054186 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:25.054154    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:25.150105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:25.150071    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:26.243677 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:26.243644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:26.303227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:26.303190    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:26.651284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:26.651249    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:26.749940 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:26.749907    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:26.853115 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:26.853076    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:26.954674 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:26.954588    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:28.540012 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:28.539978    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:33.580267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:33.580236    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:34.587242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:34.587210    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-bc8vj"
Sep 09 16:19:34.871842 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:34.871726    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:34.968253 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:34.968214    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:35.043137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.043096    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"]
Sep 09 16:19:35.050660 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.050621    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:35.063931 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.063896    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"]
Sep 09 16:19:35.196860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.196815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85b756b9-7853-4f48-bb3b-586801e5b806-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" (UID: \"85b756b9-7853-4f48-bb3b-586801e5b806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:35.197082 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.197020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q985j\" (UniqueName: \"kubernetes.io/projected/85b756b9-7853-4f48-bb3b-586801e5b806-kube-api-access-q985j\") pod \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" (UID: \"85b756b9-7853-4f48-bb3b-586801e5b806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:35.297724 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.297682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q985j\" (UniqueName: \"kubernetes.io/projected/85b756b9-7853-4f48-bb3b-586801e5b806-kube-api-access-q985j\") pod \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" (UID: \"85b756b9-7853-4f48-bb3b-586801e5b806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:35.297924 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.297736    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85b756b9-7853-4f48-bb3b-586801e5b806-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" (UID: \"85b756b9-7853-4f48-bb3b-586801e5b806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:35.298136 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.298114    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85b756b9-7853-4f48-bb3b-586801e5b806-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" (UID: \"85b756b9-7853-4f48-bb3b-586801e5b806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:35.318632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.318602    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q985j\" (UniqueName: \"kubernetes.io/projected/85b756b9-7853-4f48-bb3b-586801e5b806-kube-api-access-q985j\") pod \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" (UID: \"85b756b9-7853-4f48-bb3b-586801e5b806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:35.362482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.362441    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:35.592789 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.592698    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kxbm6"
Sep 09 16:19:35.641359 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.641328    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"]
Sep 09 16:19:35.643648 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:35.643617    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b756b9_7853_4f48_bb3b_586801e5b806.slice/crio-b9d5831f2c5a7ef7f5bf78276bf77b7bf01620f37a9cab9b2e9a4203ca9abe3a WatchSource:0}: Error finding container b9d5831f2c5a7ef7f5bf78276bf77b7bf01620f37a9cab9b2e9a4203ca9abe3a: Status 404 returned error can't find the container with id b9d5831f2c5a7ef7f5bf78276bf77b7bf01620f37a9cab9b2e9a4203ca9abe3a
Sep 09 16:19:35.653999 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:35.653972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk" event={"ID":"85b756b9-7853-4f48-bb3b-586801e5b806","Type":"ContainerStarted","Data":"b9d5831f2c5a7ef7f5bf78276bf77b7bf01620f37a9cab9b2e9a4203ca9abe3a"}
Sep 09 16:19:36.085960 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.085917    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"]
Sep 09 16:19:36.099971 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.099937    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"]
Sep 09 16:19:36.110324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.110292    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"]
Sep 09 16:19:36.110529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.110491    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" containerName="manager" containerID="cri-o://51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a" gracePeriod=2
Sep 09 16:19:36.116355 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.116296    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"]
Sep 09 16:19:36.117124 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.117077    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" containerName="manager"
Sep 09 16:19:36.117124 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.117099    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" containerName="manager"
Sep 09 16:19:36.117311 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.117229    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" containerName="manager"
Sep 09 16:19:36.122102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.122079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:36.122452 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.122429    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"]
Sep 09 16:19:36.141922 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.141871    2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"51c87f90-e4fc-4165-9f76-121cf5e19f9c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\": pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.143936 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.143905    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.145389 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.145363    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"]
Sep 09 16:19:36.151022 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.150993    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"]
Sep 09 16:19:36.151394 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.151363    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" containerName="manager" containerID="cri-o://a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c" gracePeriod=2
Sep 09 16:19:36.160221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.158925    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"]
Sep 09 16:19:36.160221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.159593    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" containerName="manager"
Sep 09 16:19:36.160221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.159712    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" containerName="manager"
Sep 09 16:19:36.160221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.159887    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" containerName="manager"
Sep 09 16:19:36.165721 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.165695    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"]
Sep 09 16:19:36.165869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.165841    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:36.179074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.179044    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"]
Sep 09 16:19:36.184850 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.184523    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.189244 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.189218    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"]
Sep 09 16:19:36.189688 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.189673    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" containerName="manager"
Sep 09 16:19:36.189688 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.189690    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" containerName="manager"
Sep 09 16:19:36.189813 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.189763    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" containerName="manager"
Sep 09 16:19:36.193252 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.193219    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"
Sep 09 16:19:36.206473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.206438    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"]
Sep 09 16:19:36.211865 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.211832    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ns444\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.214023 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.213954    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.216188 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.216165    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ns444\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.307939 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.307898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fnn5\" (UniqueName: \"kubernetes.io/projected/c9116eef-311a-4861-8a64-91f1cc199711-kube-api-access-6fnn5\") pod \"kuadrant-operator-controller-manager-5f685c496f-vk28w\" (UID: \"c9116eef-311a-4861-8a64-91f1cc199711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:36.308123 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.307958    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vd9q\" (UniqueName: \"kubernetes.io/projected/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-kube-api-access-5vd9q\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sv9nh\" (UID: \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:36.308123 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.307989    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9116eef-311a-4861-8a64-91f1cc199711-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-vk28w\" (UID: \"c9116eef-311a-4861-8a64-91f1cc199711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:36.308123 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.308089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sv9nh\" (UID: \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:36.308284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.308152    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjgdl\" (UniqueName: \"kubernetes.io/projected/4745fc4f-3986-40ae-a34a-80c0d8d26034-kube-api-access-xjgdl\") pod \"limitador-operator-controller-manager-74495c69f8-jvjqz\" (UID: \"4745fc4f-3986-40ae-a34a-80c0d8d26034\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"
Sep 09 16:19:36.411885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.410252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fnn5\" (UniqueName: \"kubernetes.io/projected/c9116eef-311a-4861-8a64-91f1cc199711-kube-api-access-6fnn5\") pod \"kuadrant-operator-controller-manager-5f685c496f-vk28w\" (UID: \"c9116eef-311a-4861-8a64-91f1cc199711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:36.411885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.410317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vd9q\" (UniqueName: \"kubernetes.io/projected/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-kube-api-access-5vd9q\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sv9nh\" (UID: \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:36.411885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.410351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9116eef-311a-4861-8a64-91f1cc199711-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-vk28w\" (UID: \"c9116eef-311a-4861-8a64-91f1cc199711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:36.411885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.410749    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9116eef-311a-4861-8a64-91f1cc199711-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-vk28w\" (UID: \"c9116eef-311a-4861-8a64-91f1cc199711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:36.411885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.410894    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sv9nh\" (UID: \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:36.411885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.410952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjgdl\" (UniqueName: \"kubernetes.io/projected/4745fc4f-3986-40ae-a34a-80c0d8d26034-kube-api-access-xjgdl\") pod \"limitador-operator-controller-manager-74495c69f8-jvjqz\" (UID: \"4745fc4f-3986-40ae-a34a-80c0d8d26034\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"
Sep 09 16:19:36.412266 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.412024    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sv9nh\" (UID: \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:36.425284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.425257    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vd9q\" (UniqueName: \"kubernetes.io/projected/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-kube-api-access-5vd9q\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sv9nh\" (UID: \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:36.425390 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.425280    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjgdl\" (UniqueName: \"kubernetes.io/projected/4745fc4f-3986-40ae-a34a-80c0d8d26034-kube-api-access-xjgdl\") pod \"limitador-operator-controller-manager-74495c69f8-jvjqz\" (UID: \"4745fc4f-3986-40ae-a34a-80c0d8d26034\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"
Sep 09 16:19:36.426191 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.426168    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fnn5\" (UniqueName: \"kubernetes.io/projected/c9116eef-311a-4861-8a64-91f1cc199711-kube-api-access-6fnn5\") pod \"kuadrant-operator-controller-manager-5f685c496f-vk28w\" (UID: \"c9116eef-311a-4861-8a64-91f1cc199711\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:36.441546 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.441524    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.443564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.443548    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.443983 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.443962    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.446119 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.446096    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ns444\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.448378 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.448356    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ns444\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.450513 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.450493    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.517700 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.517663    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:36.525750 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.525720    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:36.532579 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.532556    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"
Sep 09 16:19:36.613056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.612992    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z6qs\" (UniqueName: \"kubernetes.io/projected/6e6895a8-1042-4137-9755-fb1f8a6a4221-kube-api-access-5z6qs\") pod \"6e6895a8-1042-4137-9755-fb1f8a6a4221\" (UID: \"6e6895a8-1042-4137-9755-fb1f8a6a4221\") "
Sep 09 16:19:36.613056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.613142    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51c87f90-e4fc-4165-9f76-121cf5e19f9c-extensions-socket-volume\") pod \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\" (UID: \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\") "
Sep 09 16:19:36.613056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.613242    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmd9w\" (UniqueName: \"kubernetes.io/projected/51c87f90-e4fc-4165-9f76-121cf5e19f9c-kube-api-access-hmd9w\") pod \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\" (UID: \"51c87f90-e4fc-4165-9f76-121cf5e19f9c\") "
Sep 09 16:19:36.613056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.613461    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c87f90-e4fc-4165-9f76-121cf5e19f9c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "51c87f90-e4fc-4165-9f76-121cf5e19f9c" (UID: "51c87f90-e4fc-4165-9f76-121cf5e19f9c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:36.614194 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.613608    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51c87f90-e4fc-4165-9f76-121cf5e19f9c-extensions-socket-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:36.615873 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.615829    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6895a8-1042-4137-9755-fb1f8a6a4221-kube-api-access-5z6qs" (OuterVolumeSpecName: "kube-api-access-5z6qs") pod "6e6895a8-1042-4137-9755-fb1f8a6a4221" (UID: "6e6895a8-1042-4137-9755-fb1f8a6a4221"). InnerVolumeSpecName "kube-api-access-5z6qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:36.616477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.616454    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c87f90-e4fc-4165-9f76-121cf5e19f9c-kube-api-access-hmd9w" (OuterVolumeSpecName: "kube-api-access-hmd9w") pod "51c87f90-e4fc-4165-9f76-121cf5e19f9c" (UID: "51c87f90-e4fc-4165-9f76-121cf5e19f9c"). InnerVolumeSpecName "kube-api-access-hmd9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:36.663482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.663446    2567 generic.go:356] "Generic (PLEG): container finished" podID="6e6895a8-1042-4137-9755-fb1f8a6a4221" containerID="a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c" exitCode=0
Sep 09 16:19:36.663642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.663493    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.663642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.663530    2567 scope.go:117] "RemoveContainer" containerID="a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c"
Sep 09 16:19:36.665349 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.665324    2567 generic.go:356] "Generic (PLEG): container finished" podID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" containerID="51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a" exitCode=0
Sep 09 16:19:36.665474 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.665373    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.665949 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.665919    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.667684 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.667656    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ns444\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.667962 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.667944    2567 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk" container="manager"
Sep 09 16:19:36.669727 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.669703    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.671534 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.671515    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ns444\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.673518 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.673439    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:36.673850 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.673829    2567 scope.go:117] "RemoveContainer" containerID="a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c"
Sep 09 16:19:36.674221 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.674148    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c\": container with ID starting with a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c not found: ID does not exist" containerID="a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c"
Sep 09 16:19:36.674221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.674185    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c"} err="failed to get container status \"a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c\": rpc error: code = NotFound desc = could not find container \"a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c\": container with ID starting with a4d306cde10799a1e9c9b6879a6d2dbb63ab7ef891446677f1a9a5f7ae31781c not found: ID does not exist"
Sep 09 16:19:36.674221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.674209    2567 scope.go:117] "RemoveContainer" containerID="51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a"
Sep 09 16:19:36.675408 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.675310    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.677129 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.677102    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ns444\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.679002 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.678977    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ns444\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ns444"
Sep 09 16:19:36.681985 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.681962    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:36.683657 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.683628    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hc7gw\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hc7gw"
Sep 09 16:19:36.683740 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.683677    2567 scope.go:117] "RemoveContainer" containerID="51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a"
Sep 09 16:19:36.683988 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:36.683969    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a\": container with ID starting with 51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a not found: ID does not exist" containerID="51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a"
Sep 09 16:19:36.684047 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.683995    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a"} err="failed to get container status \"51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a\": rpc error: code = NotFound desc = could not find container \"51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a\": container with ID starting with 51bd189eda262a7815f77a3ce4080f631c3cf9bb5d232f0b1902e7f5ad7e260a not found: ID does not exist"
Sep 09 16:19:36.714963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.714922    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z6qs\" (UniqueName: \"kubernetes.io/projected/6e6895a8-1042-4137-9755-fb1f8a6a4221-kube-api-access-5z6qs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:36.714963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.714954    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmd9w\" (UniqueName: \"kubernetes.io/projected/51c87f90-e4fc-4165-9f76-121cf5e19f9c-kube-api-access-hmd9w\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:36.737513 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.737485    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51c87f90-e4fc-4165-9f76-121cf5e19f9c" path="/var/lib/kubelet/pods/51c87f90-e4fc-4165-9f76-121cf5e19f9c/volumes"
Sep 09 16:19:36.737863 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.737849    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e6895a8-1042-4137-9755-fb1f8a6a4221" path="/var/lib/kubelet/pods/6e6895a8-1042-4137-9755-fb1f8a6a4221/volumes"
Sep 09 16:19:36.802260 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.802232    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"]
Sep 09 16:19:36.803548 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:36.803522    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9116eef_311a_4861_8a64_91f1cc199711.slice/crio-6760de6ac38d133a3ad509543fc7833d0b26496a58c77839a0bef6361b17a0ef WatchSource:0}: Error finding container 6760de6ac38d133a3ad509543fc7833d0b26496a58c77839a0bef6361b17a0ef: Status 404 returned error can't find the container with id 6760de6ac38d133a3ad509543fc7833d0b26496a58c77839a0bef6361b17a0ef
Sep 09 16:19:36.816643 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.816621    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"]
Sep 09 16:19:36.820224 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:36.820199    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e9d21f_0cc8_4aca_846b_d2ecbfe23721.slice/crio-cdbd572448ac6b6aee943118e977b4b073b19a7ecd8a638d191c3476c38b6a01 WatchSource:0}: Error finding container cdbd572448ac6b6aee943118e977b4b073b19a7ecd8a638d191c3476c38b6a01: Status 404 returned error can't find the container with id cdbd572448ac6b6aee943118e977b4b073b19a7ecd8a638d191c3476c38b6a01
Sep 09 16:19:36.831734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:36.831706    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"]
Sep 09 16:19:36.831999 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:36.831977    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4745fc4f_3986_40ae_a34a_80c0d8d26034.slice/crio-18b68ba7df986f0e124e08bb234a94d25e33460c70908d22900683c2162a09b9 WatchSource:0}: Error finding container 18b68ba7df986f0e124e08bb234a94d25e33460c70908d22900683c2162a09b9: Status 404 returned error can't find the container with id 18b68ba7df986f0e124e08bb234a94d25e33460c70908d22900683c2162a09b9
Sep 09 16:19:37.334711 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.334683    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:37.683031 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.682972    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" containerName="manager" containerID="cri-o://f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae" gracePeriod=2
Sep 09 16:19:37.684885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.684857    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh" event={"ID":"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721","Type":"ContainerStarted","Data":"de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6"}
Sep 09 16:19:37.685018 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.684949    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh" event={"ID":"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721","Type":"ContainerStarted","Data":"cdbd572448ac6b6aee943118e977b4b073b19a7ecd8a638d191c3476c38b6a01"}
Sep 09 16:19:37.685018 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.684982    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:37.686927 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.686901    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w" event={"ID":"c9116eef-311a-4861-8a64-91f1cc199711","Type":"ContainerStarted","Data":"413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5"}
Sep 09 16:19:37.687031 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.686954    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:37.687031 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.686980    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w" event={"ID":"c9116eef-311a-4861-8a64-91f1cc199711","Type":"ContainerStarted","Data":"6760de6ac38d133a3ad509543fc7833d0b26496a58c77839a0bef6361b17a0ef"}
Sep 09 16:19:37.691009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.690978    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz" event={"ID":"4745fc4f-3986-40ae-a34a-80c0d8d26034","Type":"ContainerStarted","Data":"cbb0b7767e9dd43574fe7d32943a87a7bf4996a257296eef012780dad91e6e7e"}
Sep 09 16:19:37.691092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.691026    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz" event={"ID":"4745fc4f-3986-40ae-a34a-80c0d8d26034","Type":"ContainerStarted","Data":"18b68ba7df986f0e124e08bb234a94d25e33460c70908d22900683c2162a09b9"}
Sep 09 16:19:37.691092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.691049    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"
Sep 09 16:19:37.706554 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.706507    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh" podStartSLOduration=1.706492326 podStartE2EDuration="1.706492326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:37.704274366 +0000 UTC m=+675.475365612" watchObservedRunningTime="2026-09-09 16:19:37.706492326 +0000 UTC m=+675.477583637"
Sep 09 16:19:37.723348 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.723282    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz" podStartSLOduration=1.723265997 podStartE2EDuration="1.723265997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:37.72262367 +0000 UTC m=+675.493714913" watchObservedRunningTime="2026-09-09 16:19:37.723265997 +0000 UTC m=+675.494357247"
Sep 09 16:19:37.744432 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.744372    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w" podStartSLOduration=1.744354232 podStartE2EDuration="1.744354232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:37.742077155 +0000 UTC m=+675.513168427" watchObservedRunningTime="2026-09-09 16:19:37.744354232 +0000 UTC m=+675.515445479"
Sep 09 16:19:37.931246 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:37.931218    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:37.935862 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:37.935807    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:38.126903 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.126870    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q985j\" (UniqueName: \"kubernetes.io/projected/85b756b9-7853-4f48-bb3b-586801e5b806-kube-api-access-q985j\") pod \"85b756b9-7853-4f48-bb3b-586801e5b806\" (UID: \"85b756b9-7853-4f48-bb3b-586801e5b806\") "
Sep 09 16:19:38.127072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.126942    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85b756b9-7853-4f48-bb3b-586801e5b806-extensions-socket-volume\") pod \"85b756b9-7853-4f48-bb3b-586801e5b806\" (UID: \"85b756b9-7853-4f48-bb3b-586801e5b806\") "
Sep 09 16:19:38.127253 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.127228    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b756b9-7853-4f48-bb3b-586801e5b806-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "85b756b9-7853-4f48-bb3b-586801e5b806" (UID: "85b756b9-7853-4f48-bb3b-586801e5b806"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:38.128988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.128967    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b756b9-7853-4f48-bb3b-586801e5b806-kube-api-access-q985j" (OuterVolumeSpecName: "kube-api-access-q985j") pod "85b756b9-7853-4f48-bb3b-586801e5b806" (UID: "85b756b9-7853-4f48-bb3b-586801e5b806"). InnerVolumeSpecName "kube-api-access-q985j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:38.228661 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.228570    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q985j\" (UniqueName: \"kubernetes.io/projected/85b756b9-7853-4f48-bb3b-586801e5b806-kube-api-access-q985j\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:38.228661 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.228607    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85b756b9-7853-4f48-bb3b-586801e5b806-extensions-socket-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:38.698943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.698906    2567 generic.go:356] "Generic (PLEG): container finished" podID="85b756b9-7853-4f48-bb3b-586801e5b806" containerID="f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae" exitCode=0
Sep 09 16:19:38.699393 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.698956    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:38.699393 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.699022    2567 scope.go:117] "RemoveContainer" containerID="f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae"
Sep 09 16:19:38.701372 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:38.701343    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:38.708664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.708642    2567 scope.go:117] "RemoveContainer" containerID="f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae"
Sep 09 16:19:38.708986 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:38.708968    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae\": container with ID starting with f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae not found: ID does not exist" containerID="f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae"
Sep 09 16:19:38.709050 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.708995    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae"} err="failed to get container status \"f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae\": rpc error: code = NotFound desc = could not find container \"f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae\": container with ID starting with f19cd20b6fd290895c9110d73305147618e2fdc65f98a00dab98aa66ba78c9ae not found: ID does not exist"
Sep 09 16:19:38.709223 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:38.709204    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-k74mk\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-k74mk"
Sep 09 16:19:38.738173 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:38.738144    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b756b9-7853-4f48-bb3b-586801e5b806" path="/var/lib/kubelet/pods/85b756b9-7853-4f48-bb3b-586801e5b806/volumes"
Sep 09 16:19:39.410181 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:39.410128    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:41.690670 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:41.690632    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:41.817610 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:41.817577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:45.272324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:45.272286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:45.372484 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:45.372446    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:45.663416 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:45.663373    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:45.730275 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:45.730244    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:45.945194 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:45.945110    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:46.045027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:46.044997    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:48.701694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:48.701651    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:48.702111 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:48.701824    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:19:48.702111 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:48.701865    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvjqz"
Sep 09 16:19:48.788716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:48.788678    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"]
Sep 09 16:19:48.788996 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:48.788926    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh" podUID="e6e9d21f-0cc8-4aca-846b-d2ecbfe23721" containerName="manager" containerID="cri-o://de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6" gracePeriod=10
Sep 09 16:19:49.019406 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.019373    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"]
Sep 09 16:19:49.023038 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.023020    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:49.039215 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.039183    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"]
Sep 09 16:19:49.057751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.057720    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:49.116687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.116660    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-extensions-socket-volume\") pod \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\" (UID: \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\") "
Sep 09 16:19:49.116894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.116710    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vd9q\" (UniqueName: \"kubernetes.io/projected/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-kube-api-access-5vd9q\") pod \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\" (UID: \"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721\") "
Sep 09 16:19:49.116894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.116867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3585f1-7ccc-44ac-8482-ac153dec97f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-hp7n9\" (UID: \"de3585f1-7ccc-44ac-8482-ac153dec97f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:49.116894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.116888    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467l2\" (UniqueName: \"kubernetes.io/projected/de3585f1-7ccc-44ac-8482-ac153dec97f3-kube-api-access-467l2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-hp7n9\" (UID: \"de3585f1-7ccc-44ac-8482-ac153dec97f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:49.117130 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.117106    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e6e9d21f-0cc8-4aca-846b-d2ecbfe23721" (UID: "e6e9d21f-0cc8-4aca-846b-d2ecbfe23721"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:19:49.118802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.118739    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-kube-api-access-5vd9q" (OuterVolumeSpecName: "kube-api-access-5vd9q") pod "e6e9d21f-0cc8-4aca-846b-d2ecbfe23721" (UID: "e6e9d21f-0cc8-4aca-846b-d2ecbfe23721"). InnerVolumeSpecName "kube-api-access-5vd9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:49.217889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.217803    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3585f1-7ccc-44ac-8482-ac153dec97f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-hp7n9\" (UID: \"de3585f1-7ccc-44ac-8482-ac153dec97f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:49.217889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.217846    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467l2\" (UniqueName: \"kubernetes.io/projected/de3585f1-7ccc-44ac-8482-ac153dec97f3-kube-api-access-467l2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-hp7n9\" (UID: \"de3585f1-7ccc-44ac-8482-ac153dec97f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:49.218074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.217938    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-extensions-socket-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:49.218074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.217948    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vd9q\" (UniqueName: \"kubernetes.io/projected/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721-kube-api-access-5vd9q\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:49.218168 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.218145    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3585f1-7ccc-44ac-8482-ac153dec97f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-hp7n9\" (UID: \"de3585f1-7ccc-44ac-8482-ac153dec97f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:49.237413 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.237376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-467l2\" (UniqueName: \"kubernetes.io/projected/de3585f1-7ccc-44ac-8482-ac153dec97f3-kube-api-access-467l2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-hp7n9\" (UID: \"de3585f1-7ccc-44ac-8482-ac153dec97f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:49.352701 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.352656    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:49.635632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.635601    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"]
Sep 09 16:19:49.636843 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:19:49.636821    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3585f1_7ccc_44ac_8482_ac153dec97f3.slice/crio-548397a142e0140a34c6d87344d0ad7db275223b0d6fc5d0d5c5e1523820908c WatchSource:0}: Error finding container 548397a142e0140a34c6d87344d0ad7db275223b0d6fc5d0d5c5e1523820908c: Status 404 returned error can't find the container with id 548397a142e0140a34c6d87344d0ad7db275223b0d6fc5d0d5c5e1523820908c
Sep 09 16:19:49.667427 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.667393    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-686f6788fb-v24qm" podUID="a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" containerName="console" containerID="cri-o://9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6" gracePeriod=15
Sep 09 16:19:49.770535 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.770411    2567 generic.go:356] "Generic (PLEG): container finished" podID="e6e9d21f-0cc8-4aca-846b-d2ecbfe23721" containerID="de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6" exitCode=0
Sep 09 16:19:49.770535 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.770471    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"
Sep 09 16:19:49.770535 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.770522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh" event={"ID":"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721","Type":"ContainerDied","Data":"de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6"}
Sep 09 16:19:49.771050 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.770569    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh" event={"ID":"e6e9d21f-0cc8-4aca-846b-d2ecbfe23721","Type":"ContainerDied","Data":"cdbd572448ac6b6aee943118e977b4b073b19a7ecd8a638d191c3476c38b6a01"}
Sep 09 16:19:49.771050 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.770599    2567 scope.go:117] "RemoveContainer" containerID="de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6"
Sep 09 16:19:49.773434 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.773399    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9" event={"ID":"de3585f1-7ccc-44ac-8482-ac153dec97f3","Type":"ContainerStarted","Data":"548397a142e0140a34c6d87344d0ad7db275223b0d6fc5d0d5c5e1523820908c"}
Sep 09 16:19:49.781723 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.781697    2567 scope.go:117] "RemoveContainer" containerID="de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6"
Sep 09 16:19:49.782128 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:49.782099    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6\": container with ID starting with de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6 not found: ID does not exist" containerID="de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6"
Sep 09 16:19:49.782223 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.782140    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6"} err="failed to get container status \"de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6\": rpc error: code = NotFound desc = could not find container \"de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6\": container with ID starting with de689c5824856404ba382e1c8c35c18be0da54e50b32a39e6f9dacc1d06605d6 not found: ID does not exist"
Sep 09 16:19:49.810986 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.810955    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"]
Sep 09 16:19:49.832515 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.832485    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sv9nh"]
Sep 09 16:19:49.924551 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:49.924523    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:19:50.026014 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.025975    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-trusted-ca-bundle\") pod \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") "
Sep 09 16:19:50.026188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026029    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxznn\" (UniqueName: \"kubernetes.io/projected/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-kube-api-access-gxznn\") pod \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") "
Sep 09 16:19:50.026188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026068    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-config\") pod \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") "
Sep 09 16:19:50.026270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026253    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-oauth-serving-cert\") pod \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") "
Sep 09 16:19:50.026359 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026342    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-serving-cert\") pod \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") "
Sep 09 16:19:50.026405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026367    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" (UID: "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:19:50.026405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026380    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-oauth-config\") pod \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") "
Sep 09 16:19:50.026507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026414    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-service-ca\") pod \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\" (UID: \"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d\") "
Sep 09 16:19:50.026507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026432    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-config" (OuterVolumeSpecName: "console-config") pod "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" (UID: "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:19:50.026617 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026601    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" (UID: "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:19:50.026719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026699    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-trusted-ca-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:50.026794 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026726    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:50.026794 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026741    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-oauth-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:50.026874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.026803    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" (UID: "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:19:50.028297 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.028277    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-kube-api-access-gxznn" (OuterVolumeSpecName: "kube-api-access-gxznn") pod "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" (UID: "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d"). InnerVolumeSpecName "kube-api-access-gxznn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:19:50.028842 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.028820    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" (UID: "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:19:50.028905 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.028839    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" (UID: "a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:19:50.127209 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.127165    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxznn\" (UniqueName: \"kubernetes.io/projected/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-kube-api-access-gxznn\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:50.127209 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.127201    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:50.127209 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.127211    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-console-oauth-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:50.127209 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.127220    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:19:50.738417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.738378    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6e9d21f-0cc8-4aca-846b-d2ecbfe23721" path="/var/lib/kubelet/pods/e6e9d21f-0cc8-4aca-846b-d2ecbfe23721/volumes"
Sep 09 16:19:50.781358 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.781321    2567 generic.go:356] "Generic (PLEG): container finished" podID="a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" containerID="9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6" exitCode=0
Sep 09 16:19:50.781358 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.781360    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f6788fb-v24qm"
Sep 09 16:19:50.781847 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.781409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f6788fb-v24qm" event={"ID":"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d","Type":"ContainerDied","Data":"9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6"}
Sep 09 16:19:50.781847 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.781466    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f6788fb-v24qm" event={"ID":"a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d","Type":"ContainerDied","Data":"c45e006071ea93730a5e280cf6eeea59d031350d1e88efb7c99c184d93376881"}
Sep 09 16:19:50.781847 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.781501    2567 scope.go:117] "RemoveContainer" containerID="9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6"
Sep 09 16:19:50.784818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.784789    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9" event={"ID":"de3585f1-7ccc-44ac-8482-ac153dec97f3","Type":"ContainerStarted","Data":"ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473"}
Sep 09 16:19:50.784950 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.784913    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:19:50.791231 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.791213    2567 scope.go:117] "RemoveContainer" containerID="9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6"
Sep 09 16:19:50.791505 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:19:50.791485    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6\": container with ID starting with 9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6 not found: ID does not exist" containerID="9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6"
Sep 09 16:19:50.791554 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.791513    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6"} err="failed to get container status \"9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6\": rpc error: code = NotFound desc = could not find container \"9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6\": container with ID starting with 9ad5ac5d767e3766ca0ac8b2ab28a89bfef3a3681fe765390545269dde249fa6 not found: ID does not exist"
Sep 09 16:19:50.799846 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.799764    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686f6788fb-v24qm"]
Sep 09 16:19:50.803802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.803781    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-686f6788fb-v24qm"]
Sep 09 16:19:50.820001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:50.819955    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9" podStartSLOduration=2.819939121 podStartE2EDuration="2.819939121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:50.819393867 +0000 UTC m=+688.590485136" watchObservedRunningTime="2026-09-09 16:19:50.819939121 +0000 UTC m=+688.591030367"
Sep 09 16:19:52.738179 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:52.738145    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" path="/var/lib/kubelet/pods/a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d/volumes"
Sep 09 16:19:54.697883 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:54.697837    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:54.794056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:54.794023    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:57.110053 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:57.110018    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:57.209283 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:19:57.209250    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:01.794545 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:01.794512    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:20:01.845605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:01.845568    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"]
Sep 09 16:20:01.845836 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:01.845807    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w" podUID="c9116eef-311a-4861-8a64-91f1cc199711" containerName="manager" containerID="cri-o://413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5" gracePeriod=10
Sep 09 16:20:02.100688 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.100660    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:20:02.137280 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.137244    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9116eef-311a-4861-8a64-91f1cc199711-extensions-socket-volume\") pod \"c9116eef-311a-4861-8a64-91f1cc199711\" (UID: \"c9116eef-311a-4861-8a64-91f1cc199711\") "
Sep 09 16:20:02.137572 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.137292    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fnn5\" (UniqueName: \"kubernetes.io/projected/c9116eef-311a-4861-8a64-91f1cc199711-kube-api-access-6fnn5\") pod \"c9116eef-311a-4861-8a64-91f1cc199711\" (UID: \"c9116eef-311a-4861-8a64-91f1cc199711\") "
Sep 09 16:20:02.137788 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.137726    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9116eef-311a-4861-8a64-91f1cc199711-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c9116eef-311a-4861-8a64-91f1cc199711" (UID: "c9116eef-311a-4861-8a64-91f1cc199711"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:20:02.139519 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.139492    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9116eef-311a-4861-8a64-91f1cc199711-kube-api-access-6fnn5" (OuterVolumeSpecName: "kube-api-access-6fnn5") pod "c9116eef-311a-4861-8a64-91f1cc199711" (UID: "c9116eef-311a-4861-8a64-91f1cc199711"). InnerVolumeSpecName "kube-api-access-6fnn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:20:02.237957 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.237916    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fnn5\" (UniqueName: \"kubernetes.io/projected/c9116eef-311a-4861-8a64-91f1cc199711-kube-api-access-6fnn5\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:20:02.237957 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.237949    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9116eef-311a-4861-8a64-91f1cc199711-extensions-socket-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:20:02.875074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.875036    2567 generic.go:356] "Generic (PLEG): container finished" podID="c9116eef-311a-4861-8a64-91f1cc199711" containerID="413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5" exitCode=0
Sep 09 16:20:02.875545 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.875083    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"
Sep 09 16:20:02.875545 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.875095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w" event={"ID":"c9116eef-311a-4861-8a64-91f1cc199711","Type":"ContainerDied","Data":"413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5"}
Sep 09 16:20:02.875545 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.875157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w" event={"ID":"c9116eef-311a-4861-8a64-91f1cc199711","Type":"ContainerDied","Data":"6760de6ac38d133a3ad509543fc7833d0b26496a58c77839a0bef6361b17a0ef"}
Sep 09 16:20:02.875545 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.875192    2567 scope.go:117] "RemoveContainer" containerID="413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5"
Sep 09 16:20:02.885169 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.885148    2567 scope.go:117] "RemoveContainer" containerID="413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5"
Sep 09 16:20:02.885470 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:20:02.885450    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5\": container with ID starting with 413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5 not found: ID does not exist" containerID="413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5"
Sep 09 16:20:02.885536 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.885479    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5"} err="failed to get container status \"413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5\": rpc error: code = NotFound desc = could not find container \"413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5\": container with ID starting with 413af9cd786538e76b9ecf6cebb87c2775867b88e9a8418861754ef3e0db6de5 not found: ID does not exist"
Sep 09 16:20:02.897529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.897490    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"]
Sep 09 16:20:02.904580 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:02.904543    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vk28w"]
Sep 09 16:20:04.737573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:04.737534    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9116eef-311a-4861-8a64-91f1cc199711" path="/var/lib/kubelet/pods/c9116eef-311a-4861-8a64-91f1cc199711/volumes"
Sep 09 16:20:05.333481 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.333449    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"]
Sep 09 16:20:05.333991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.333970    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6e9d21f-0cc8-4aca-846b-d2ecbfe23721" containerName="manager"
Sep 09 16:20:05.334052 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.333996    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6e9d21f-0cc8-4aca-846b-d2ecbfe23721" containerName="manager"
Sep 09 16:20:05.334052 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.334020    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" containerName="console"
Sep 09 16:20:05.334052 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.334026    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" containerName="console"
Sep 09 16:20:05.334052 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.334037    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9116eef-311a-4861-8a64-91f1cc199711" containerName="manager"
Sep 09 16:20:05.334052 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.334044    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9116eef-311a-4861-8a64-91f1cc199711" containerName="manager"
Sep 09 16:20:05.334207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.334121    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9116eef-311a-4861-8a64-91f1cc199711" containerName="manager"
Sep 09 16:20:05.334207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.334128    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e9d21f-0cc8-4aca-846b-d2ecbfe23721" containerName="manager"
Sep 09 16:20:05.334207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.334135    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a436f9ca-c6f1-4c44-bde6-f3f5b97cef0d" containerName="console"
Sep 09 16:20:05.337329 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.337311    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.340370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.340347    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sqvs5\""
Sep 09 16:20:05.340597 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.340348    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 16:20:05.342589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.342561    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"]
Sep 09 16:20:05.353067 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.353039    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:05.467734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.467689    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.467917 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.467737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.467917 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.467782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.467917 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.467840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.467917 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.467898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpcnv\" (UniqueName: \"kubernetes.io/projected/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-kube-api-access-bpcnv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.468062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.467926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.468062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.467985    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.468062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.468053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.468159 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.468125    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.483640 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.483605    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:05.568738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.568700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpcnv\" (UniqueName: \"kubernetes.io/projected/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-kube-api-access-bpcnv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.568738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.568741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.568886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.568942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569034    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569058    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569503 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569503 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569711 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569563    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569711 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569602    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.569855 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.569833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.571281 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.571263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.571390 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.571281    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.576591 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.576568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.576685 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.576636    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpcnv\" (UniqueName: \"kubernetes.io/projected/b65f6b94-6fb5-4e6c-963b-8aea377ea05e-kube-api-access-bpcnv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wlrgd\" (UID: \"b65f6b94-6fb5-4e6c-963b-8aea377ea05e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.652997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.652964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:05.929655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:05.929625    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"]
Sep 09 16:20:05.930931 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:20:05.930910    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65f6b94_6fb5_4e6c_963b_8aea377ea05e.slice/crio-9bfe121165a0fcb314e4527f75c22be1dd34061c59c4dc6135be704583273610 WatchSource:0}: Error finding container 9bfe121165a0fcb314e4527f75c22be1dd34061c59c4dc6135be704583273610: Status 404 returned error can't find the container with id 9bfe121165a0fcb314e4527f75c22be1dd34061c59c4dc6135be704583273610
Sep 09 16:20:06.901477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:06.901442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" event={"ID":"b65f6b94-6fb5-4e6c-963b-8aea377ea05e","Type":"ContainerStarted","Data":"9bfe121165a0fcb314e4527f75c22be1dd34061c59c4dc6135be704583273610"}
Sep 09 16:20:09.093675 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:09.093641    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:20:09.093952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:09.093727    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:20:09.093952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:09.093757    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:20:09.923709 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:09.923669    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" event={"ID":"b65f6b94-6fb5-4e6c-963b-8aea377ea05e","Type":"ContainerStarted","Data":"bada3d5db27c212a8f5b5d7ea90a9a4eb7c80bc1c2d012a90f5d4407f61eb883"}
Sep 09 16:20:09.947816 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:09.945076    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" podStartSLOduration=1.785064455 podStartE2EDuration="4.945053793s" totalImagesPullingTime="3.159989338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:20:09.942198419 +0000 UTC m=+707.713289666" watchObservedRunningTime="2026-09-09 16:20:09.945053793 +0000 UTC m=+707.716145041"
Sep 09 16:20:10.653370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:10.653330    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:10.658045 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:10.658016    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:10.930881 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:10.930793    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:10.931853 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:10.931833    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:20:21.725195 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.725143    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8fp2c"]
Sep 09 16:20:21.729015 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.728992    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:21.731533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.731510    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 16:20:21.731648 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.731536    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bz25f\""
Sep 09 16:20:21.737864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.737839    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8fp2c"]
Sep 09 16:20:21.739055 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.739026    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:21.819901 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.819849    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdb8v\" (UniqueName: \"kubernetes.io/projected/5cfeec0c-4965-44b2-8269-9d7490dc6ece-kube-api-access-vdb8v\") pod \"limitador-limitador-8588749977-8fp2c\" (UID: \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\") " pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:21.819901 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.819900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5cfeec0c-4965-44b2-8269-9d7490dc6ece-config-file\") pod \"limitador-limitador-8588749977-8fp2c\" (UID: \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\") " pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:21.822528 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.822492    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8fp2c"]
Sep 09 16:20:21.829499 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.829475    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:21.892503 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.892466    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:21.921108 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.921069    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdb8v\" (UniqueName: \"kubernetes.io/projected/5cfeec0c-4965-44b2-8269-9d7490dc6ece-kube-api-access-vdb8v\") pod \"limitador-limitador-8588749977-8fp2c\" (UID: \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\") " pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:21.921108 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.921107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5cfeec0c-4965-44b2-8269-9d7490dc6ece-config-file\") pod \"limitador-limitador-8588749977-8fp2c\" (UID: \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\") " pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:21.921914 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.921864    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5cfeec0c-4965-44b2-8269-9d7490dc6ece-config-file\") pod \"limitador-limitador-8588749977-8fp2c\" (UID: \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\") " pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:21.929655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:21.929629    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdb8v\" (UniqueName: \"kubernetes.io/projected/5cfeec0c-4965-44b2-8269-9d7490dc6ece-kube-api-access-vdb8v\") pod \"limitador-limitador-8588749977-8fp2c\" (UID: \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\") " pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:22.041411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:22.041326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:22.317297 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:22.317266    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8fp2c"]
Sep 09 16:20:22.318431 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:20:22.318403    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfeec0c_4965_44b2_8269_9d7490dc6ece.slice/crio-a05a1f0a499907d5fbbf183136e27cc45f2bbf9cc96ba7085e78258c0f6def20 WatchSource:0}: Error finding container a05a1f0a499907d5fbbf183136e27cc45f2bbf9cc96ba7085e78258c0f6def20: Status 404 returned error can't find the container with id a05a1f0a499907d5fbbf183136e27cc45f2bbf9cc96ba7085e78258c0f6def20
Sep 09 16:20:22.653417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:22.653379    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:22.753691 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:22.753662    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:23.009285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:23.009199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c" event={"ID":"5cfeec0c-4965-44b2-8269-9d7490dc6ece","Type":"ContainerStarted","Data":"a05a1f0a499907d5fbbf183136e27cc45f2bbf9cc96ba7085e78258c0f6def20"}
Sep 09 16:20:24.017299 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:24.017207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c" event={"ID":"5cfeec0c-4965-44b2-8269-9d7490dc6ece","Type":"ContainerStarted","Data":"6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b"}
Sep 09 16:20:24.017651 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:24.017361    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:24.035698 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:24.035641    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c" podStartSLOduration=1.673166522 podStartE2EDuration="3.035626576s" totalImagesPullingTime="1.362460054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:20:24.03398205 +0000 UTC m=+721.805073296" watchObservedRunningTime="2026-09-09 16:20:24.035626576 +0000 UTC m=+721.806717822"
Sep 09 16:20:35.024761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:35.024726    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:36.702968 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:36.702932    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8fp2c"]
Sep 09 16:20:36.703406 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:36.703116    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c" podUID="5cfeec0c-4965-44b2-8269-9d7490dc6ece" containerName="limitador" containerID="cri-o://6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b" gracePeriod=30
Sep 09 16:20:37.267206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:37.267178    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:37.361376 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:37.361289    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5cfeec0c-4965-44b2-8269-9d7490dc6ece-config-file\") pod \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\" (UID: \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\") "
Sep 09 16:20:37.361376 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:37.361360    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdb8v\" (UniqueName: \"kubernetes.io/projected/5cfeec0c-4965-44b2-8269-9d7490dc6ece-kube-api-access-vdb8v\") pod \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\" (UID: \"5cfeec0c-4965-44b2-8269-9d7490dc6ece\") "
Sep 09 16:20:37.361688 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:37.361664    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cfeec0c-4965-44b2-8269-9d7490dc6ece-config-file" (OuterVolumeSpecName: "config-file") pod "5cfeec0c-4965-44b2-8269-9d7490dc6ece" (UID: "5cfeec0c-4965-44b2-8269-9d7490dc6ece"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:37.363384 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:37.363358    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cfeec0c-4965-44b2-8269-9d7490dc6ece-kube-api-access-vdb8v" (OuterVolumeSpecName: "kube-api-access-vdb8v") pod "5cfeec0c-4965-44b2-8269-9d7490dc6ece" (UID: "5cfeec0c-4965-44b2-8269-9d7490dc6ece"). InnerVolumeSpecName "kube-api-access-vdb8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:20:37.462645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:37.462611    2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5cfeec0c-4965-44b2-8269-9d7490dc6ece-config-file\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:20:37.462645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:37.462639    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdb8v\" (UniqueName: \"kubernetes.io/projected/5cfeec0c-4965-44b2-8269-9d7490dc6ece-kube-api-access-vdb8v\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:20:38.101406 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.101370    2567 generic.go:356] "Generic (PLEG): container finished" podID="5cfeec0c-4965-44b2-8269-9d7490dc6ece" containerID="6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b" exitCode=0
Sep 09 16:20:38.101880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.101412    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c"
Sep 09 16:20:38.101880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.101461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c" event={"ID":"5cfeec0c-4965-44b2-8269-9d7490dc6ece","Type":"ContainerDied","Data":"6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b"}
Sep 09 16:20:38.101880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.101513    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-8fp2c" event={"ID":"5cfeec0c-4965-44b2-8269-9d7490dc6ece","Type":"ContainerDied","Data":"a05a1f0a499907d5fbbf183136e27cc45f2bbf9cc96ba7085e78258c0f6def20"}
Sep 09 16:20:38.101880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.101540    2567 scope.go:117] "RemoveContainer" containerID="6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b"
Sep 09 16:20:38.111367 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.111344    2567 scope.go:117] "RemoveContainer" containerID="6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b"
Sep 09 16:20:38.111621 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:20:38.111602    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b\": container with ID starting with 6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b not found: ID does not exist" containerID="6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b"
Sep 09 16:20:38.111690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.111628    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b"} err="failed to get container status \"6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b\": rpc error: code = NotFound desc = could not find container \"6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b\": container with ID starting with 6edf4b83ed96b84b4fe6181bfa69ec5c0d3843b98cb2c975b18f143c4f9f192b not found: ID does not exist"
Sep 09 16:20:38.124096 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.124071    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8fp2c"]
Sep 09 16:20:38.128306 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.128285    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-8fp2c"]
Sep 09 16:20:38.737973 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:38.737943    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cfeec0c-4965-44b2-8269-9d7490dc6ece" path="/var/lib/kubelet/pods/5cfeec0c-4965-44b2-8269-9d7490dc6ece/volumes"
Sep 09 16:20:42.599142 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:42.599108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:42.756733 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:42.756698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:43.085405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.085372    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"]
Sep 09 16:20:43.085841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.085826    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cfeec0c-4965-44b2-8269-9d7490dc6ece" containerName="limitador"
Sep 09 16:20:43.085893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.085842    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cfeec0c-4965-44b2-8269-9d7490dc6ece" containerName="limitador"
Sep 09 16:20:43.085946 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.085936    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cfeec0c-4965-44b2-8269-9d7490dc6ece" containerName="limitador"
Sep 09 16:20:43.094736 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.094710    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:43.097395 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.097366    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 16:20:43.097635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.097366    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 16:20:43.097738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.097646    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"]
Sep 09 16:20:43.098295 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.098263    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-22nsv\""
Sep 09 16:20:43.098467 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.098304    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 16:20:43.110682 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.110657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2e27758-fa57-4523-bf01-b09a9f08e700-data\") pod \"postgres-69fb4594cf-kcvwg\" (UID: \"a2e27758-fa57-4523-bf01-b09a9f08e700\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:43.110833 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.110808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgscl\" (UniqueName: \"kubernetes.io/projected/a2e27758-fa57-4523-bf01-b09a9f08e700-kube-api-access-dgscl\") pod \"postgres-69fb4594cf-kcvwg\" (UID: \"a2e27758-fa57-4523-bf01-b09a9f08e700\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:43.117757 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.117509    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:43.211967 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.211939    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2e27758-fa57-4523-bf01-b09a9f08e700-data\") pod \"postgres-69fb4594cf-kcvwg\" (UID: \"a2e27758-fa57-4523-bf01-b09a9f08e700\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:43.212142 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.211991    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgscl\" (UniqueName: \"kubernetes.io/projected/a2e27758-fa57-4523-bf01-b09a9f08e700-kube-api-access-dgscl\") pod \"postgres-69fb4594cf-kcvwg\" (UID: \"a2e27758-fa57-4523-bf01-b09a9f08e700\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:43.212294 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.212274    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2e27758-fa57-4523-bf01-b09a9f08e700-data\") pod \"postgres-69fb4594cf-kcvwg\" (UID: \"a2e27758-fa57-4523-bf01-b09a9f08e700\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:43.220285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.220262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgscl\" (UniqueName: \"kubernetes.io/projected/a2e27758-fa57-4523-bf01-b09a9f08e700-kube-api-access-dgscl\") pod \"postgres-69fb4594cf-kcvwg\" (UID: \"a2e27758-fa57-4523-bf01-b09a9f08e700\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:43.409025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.408995    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:43.681174 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:43.681145    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"]
Sep 09 16:20:43.682686 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:20:43.682660    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e27758_fa57_4523_bf01_b09a9f08e700.slice/crio-ab29a527f9fc9f301fc609aceea0975d05dd7bf5cac2be875daa54f43b0f25c9 WatchSource:0}: Error finding container ab29a527f9fc9f301fc609aceea0975d05dd7bf5cac2be875daa54f43b0f25c9: Status 404 returned error can't find the container with id ab29a527f9fc9f301fc609aceea0975d05dd7bf5cac2be875daa54f43b0f25c9
Sep 09 16:20:44.139541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:44.139511    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg" event={"ID":"a2e27758-fa57-4523-bf01-b09a9f08e700","Type":"ContainerStarted","Data":"ab29a527f9fc9f301fc609aceea0975d05dd7bf5cac2be875daa54f43b0f25c9"}
Sep 09 16:20:52.196477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:52.196440    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg" event={"ID":"a2e27758-fa57-4523-bf01-b09a9f08e700","Type":"ContainerStarted","Data":"279d2e647c6d5a845c9b36aafbb17d8d9ce759a5d10ddd7feb9c7edee59fee24"}
Sep 09 16:20:52.196884 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:52.196652    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:52.214440 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:52.214393    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg" podStartSLOduration=1.131130516 podStartE2EDuration="9.214380298s" totalImagesPullingTime="8.083249782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:20:52.213341854 +0000 UTC m=+749.984433114" watchObservedRunningTime="2026-09-09 16:20:52.214380298 +0000 UTC m=+749.985471543"
Sep 09 16:20:58.231643 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:58.231613    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kcvwg"
Sep 09 16:20:58.575387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:58.575298    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:58.703877 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:58.703844    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:58.934607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:58.934572    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:58.999388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:20:58.999338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:06.041496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.041453    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:06.075562 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.075526    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-6224s"]
Sep 09 16:21:06.079337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.079313    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.081673 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.081653    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 16:21:06.081893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.081661    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 16:21:06.081893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.081662    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kxvzz\""
Sep 09 16:21:06.082553 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.082535    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 16:21:06.088172 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.088146    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-6224s"]
Sep 09 16:21:06.141977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.141947    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:06.231050 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.231017    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-webhook-cert\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.231050 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.231052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x75pn\" (UniqueName: \"kubernetes.io/projected/59b68b59-da9c-43b7-b9a4-e73db2b71074-kube-api-access-x75pn\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.231269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.231093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.246285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.246256    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:06.258481 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.258440    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-574cc95cb9-8pv2b"]
Sep 09 16:21:06.262306 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.262284    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.272567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.272537    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-8pv2b"]
Sep 09 16:21:06.332296 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.332190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.332484 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.332321    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-webhook-cert\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.332484 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.332353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x75pn\" (UniqueName: \"kubernetes.io/projected/59b68b59-da9c-43b7-b9a4-e73db2b71074-kube-api-access-x75pn\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.332484 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:21:06.332360    2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 16:21:06.332484 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:21:06.332426    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs podName:59b68b59-da9c-43b7-b9a4-e73db2b71074 nodeName:}" failed. No retries permitted until 2026-09-09 16:21:06.832409035 +0000 UTC m=+764.603500272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs") pod "maas-controller-7bbdd8d44-6224s" (UID: "59b68b59-da9c-43b7-b9a4-e73db2b71074") : secret "maas-controller-metrics-tls" not found
Sep 09 16:21:06.334855 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.334825    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-webhook-cert\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.340688 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.340649    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x75pn\" (UniqueName: \"kubernetes.io/projected/59b68b59-da9c-43b7-b9a4-e73db2b71074-kube-api-access-x75pn\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.341272 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.341247    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:06.433166 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.433115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.433359 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.433187    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-webhook-cert\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.433359 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.433235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn8sg\" (UniqueName: \"kubernetes.io/projected/4ec378a0-5f63-4491-8a6f-c3077485b6b2-kube-api-access-fn8sg\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.534087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.534040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8sg\" (UniqueName: \"kubernetes.io/projected/4ec378a0-5f63-4491-8a6f-c3077485b6b2-kube-api-access-fn8sg\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.534263 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.534136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.534263 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.534197    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-webhook-cert\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.534337 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:21:06.534277    2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 16:21:06.534377 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:21:06.534339    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs podName:4ec378a0-5f63-4491-8a6f-c3077485b6b2 nodeName:}" failed. No retries permitted until 2026-09-09 16:21:07.034324879 +0000 UTC m=+764.805416108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs") pod "maas-controller-574cc95cb9-8pv2b" (UID: "4ec378a0-5f63-4491-8a6f-c3077485b6b2") : secret "maas-controller-metrics-tls" not found
Sep 09 16:21:06.536767 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.536748    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-webhook-cert\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.542601 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.542571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn8sg\" (UniqueName: \"kubernetes.io/projected/4ec378a0-5f63-4491-8a6f-c3077485b6b2-kube-api-access-fn8sg\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:06.593002 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.592926    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:06.836981 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.836941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.839359 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.839330    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs\") pod \"maas-controller-7bbdd8d44-6224s\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") " pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:06.992463 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:06.992423    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:07.039100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:07.039051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:07.042075 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:07.042048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs\") pod \"maas-controller-574cc95cb9-8pv2b\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") " pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:07.175993 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:07.175961    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:07.264639 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:21:07.264605    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b68b59_da9c_43b7_b9a4_e73db2b71074.slice/crio-dbb1c3635fe5ff8c1f560fc09b5fc3faea839dc2e0d582debc62bc90f339d055 WatchSource:0}: Error finding container dbb1c3635fe5ff8c1f560fc09b5fc3faea839dc2e0d582debc62bc90f339d055: Status 404 returned error can't find the container with id dbb1c3635fe5ff8c1f560fc09b5fc3faea839dc2e0d582debc62bc90f339d055
Sep 09 16:21:07.264785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:07.264697    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-6224s"]
Sep 09 16:21:07.295951 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:07.295919    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdd8d44-6224s" event={"ID":"59b68b59-da9c-43b7-b9a4-e73db2b71074","Type":"ContainerStarted","Data":"dbb1c3635fe5ff8c1f560fc09b5fc3faea839dc2e0d582debc62bc90f339d055"}
Sep 09 16:21:07.446949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:07.446917    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-8pv2b"]
Sep 09 16:21:07.448300 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:21:07.448274    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec378a0_5f63_4491_8a6f_c3077485b6b2.slice/crio-421528c2417929cc73fc7cb4d8323ed217fd04e22e5d9c695a22d8d74d7ba24a WatchSource:0}: Error finding container 421528c2417929cc73fc7cb4d8323ed217fd04e22e5d9c695a22d8d74d7ba24a: Status 404 returned error can't find the container with id 421528c2417929cc73fc7cb4d8323ed217fd04e22e5d9c695a22d8d74d7ba24a
Sep 09 16:21:08.303492 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:08.303458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-8pv2b" event={"ID":"4ec378a0-5f63-4491-8a6f-c3077485b6b2","Type":"ContainerStarted","Data":"421528c2417929cc73fc7cb4d8323ed217fd04e22e5d9c695a22d8d74d7ba24a"}
Sep 09 16:21:09.531665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:09.531497    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:09.627822 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:09.627786    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:10.317007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:10.316963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-8pv2b" event={"ID":"4ec378a0-5f63-4491-8a6f-c3077485b6b2","Type":"ContainerStarted","Data":"10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1"}
Sep 09 16:21:10.317206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:10.317053    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:10.335032 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:10.334972    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-574cc95cb9-8pv2b" podStartSLOduration=2.461445296 podStartE2EDuration="4.334956058s" totalImagesPullingTime="1.873510762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:21:10.333411013 +0000 UTC m=+768.104502260" watchObservedRunningTime="2026-09-09 16:21:10.334956058 +0000 UTC m=+768.106047295"
Sep 09 16:21:11.325519 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:11.325411    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdd8d44-6224s" event={"ID":"59b68b59-da9c-43b7-b9a4-e73db2b71074","Type":"ContainerStarted","Data":"394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc"}
Sep 09 16:21:11.345099 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:11.345034    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bbdd8d44-6224s" podStartSLOduration=1.652122926 podStartE2EDuration="5.345017211s" totalImagesPullingTime="3.692894285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:21:11.343502576 +0000 UTC m=+769.114593836" watchObservedRunningTime="2026-09-09 16:21:11.345017211 +0000 UTC m=+769.116108457"
Sep 09 16:21:12.331156 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:12.331128    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:21.327923 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.327839    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:21:21.373310 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.373276    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-6224s"]
Sep 09 16:21:21.373547 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.373514    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bbdd8d44-6224s" podUID="59b68b59-da9c-43b7-b9a4-e73db2b71074" containerName="manager" containerID="cri-o://394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc" gracePeriod=30
Sep 09 16:21:21.375751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.375720    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:21.627109 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.627083    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:21.682548 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.682510    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs\") pod \"59b68b59-da9c-43b7-b9a4-e73db2b71074\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") "
Sep 09 16:21:21.682712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.682603    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x75pn\" (UniqueName: \"kubernetes.io/projected/59b68b59-da9c-43b7-b9a4-e73db2b71074-kube-api-access-x75pn\") pod \"59b68b59-da9c-43b7-b9a4-e73db2b71074\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") "
Sep 09 16:21:21.682712 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.682636    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-webhook-cert\") pod \"59b68b59-da9c-43b7-b9a4-e73db2b71074\" (UID: \"59b68b59-da9c-43b7-b9a4-e73db2b71074\") "
Sep 09 16:21:21.684793 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.684738    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "59b68b59-da9c-43b7-b9a4-e73db2b71074" (UID: "59b68b59-da9c-43b7-b9a4-e73db2b71074"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:21:21.684900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.684832    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b68b59-da9c-43b7-b9a4-e73db2b71074-kube-api-access-x75pn" (OuterVolumeSpecName: "kube-api-access-x75pn") pod "59b68b59-da9c-43b7-b9a4-e73db2b71074" (UID: "59b68b59-da9c-43b7-b9a4-e73db2b71074"). InnerVolumeSpecName "kube-api-access-x75pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:21:21.684900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.684831    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "59b68b59-da9c-43b7-b9a4-e73db2b71074" (UID: "59b68b59-da9c-43b7-b9a4-e73db2b71074"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:21:21.784062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.784029    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:21:21.784062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.784060    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x75pn\" (UniqueName: \"kubernetes.io/projected/59b68b59-da9c-43b7-b9a4-e73db2b71074-kube-api-access-x75pn\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:21:21.784062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:21.784070    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59b68b59-da9c-43b7-b9a4-e73db2b71074-webhook-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:21:22.395695 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.395663    2567 generic.go:356] "Generic (PLEG): container finished" podID="59b68b59-da9c-43b7-b9a4-e73db2b71074" containerID="394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc" exitCode=0
Sep 09 16:21:22.396167 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.395709    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdd8d44-6224s"
Sep 09 16:21:22.396167 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.395722    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdd8d44-6224s" event={"ID":"59b68b59-da9c-43b7-b9a4-e73db2b71074","Type":"ContainerDied","Data":"394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc"}
Sep 09 16:21:22.396167 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.395766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdd8d44-6224s" event={"ID":"59b68b59-da9c-43b7-b9a4-e73db2b71074","Type":"ContainerDied","Data":"dbb1c3635fe5ff8c1f560fc09b5fc3faea839dc2e0d582debc62bc90f339d055"}
Sep 09 16:21:22.396167 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.395820    2567 scope.go:117] "RemoveContainer" containerID="394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc"
Sep 09 16:21:22.405701 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.405683    2567 scope.go:117] "RemoveContainer" containerID="394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc"
Sep 09 16:21:22.406015 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:21:22.405998    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc\": container with ID starting with 394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc not found: ID does not exist" containerID="394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc"
Sep 09 16:21:22.406074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.406022    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc"} err="failed to get container status \"394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc\": rpc error: code = NotFound desc = could not find container \"394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc\": container with ID starting with 394fcc0ab44c056cafaff8c95110d373755d708a206a156d2a085ede5732b3dc not found: ID does not exist"
Sep 09 16:21:22.417886 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.417850    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-6224s"]
Sep 09 16:21:22.420366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.420341    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bbdd8d44-6224s"]
Sep 09 16:21:22.738809 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:22.738722    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59b68b59-da9c-43b7-b9a4-e73db2b71074" path="/var/lib/kubelet/pods/59b68b59-da9c-43b7-b9a4-e73db2b71074/volumes"
Sep 09 16:21:42.122129 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:42.122096    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:42.224007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:42.223979    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:43.645261 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.645214    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:43.746292 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.746252    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:43.776616 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.776581    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"]
Sep 09 16:21:43.777062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.777046    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b68b59-da9c-43b7-b9a4-e73db2b71074" containerName="manager"
Sep 09 16:21:43.777062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.777061    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b68b59-da9c-43b7-b9a4-e73db2b71074" containerName="manager"
Sep 09 16:21:43.777213 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.777130    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b68b59-da9c-43b7-b9a4-e73db2b71074" containerName="manager"
Sep 09 16:21:43.803866 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.803826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"]
Sep 09 16:21:43.804039 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.803919    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.806422 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.806398    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 16:21:43.807412 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.807383    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mslnv\""
Sep 09 16:21:43.807570 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.807423    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 16:21:43.824197 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.824169    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:43.887480 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.887435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e58aae1b-90e9-4bf0-88c2-beb936e3e723-openshift-service-ca\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.887668 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.887521    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-metrics-certs\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.887668 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.887572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-maas-api-tls\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.887668 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.887646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbdhb\" (UniqueName: \"kubernetes.io/projected/e58aae1b-90e9-4bf0-88c2-beb936e3e723-kube-api-access-hbdhb\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.941134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.941050    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:43.988814 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.988735    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-metrics-certs\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.988985 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.988849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-maas-api-tls\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.988985 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.988915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbdhb\" (UniqueName: \"kubernetes.io/projected/e58aae1b-90e9-4bf0-88c2-beb936e3e723-kube-api-access-hbdhb\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.988985 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.988961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e58aae1b-90e9-4bf0-88c2-beb936e3e723-openshift-service-ca\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.989641 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.989602    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e58aae1b-90e9-4bf0-88c2-beb936e3e723-openshift-service-ca\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.991387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.991360    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-metrics-certs\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:43.991479 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:43.991371    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-maas-api-tls\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:44.000762 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:44.000733    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbdhb\" (UniqueName: \"kubernetes.io/projected/e58aae1b-90e9-4bf0-88c2-beb936e3e723-kube-api-access-hbdhb\") pod \"maas-api-7b7b9ff5c-69dgx\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") " pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:44.115234 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:44.115198    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:44.158499 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:44.158464    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:44.257597 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:44.257483    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:44.398094 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:44.398063    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"]
Sep 09 16:21:44.400205 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:21:44.400140    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58aae1b_90e9_4bf0_88c2_beb936e3e723.slice/crio-037126b5bab991d33eb759675d0c4aa617c350f2625b87ee10e48d653cf13514 WatchSource:0}: Error finding container 037126b5bab991d33eb759675d0c4aa617c350f2625b87ee10e48d653cf13514: Status 404 returned error can't find the container with id 037126b5bab991d33eb759675d0c4aa617c350f2625b87ee10e48d653cf13514
Sep 09 16:21:44.532913 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:44.532826    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx" event={"ID":"e58aae1b-90e9-4bf0-88c2-beb936e3e723","Type":"ContainerStarted","Data":"037126b5bab991d33eb759675d0c4aa617c350f2625b87ee10e48d653cf13514"}
Sep 09 16:21:48.101536 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:48.101496    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:48.589787 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:48.589739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx" event={"ID":"e58aae1b-90e9-4bf0-88c2-beb936e3e723","Type":"ContainerStarted","Data":"93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa"}
Sep 09 16:21:48.589997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:48.589823    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:48.606246 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:48.606195    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx" podStartSLOduration=2.477197315 podStartE2EDuration="5.606179096s" totalImagesPullingTime="3.128981781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:21:48.60493527 +0000 UTC m=+806.376026516" watchObservedRunningTime="2026-09-09 16:21:48.606179096 +0000 UTC m=+806.377270342"
Sep 09 16:21:53.622654 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:53.622618    2567 generic.go:356] "Generic (PLEG): container finished" podID="b65f6b94-6fb5-4e6c-963b-8aea377ea05e" containerID="bada3d5db27c212a8f5b5d7ea90a9a4eb7c80bc1c2d012a90f5d4407f61eb883" exitCode=0
Sep 09 16:21:53.623209 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:53.622695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" event={"ID":"b65f6b94-6fb5-4e6c-963b-8aea377ea05e","Type":"ContainerDied","Data":"bada3d5db27c212a8f5b5d7ea90a9a4eb7c80bc1c2d012a90f5d4407f61eb883"}
Sep 09 16:21:53.623301 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:53.623282    2567 scope.go:117] "RemoveContainer" containerID="bada3d5db27c212a8f5b5d7ea90a9a4eb7c80bc1c2d012a90f5d4407f61eb883"
Sep 09 16:21:53.624391 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:53.624355    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:21:53.624477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:53.624454    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:21:53.624515 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:53.624490    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:21:54.600841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:54.600809    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:21:54.635431 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:54.635391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" event={"ID":"b65f6b94-6fb5-4e6c-963b-8aea377ea05e","Type":"ContainerStarted","Data":"d8ae205661429fe3dc7d2f58d71dcc0d4a0e6a5c7f612f7ccc906fadb566a192"}
Sep 09 16:21:54.653965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:54.653927    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:21:54.655323 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:54.655291    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wlrgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:21:54.655465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:54.655360    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" podUID="b65f6b94-6fb5-4e6c-963b-8aea377ea05e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:21:55.653565 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:55.653520    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wlrgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:21:55.654072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:55.653624    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" podUID="b65f6b94-6fb5-4e6c-963b-8aea377ea05e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:21:55.676613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:55.676555    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:55.778582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:55.778512    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:55.931286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:55.931184    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:21:56.653730 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:56.653687    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wlrgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:21:56.654232 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:56.653854    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" podUID="b65f6b94-6fb5-4e6c-963b-8aea377ea05e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:21:57.653386 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:57.653353    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wlrgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:21:57.654379 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:57.654349    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" podUID="b65f6b94-6fb5-4e6c-963b-8aea377ea05e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:21:58.653789 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:58.653729    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wlrgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:21:58.653970 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:58.653854    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" podUID="b65f6b94-6fb5-4e6c-963b-8aea377ea05e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:21:59.653666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:59.653615    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wlrgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:21:59.654169 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:21:59.653707    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd" podUID="b65f6b94-6fb5-4e6c-963b-8aea377ea05e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:22:00.657312 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:00.657278    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:22:00.658327 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:00.658306    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wlrgd"
Sep 09 16:22:08.916928 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:08.916894    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"]
Sep 09 16:22:08.921040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:08.921017    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:08.923397 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:08.923373    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 16:22:08.924423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:08.924393    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 16:22:08.924551 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:08.924435    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m45r2\""
Sep 09 16:22:08.924551 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:08.924489    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 16:22:08.930847 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:08.930767    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"]
Sep 09 16:22:08.947099 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:08.947071    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:22:09.021069 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.021030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.021069 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.021073    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.021286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.021091    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3954cc43-5910-45bb-baa3-9b15d7889b31-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.021286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.021177    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.021286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.021241    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bnrc\" (UniqueName: \"kubernetes.io/projected/3954cc43-5910-45bb-baa3-9b15d7889b31-kube-api-access-9bnrc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.021286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.021273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.122538 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.122497    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.122734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.122565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bnrc\" (UniqueName: \"kubernetes.io/projected/3954cc43-5910-45bb-baa3-9b15d7889b31-kube-api-access-9bnrc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.122734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.122598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.122734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.122695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.122734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.122721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.123018 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.122746    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3954cc43-5910-45bb-baa3-9b15d7889b31-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.123178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.123120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.123178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.123147    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.123374 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.123218    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.124901 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.124882    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3954cc43-5910-45bb-baa3-9b15d7889b31-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.125269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.125250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3954cc43-5910-45bb-baa3-9b15d7889b31-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.129997 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.129977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bnrc\" (UniqueName: \"kubernetes.io/projected/3954cc43-5910-45bb-baa3-9b15d7889b31-kube-api-access-9bnrc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5\" (UID: \"3954cc43-5910-45bb-baa3-9b15d7889b31\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.233061 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.232968    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:09.508012 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.507979    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"]
Sep 09 16:22:09.509277 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:22:09.509255    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3954cc43_5910_45bb_baa3_9b15d7889b31.slice/crio-aa433a15aa627ddf3c4b8dae808be5afdd347aacd601de27969393a3d6d93d3f WatchSource:0}: Error finding container aa433a15aa627ddf3c4b8dae808be5afdd347aacd601de27969393a3d6d93d3f: Status 404 returned error can't find the container with id aa433a15aa627ddf3c4b8dae808be5afdd347aacd601de27969393a3d6d93d3f
Sep 09 16:22:09.737598 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:09.737554    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5" event={"ID":"3954cc43-5910-45bb-baa3-9b15d7889b31","Type":"ContainerStarted","Data":"aa433a15aa627ddf3c4b8dae808be5afdd347aacd601de27969393a3d6d93d3f"}
Sep 09 16:22:10.745598 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:10.745560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5" event={"ID":"3954cc43-5910-45bb-baa3-9b15d7889b31","Type":"ContainerStarted","Data":"08e7c03c53562d635eecf7c8c497e4c5d48a5dddc48720c08a179049efa57085"}
Sep 09 16:22:10.764000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:10.763954    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5" podStartSLOduration=1.7358620930000002 podStartE2EDuration="2.763937814s" totalImagesPullingTime="1.028075721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:22:10.761486649 +0000 UTC m=+828.532577911" watchObservedRunningTime="2026-09-09 16:22:10.763937814 +0000 UTC m=+828.535029060"
Sep 09 16:22:19.233800 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:19.233713    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:19.234318 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:19.233828    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:19.246311 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:19.246288    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:19.811186 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:19.811155    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5"
Sep 09 16:22:28.245204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:28.245172    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:22:32.503057 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.503020    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"]
Sep 09 16:22:32.506940 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.506916    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.509600 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.509575    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 16:22:32.517144 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.517118    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"]
Sep 09 16:22:32.607704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.607671    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:22:32.655337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.655301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.655337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.655342    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2pld\" (UniqueName: \"kubernetes.io/projected/51a78f96-187b-4094-b06f-55cd38dd0b55-kube-api-access-s2pld\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.655541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.655436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.655541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.655464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a78f96-187b-4094-b06f-55cd38dd0b55-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.655541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.655482    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.655541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.655527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756266 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756266 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a78f96-187b-4094-b06f-55cd38dd0b55-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756488 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756338    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756488 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756410    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756488 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2pld\" (UniqueName: \"kubernetes.io/projected/51a78f96-187b-4094-b06f-55cd38dd0b55-kube-api-access-s2pld\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756589    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756757 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756733    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.756864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.756838    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.758708 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.758685    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a78f96-187b-4094-b06f-55cd38dd0b55-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.758912 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.758893    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a78f96-187b-4094-b06f-55cd38dd0b55-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.764212 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.764188    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2pld\" (UniqueName: \"kubernetes.io/projected/51a78f96-187b-4094-b06f-55cd38dd0b55-kube-api-access-s2pld\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b\" (UID: \"51a78f96-187b-4094-b06f-55cd38dd0b55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:32.819269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:32.819237    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:33.102604 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:33.102506    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"]
Sep 09 16:22:33.108062 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:22:33.108028    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a78f96_187b_4094_b06f_55cd38dd0b55.slice/crio-fdc9cc4dd65119320f360a5dbfa66bb11b41f9df20256da83756acc25a0fdf1c WatchSource:0}: Error finding container fdc9cc4dd65119320f360a5dbfa66bb11b41f9df20256da83756acc25a0fdf1c: Status 404 returned error can't find the container with id fdc9cc4dd65119320f360a5dbfa66bb11b41f9df20256da83756acc25a0fdf1c
Sep 09 16:22:33.892059 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:33.892020    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b" event={"ID":"51a78f96-187b-4094-b06f-55cd38dd0b55","Type":"ContainerStarted","Data":"baa6dc8aa24200f0f9b3b9b194dbdfc2fe9589853042882934f826f2343953df"}
Sep 09 16:22:33.892426 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:33.892077    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b" event={"ID":"51a78f96-187b-4094-b06f-55cd38dd0b55","Type":"ContainerStarted","Data":"fdc9cc4dd65119320f360a5dbfa66bb11b41f9df20256da83756acc25a0fdf1c"}
Sep 09 16:22:33.914496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:33.914448    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b" podStartSLOduration=1.636290987 podStartE2EDuration="1.914431767s" totalImagesPullingTime="278.14078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:22:33.912685823 +0000 UTC m=+851.683777060" watchObservedRunningTime="2026-09-09 16:22:33.914431767 +0000 UTC m=+851.685523013"
Sep 09 16:22:42.038510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:42.038477    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:22:42.820045 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:42.819992    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:42.820257 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:42.820059    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:42.832522 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:42.832492    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:42.959387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:42.959362    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b"
Sep 09 16:22:54.241126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:22:54.241085    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:03.737131 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:23:03.737097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:07.383090 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:23:07.383058    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:07.437468 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:23:07.437433    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:09.757713 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:23:09.757671    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:19.213436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:23:19.213401    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:19.314549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:23:19.314512    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:38.381230 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:38.381196    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:39.963750 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:39.963715    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:49.165950 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:49.165914    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:56.219055 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:56.219024    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:56.319285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:56.319253    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:56.556081 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:56.555993    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:56.676981 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:56.676951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:57.833978 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:57.833927    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:57.933573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:57.933527    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:58.340324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:58.340279    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:59.849388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:24:59.849348    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:00.567292 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:00.567261    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:01.016676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.016643    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"]
Sep 09 16:25:01.020618 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.020592    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.023242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.023213    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6d44b6-serving-cert\""
Sep 09 16:25:01.035718 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.035691    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"]
Sep 09 16:25:01.044847 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.044819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560e07a1-662f-425f-9b1a-8f3032522413-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.044979 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.044904    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-metrics-certs\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.044979 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.044939    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.045107 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.045029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvcx9\" (UniqueName: \"kubernetes.io/projected/560e07a1-662f-425f-9b1a-8f3032522413-kube-api-access-fvcx9\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.045269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.045243    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:01.145962 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.145915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-metrics-certs\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.146542 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.146515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.146802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.146752    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:01.146923 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:01.146659    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-serving-cert: secret "maas-api-e2e-inf-a-6d44b6-serving-cert" not found
Sep 09 16:25:01.146997 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:01.146974    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls podName:560e07a1-662f-425f-9b1a-8f3032522413 nodeName:}" failed. No retries permitted until 2026-09-09 16:25:01.646953338 +0000 UTC m=+999.418044581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls") pod "maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt" (UID: "560e07a1-662f-425f-9b1a-8f3032522413") : secret "maas-api-e2e-inf-a-6d44b6-serving-cert" not found
Sep 09 16:25:01.147171 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.147146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvcx9\" (UniqueName: \"kubernetes.io/projected/560e07a1-662f-425f-9b1a-8f3032522413-kube-api-access-fvcx9\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.147368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.147346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560e07a1-662f-425f-9b1a-8f3032522413-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.148192 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.148124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560e07a1-662f-425f-9b1a-8f3032522413-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.149273 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.149246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-metrics-certs\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.157141 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.157089    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvcx9\" (UniqueName: \"kubernetes.io/projected/560e07a1-662f-425f-9b1a-8f3032522413-kube-api-access-fvcx9\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.402293 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.402252    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:01.616012 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.615976    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:01.653968 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.653876    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.656910 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.656880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls\") pod \"maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:01.934681 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:01.934595    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:02.211849 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:02.211821    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"]
Sep 09 16:25:02.217401 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:02.217371    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:25:02.249065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:02.249029    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:02.827981 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:02.827935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt" event={"ID":"560e07a1-662f-425f-9b1a-8f3032522413","Type":"ContainerStarted","Data":"403e88ba89eca4c648d3502de0aaf02ec8a6cacd4a352b2b0336680bb4d7a00e"}
Sep 09 16:25:02.828152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:02.828009    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:02.828152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:02.828036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt" event={"ID":"560e07a1-662f-425f-9b1a-8f3032522413","Type":"ContainerStarted","Data":"9055f5cdbc894c5d7cd9cff123dd34c8abf514da6008e7883154894128357165"}
Sep 09 16:25:02.846178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:02.846114    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt" podStartSLOduration=2.400681154 podStartE2EDuration="2.846097317s" totalImagesPullingTime="445.416163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:25:02.844594412 +0000 UTC m=+1000.615685658" watchObservedRunningTime="2026-09-09 16:25:02.846097317 +0000 UTC m=+1000.617188563"
Sep 09 16:25:03.708119 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:03.708082    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:04.435025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:04.434992    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:04.493898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:04.493868    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:04.787053 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:04.786958    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:04.886181 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:04.886151    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:08.143131 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.143099    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:08.207168 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.207131    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:08.275614 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.275585    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:08.450279 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.449129    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"]
Sep 09 16:25:08.453459 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.453437    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.456508 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.456181    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0d2e38e1-serving-cert\""
Sep 09 16:25:08.464010 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.463988    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"]
Sep 09 16:25:08.496002 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.495956    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:08.523383 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.523351    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc150bd-cc50-4845-92af-c2ec73f93f37-openshift-service-ca\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.523510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.523450    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.523594 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.523573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-metrics-certs\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.523635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.523614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49rtm\" (UniqueName: \"kubernetes.io/projected/0fc150bd-cc50-4845-92af-c2ec73f93f37-kube-api-access-49rtm\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.592900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.592866    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:08.624168 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.624138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-metrics-certs\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.624307 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.624180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49rtm\" (UniqueName: \"kubernetes.io/projected/0fc150bd-cc50-4845-92af-c2ec73f93f37-kube-api-access-49rtm\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.624399 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.624373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc150bd-cc50-4845-92af-c2ec73f93f37-openshift-service-ca\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.624501 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.624477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.624629 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:08.624610    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-serving-cert: secret "maas-api-e2e-ait-0d2e38e1-serving-cert" not found
Sep 09 16:25:08.624705 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:08.624692    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls podName:0fc150bd-cc50-4845-92af-c2ec73f93f37 nodeName:}" failed. No retries permitted until 2026-09-09 16:25:09.124667728 +0000 UTC m=+1006.895758952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls") pod "maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9" (UID: "0fc150bd-cc50-4845-92af-c2ec73f93f37") : secret "maas-api-e2e-ait-0d2e38e1-serving-cert" not found
Sep 09 16:25:08.625164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.625141    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc150bd-cc50-4845-92af-c2ec73f93f37-openshift-service-ca\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.626880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.626854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-metrics-certs\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.634510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.634485    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49rtm\" (UniqueName: \"kubernetes.io/projected/0fc150bd-cc50-4845-92af-c2ec73f93f37-kube-api-access-49rtm\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:08.730846 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.730736    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:08.840103 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:08.840074    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:25:09.079028 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:09.078937    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:09.129620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:09.129586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:09.132134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:09.132113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls\") pod \"maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:09.179707 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:09.179673    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:09.256966 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:09.256918    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:09.376282 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:09.376252    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:09.659342 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:09.659315    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"]
Sep 09 16:25:09.660599 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:25:09.660561    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc150bd_cc50_4845_92af_c2ec73f93f37.slice/crio-078e61c7a2488eb4665ab1f6702dfa6898996f1e86d68f670cc1d57d867af8d2 WatchSource:0}: Error finding container 078e61c7a2488eb4665ab1f6702dfa6898996f1e86d68f670cc1d57d867af8d2: Status 404 returned error can't find the container with id 078e61c7a2488eb4665ab1f6702dfa6898996f1e86d68f670cc1d57d867af8d2
Sep 09 16:25:09.879922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:09.879890    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9" event={"ID":"0fc150bd-cc50-4845-92af-c2ec73f93f37","Type":"ContainerStarted","Data":"078e61c7a2488eb4665ab1f6702dfa6898996f1e86d68f670cc1d57d867af8d2"}
Sep 09 16:25:10.887514 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:10.887475    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9" event={"ID":"0fc150bd-cc50-4845-92af-c2ec73f93f37","Type":"ContainerStarted","Data":"7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697"}
Sep 09 16:25:10.887931 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:10.887555    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:10.906337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:10.906287    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9" podStartSLOduration=2.498282104 podStartE2EDuration="2.906271242s" totalImagesPullingTime="407.989138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:25:10.904191686 +0000 UTC m=+1008.675282937" watchObservedRunningTime="2026-09-09 16:25:10.906271242 +0000 UTC m=+1008.677362488"
Sep 09 16:25:11.952796 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:11.952731    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:12.045897 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:12.045858    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:13.199594 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.199559    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"]
Sep 09 16:25:13.203892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.203870    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.206550 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.206524    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-743aed-serving-cert\""
Sep 09 16:25:13.222704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.222677    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"]
Sep 09 16:25:13.272498 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.272462    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-maas-api-tls\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.272687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.272514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-openshift-service-ca\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.272687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.272539    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-metrics-certs\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.272687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.272581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vvcc\" (UniqueName: \"kubernetes.io/projected/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-kube-api-access-6vvcc\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.374160 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.374120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-maas-api-tls\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.374160 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.374164    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-openshift-service-ca\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.374396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.374181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-metrics-certs\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.374396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.374215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vvcc\" (UniqueName: \"kubernetes.io/projected/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-kube-api-access-6vvcc\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.374899 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.374871    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-openshift-service-ca\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.376663 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.376639    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-maas-api-tls\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.376795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.376757    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-metrics-certs\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.384542 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.384515    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vvcc\" (UniqueName: \"kubernetes.io/projected/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-kube-api-access-6vvcc\") pod \"maas-api-e2e-autores-743aed-c6bdb7499-znlrq\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.520012 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.519918    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:13.796330 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.796302    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:13.796812 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.796790    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"]
Sep 09 16:25:13.798608 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:25:13.798583    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a5df0e_3e2f_4933_a7a3_8ebbec9b987a.slice/crio-185c9d68f2fa4cb3975249df37c2a7edc75df1c46a5c81fc28a6db38242eb8d2 WatchSource:0}: Error finding container 185c9d68f2fa4cb3975249df37c2a7edc75df1c46a5c81fc28a6db38242eb8d2: Status 404 returned error can't find the container with id 185c9d68f2fa4cb3975249df37c2a7edc75df1c46a5c81fc28a6db38242eb8d2
Sep 09 16:25:13.862421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.862381    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"]
Sep 09 16:25:13.867658 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.867633    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:13.870783 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.870748    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-743aed-dockercfg-86f8j\""
Sep 09 16:25:13.870895 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.870755    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-743aed\""
Sep 09 16:25:13.882330 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.881966    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"]
Sep 09 16:25:13.898301 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.898267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:13.909300 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.909277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq" event={"ID":"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a","Type":"ContainerStarted","Data":"185c9d68f2fa4cb3975249df37c2a7edc75df1c46a5c81fc28a6db38242eb8d2"}
Sep 09 16:25:13.980256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.980219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrbzw\" (UniqueName: \"kubernetes.io/projected/cb1582ad-3107-4582-944b-caa1bdf752c7-kube-api-access-lrbzw\") pod \"payload-processing-e2e-autores-743aed-f98c89b9c-rc2st\" (UID: \"cb1582ad-3107-4582-944b-caa1bdf752c7\") " pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:13.980444 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:13.980355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb1582ad-3107-4582-944b-caa1bdf752c7-plugins-config-volume\") pod \"payload-processing-e2e-autores-743aed-f98c89b9c-rc2st\" (UID: \"cb1582ad-3107-4582-944b-caa1bdf752c7\") " pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:14.081926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.081840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb1582ad-3107-4582-944b-caa1bdf752c7-plugins-config-volume\") pod \"payload-processing-e2e-autores-743aed-f98c89b9c-rc2st\" (UID: \"cb1582ad-3107-4582-944b-caa1bdf752c7\") " pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:14.082082 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.081967    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrbzw\" (UniqueName: \"kubernetes.io/projected/cb1582ad-3107-4582-944b-caa1bdf752c7-kube-api-access-lrbzw\") pod \"payload-processing-e2e-autores-743aed-f98c89b9c-rc2st\" (UID: \"cb1582ad-3107-4582-944b-caa1bdf752c7\") " pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:14.082616 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.082591    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb1582ad-3107-4582-944b-caa1bdf752c7-plugins-config-volume\") pod \"payload-processing-e2e-autores-743aed-f98c89b9c-rc2st\" (UID: \"cb1582ad-3107-4582-944b-caa1bdf752c7\") " pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:14.089871 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.089850    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrbzw\" (UniqueName: \"kubernetes.io/projected/cb1582ad-3107-4582-944b-caa1bdf752c7-kube-api-access-lrbzw\") pod \"payload-processing-e2e-autores-743aed-f98c89b9c-rc2st\" (UID: \"cb1582ad-3107-4582-944b-caa1bdf752c7\") " pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:14.181137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.181100    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:14.456455 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.456420    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"]
Sep 09 16:25:14.456978 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:25:14.456953    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1582ad_3107_4582_944b_caa1bdf752c7.slice/crio-66e40b84fe00677c24f9a6edfdbf8df010dde468770c72357da6e84badfd130a WatchSource:0}: Error finding container 66e40b84fe00677c24f9a6edfdbf8df010dde468770c72357da6e84badfd130a: Status 404 returned error can't find the container with id 66e40b84fe00677c24f9a6edfdbf8df010dde468770c72357da6e84badfd130a
Sep 09 16:25:14.920943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.920904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st" event={"ID":"cb1582ad-3107-4582-944b-caa1bdf752c7","Type":"ContainerStarted","Data":"66e40b84fe00677c24f9a6edfdbf8df010dde468770c72357da6e84badfd130a"}
Sep 09 16:25:14.922664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.922633    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq" event={"ID":"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a","Type":"ContainerStarted","Data":"8912e557737525d4282e3f555395e0cd12904ca8b0de0ca5ff1a4c82b2b7ce02"}
Sep 09 16:25:14.922852 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.922833    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:14.940824 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:14.940756    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq" podStartSLOduration=1.5556437170000001 podStartE2EDuration="1.940742359s" totalImagesPullingTime="385.098642ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:25:14.937308234 +0000 UTC m=+1012.708399492" watchObservedRunningTime="2026-09-09 16:25:14.940742359 +0000 UTC m=+1012.711833605"
Sep 09 16:25:15.201582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:15.201490    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:15.713128 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:15.713079    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:15.813065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:15.813030    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:16.900556 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:16.900526    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:16.944007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:16.943975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st" event={"ID":"cb1582ad-3107-4582-944b-caa1bdf752c7","Type":"ContainerStarted","Data":"2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9"}
Sep 09 16:25:16.944194 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:16.944133    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:17.612155 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:17.612120    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:17.709913 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:17.709888    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:17.852617 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:17.852580    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:19.608983 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:19.608951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:20.721829 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:20.721791    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:20.937407 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:20.937379    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:25:20.955099 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:20.955039    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st" podStartSLOduration=6.143160636 podStartE2EDuration="7.955019354s" totalImagesPullingTime="1.811858718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:25:16.965859813 +0000 UTC m=+1014.736951062" watchObservedRunningTime="2026-09-09 16:25:20.955019354 +0000 UTC m=+1018.726110601"
Sep 09 16:25:22.004737 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:22.004706    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:23.221023 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:23.220993    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:24.301093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:24.301063    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:24.404698 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:24.404664    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:24.498581 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:24.498547    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:24.703885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:24.703855    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:24.876599 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:24.876565    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:25.252249 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:25.252210    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:25.717963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:25.717920    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:25.809692 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:25.809657    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:27.952941 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:27.952911    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:25:29.035084 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:29.035051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:29.100607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:29.100575    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:29.477475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:29.477442    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:30.411118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.411083    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"]
Sep 09 16:25:30.414843 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.414824    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.417190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.417167    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c23332-serving-cert\""
Sep 09 16:25:30.426857 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.426827    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"]
Sep 09 16:25:30.529374 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.529335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:30.558421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.558367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.558656 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.558608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mlr2\" (UniqueName: \"kubernetes.io/projected/443ac23a-7218-4635-90c0-96d1fd7a7ae4-kube-api-access-5mlr2\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.558738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.558679    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-metrics-certs\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.558738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.558725    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/443ac23a-7218-4635-90c0-96d1fd7a7ae4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.634785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.634738    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:30.660105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.660064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mlr2\" (UniqueName: \"kubernetes.io/projected/443ac23a-7218-4635-90c0-96d1fd7a7ae4-kube-api-access-5mlr2\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.660399 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.660374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-metrics-certs\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.660562 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.660545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/443ac23a-7218-4635-90c0-96d1fd7a7ae4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.660738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.660722    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.660920 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:30.660887    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-serving-cert: secret "maas-api-e2e-inf-b-c23332-serving-cert" not found
Sep 09 16:25:30.661286 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:30.661233    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls podName:443ac23a-7218-4635-90c0-96d1fd7a7ae4 nodeName:}" failed. No retries permitted until 2026-09-09 16:25:31.160970487 +0000 UTC m=+1028.932061722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls") pod "maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf" (UID: "443ac23a-7218-4635-90c0-96d1fd7a7ae4") : secret "maas-api-e2e-inf-b-c23332-serving-cert" not found
Sep 09 16:25:30.661477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.661451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/443ac23a-7218-4635-90c0-96d1fd7a7ae4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.663795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.663738    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-metrics-certs\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:30.669240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:30.669196    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mlr2\" (UniqueName: \"kubernetes.io/projected/443ac23a-7218-4635-90c0-96d1fd7a7ae4-kube-api-access-5mlr2\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:31.167053 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:31.167016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:31.167256 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:31.167182    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-serving-cert: secret "maas-api-e2e-inf-b-c23332-serving-cert" not found
Sep 09 16:25:31.167256 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:31.167246    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls podName:443ac23a-7218-4635-90c0-96d1fd7a7ae4 nodeName:}" failed. No retries permitted until 2026-09-09 16:25:32.167230346 +0000 UTC m=+1029.938321570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls") pod "maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf" (UID: "443ac23a-7218-4635-90c0-96d1fd7a7ae4") : secret "maas-api-e2e-inf-b-c23332-serving-cert" not found
Sep 09 16:25:32.176029 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:32.175988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:32.178630 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:32.178604    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls\") pod \"maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:32.227991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:32.227963    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:32.428202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:32.428123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:32.507861 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:32.507834    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"]
Sep 09 16:25:32.509354 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:25:32.509324    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443ac23a_7218_4635_90c0_96d1fd7a7ae4.slice/crio-799b8c226c3da029cad8701dd7dad605b76abbd99ef472227948b81d3c4d7eab WatchSource:0}: Error finding container 799b8c226c3da029cad8701dd7dad605b76abbd99ef472227948b81d3c4d7eab: Status 404 returned error can't find the container with id 799b8c226c3da029cad8701dd7dad605b76abbd99ef472227948b81d3c4d7eab
Sep 09 16:25:32.510036 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:32.509985    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:33.072069 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:33.072032    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf" event={"ID":"443ac23a-7218-4635-90c0-96d1fd7a7ae4","Type":"ContainerStarted","Data":"9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9"}
Sep 09 16:25:33.072222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:33.072103    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf" event={"ID":"443ac23a-7218-4635-90c0-96d1fd7a7ae4","Type":"ContainerStarted","Data":"799b8c226c3da029cad8701dd7dad605b76abbd99ef472227948b81d3c4d7eab"}
Sep 09 16:25:33.072267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:33.072243    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:33.091508 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:33.091455    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf" podStartSLOduration=2.625857042 podStartE2EDuration="3.091440169s" totalImagesPullingTime="465.583127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:25:33.089266384 +0000 UTC m=+1030.860357630" watchObservedRunningTime="2026-09-09 16:25:33.091440169 +0000 UTC m=+1030.862531414"
Sep 09 16:25:33.278215 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:33.278099    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:35.128333 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:35.128293    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:37.026087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:37.026049    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:39.084279 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:39.084250    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:25:48.670319 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:48.670287    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:49.224717 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.224681    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"]
Sep 09 16:25:49.225028 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.224991    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9" podUID="0fc150bd-cc50-4845-92af-c2ec73f93f37" containerName="maas-api" containerID="cri-o://7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697" gracePeriod=30
Sep 09 16:25:49.249368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.249341    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:49.349189 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.349151    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:49.445084 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.445043    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:49.484867 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.484811    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:49.527926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.527887    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:49.540922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.540896    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls\") pod \"0fc150bd-cc50-4845-92af-c2ec73f93f37\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") "
Sep 09 16:25:49.541094 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.540961    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49rtm\" (UniqueName: \"kubernetes.io/projected/0fc150bd-cc50-4845-92af-c2ec73f93f37-kube-api-access-49rtm\") pod \"0fc150bd-cc50-4845-92af-c2ec73f93f37\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") "
Sep 09 16:25:49.541094 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.540995    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc150bd-cc50-4845-92af-c2ec73f93f37-openshift-service-ca\") pod \"0fc150bd-cc50-4845-92af-c2ec73f93f37\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") "
Sep 09 16:25:49.541094 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.541079    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-metrics-certs\") pod \"0fc150bd-cc50-4845-92af-c2ec73f93f37\" (UID: \"0fc150bd-cc50-4845-92af-c2ec73f93f37\") "
Sep 09 16:25:49.541396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.541370    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fc150bd-cc50-4845-92af-c2ec73f93f37-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0fc150bd-cc50-4845-92af-c2ec73f93f37" (UID: "0fc150bd-cc50-4845-92af-c2ec73f93f37"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:25:49.543368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.543339    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0fc150bd-cc50-4845-92af-c2ec73f93f37" (UID: "0fc150bd-cc50-4845-92af-c2ec73f93f37"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:25:49.543368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.543349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fc150bd-cc50-4845-92af-c2ec73f93f37-kube-api-access-49rtm" (OuterVolumeSpecName: "kube-api-access-49rtm") pod "0fc150bd-cc50-4845-92af-c2ec73f93f37" (UID: "0fc150bd-cc50-4845-92af-c2ec73f93f37"). InnerVolumeSpecName "kube-api-access-49rtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:25:49.543543 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.543514    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0fc150bd-cc50-4845-92af-c2ec73f93f37" (UID: "0fc150bd-cc50-4845-92af-c2ec73f93f37"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:25:49.623457 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.623414    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:49.642811 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.642755    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49rtm\" (UniqueName: \"kubernetes.io/projected/0fc150bd-cc50-4845-92af-c2ec73f93f37-kube-api-access-49rtm\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:25:49.642947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.642822    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc150bd-cc50-4845-92af-c2ec73f93f37-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:25:49.642947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.642835    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:25:49.642947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:49.642843    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fc150bd-cc50-4845-92af-c2ec73f93f37-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:25:50.188916 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.188880    2567 generic.go:356] "Generic (PLEG): container finished" podID="0fc150bd-cc50-4845-92af-c2ec73f93f37" containerID="7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697" exitCode=0
Sep 09 16:25:50.189317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.188928    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"
Sep 09 16:25:50.189317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.188963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9" event={"ID":"0fc150bd-cc50-4845-92af-c2ec73f93f37","Type":"ContainerDied","Data":"7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697"}
Sep 09 16:25:50.189317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.189016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9" event={"ID":"0fc150bd-cc50-4845-92af-c2ec73f93f37","Type":"ContainerDied","Data":"078e61c7a2488eb4665ab1f6702dfa6898996f1e86d68f670cc1d57d867af8d2"}
Sep 09 16:25:50.189317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.189039    2567 scope.go:117] "RemoveContainer" containerID="7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697"
Sep 09 16:25:50.202154 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.202135    2567 scope.go:117] "RemoveContainer" containerID="7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697"
Sep 09 16:25:50.202468 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:50.202451    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697\": container with ID starting with 7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697 not found: ID does not exist" containerID="7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697"
Sep 09 16:25:50.202531 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.202473    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697"} err="failed to get container status \"7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697\": rpc error: code = NotFound desc = could not find container \"7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697\": container with ID starting with 7159ec41ef12be7114ce84e61138c88355e73ba10bc2f113f75bc92e7e372697 not found: ID does not exist"
Sep 09 16:25:50.206837 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.206813    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:50.219057 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.219030    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"]
Sep 09 16:25:50.224335 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.224311    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d2e38e1-564f54bdf6-fzsd9"]
Sep 09 16:25:50.305932 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.305904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:50.429615 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.429572    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:50.738887 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:50.738855    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fc150bd-cc50-4845-92af-c2ec73f93f37" path="/var/lib/kubelet/pods/0fc150bd-cc50-4845-92af-c2ec73f93f37/volumes"
Sep 09 16:25:51.322451 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:51.322418    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:51.393951 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:51.393916    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:51.547758 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:51.547697    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:53.763290 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.763258    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:53.863498 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.863463    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:53.924012 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.923977    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"]
Sep 09 16:25:53.924526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.924511    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc150bd-cc50-4845-92af-c2ec73f93f37" containerName="maas-api"
Sep 09 16:25:53.924526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.924526    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc150bd-cc50-4845-92af-c2ec73f93f37" containerName="maas-api"
Sep 09 16:25:53.924662 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.924616    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fc150bd-cc50-4845-92af-c2ec73f93f37" containerName="maas-api"
Sep 09 16:25:53.931085 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.931058    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:53.933620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.933597    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-fb79f974-serving-cert\""
Sep 09 16:25:53.939181 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.939037    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"]
Sep 09 16:25:53.955189 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.955159    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:53.986708 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.986679    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:53.986847 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.986713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj5cc\" (UniqueName: \"kubernetes.io/projected/6e6c9f6d-36c5-4907-8861-a87dae725594-kube-api-access-wj5cc\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:53.986892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.986854    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-metrics-certs\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:53.986938 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:53.986919    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e6c9f6d-36c5-4907-8861-a87dae725594-openshift-service-ca\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.013992 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.013915    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:54.087588 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.087551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-metrics-certs\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.087790 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.087620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e6c9f6d-36c5-4907-8861-a87dae725594-openshift-service-ca\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.087790 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.087705    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.087790 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.087737    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj5cc\" (UniqueName: \"kubernetes.io/projected/6e6c9f6d-36c5-4907-8861-a87dae725594-kube-api-access-wj5cc\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.087970 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:54.087856    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-serving-cert: secret "maas-api-e2e-migrate-fb79f974-serving-cert" not found
Sep 09 16:25:54.087970 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:25:54.087947    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls podName:6e6c9f6d-36c5-4907-8861-a87dae725594 nodeName:}" failed. No retries permitted until 2026-09-09 16:25:54.587927289 +0000 UTC m=+1052.359018531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls") pod "maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q" (UID: "6e6c9f6d-36c5-4907-8861-a87dae725594") : secret "maas-api-e2e-migrate-fb79f974-serving-cert" not found
Sep 09 16:25:54.088412 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.088393    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e6c9f6d-36c5-4907-8861-a87dae725594-openshift-service-ca\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.090135 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.090106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-metrics-certs\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.105525 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.105499    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj5cc\" (UniqueName: \"kubernetes.io/projected/6e6c9f6d-36c5-4907-8861-a87dae725594-kube-api-access-wj5cc\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.206999 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.206961    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:54.349691 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.349580    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:54.592681 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.592647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.594961 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.594938    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls\") pod \"maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:54.635724 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.635698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:54.704424 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.704390    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:54.843478 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:54.843441    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:55.124428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:55.124403    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"]
Sep 09 16:25:55.125864 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:25:55.125829    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6c9f6d_36c5_4907_8861_a87dae725594.slice/crio-4e740aab9b8a51540a9b17d9cb4a4f69311e4c53428a288c39270a314bc7ba02 WatchSource:0}: Error finding container 4e740aab9b8a51540a9b17d9cb4a4f69311e4c53428a288c39270a314bc7ba02: Status 404 returned error can't find the container with id 4e740aab9b8a51540a9b17d9cb4a4f69311e4c53428a288c39270a314bc7ba02
Sep 09 16:25:55.226612 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:55.226525    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q" event={"ID":"6e6c9f6d-36c5-4907-8861-a87dae725594","Type":"ContainerStarted","Data":"4e740aab9b8a51540a9b17d9cb4a4f69311e4c53428a288c39270a314bc7ba02"}
Sep 09 16:25:56.234486 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:56.234443    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q" event={"ID":"6e6c9f6d-36c5-4907-8861-a87dae725594","Type":"ContainerStarted","Data":"ca735055036340f098cf786644e1bcc9a2332a527d7916567d2cae47c2008a3d"}
Sep 09 16:25:56.234864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:56.234509    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:25:56.253902 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:25:56.253854    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q" podStartSLOduration=2.8695966349999997 podStartE2EDuration="3.25384037s" totalImagesPullingTime="384.243735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:25:56.249726114 +0000 UTC m=+1054.020817361" watchObservedRunningTime="2026-09-09 16:25:56.25384037 +0000 UTC m=+1054.024931616"
Sep 09 16:26:02.246821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:02.246788    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:26:19.730157 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:19.730118    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:25.289929 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.289746    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"]
Sep 09 16:26:25.290398 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.290002    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q" podUID="6e6c9f6d-36c5-4907-8861-a87dae725594" containerName="maas-api" containerID="cri-o://ca735055036340f098cf786644e1bcc9a2332a527d7916567d2cae47c2008a3d" gracePeriod=30
Sep 09 16:26:25.316578 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.316540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:25.395658 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.395615    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:25.430722 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.430682    2567 generic.go:356] "Generic (PLEG): container finished" podID="6e6c9f6d-36c5-4907-8861-a87dae725594" containerID="ca735055036340f098cf786644e1bcc9a2332a527d7916567d2cae47c2008a3d" exitCode=0
Sep 09 16:26:25.430896 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.430751    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q" event={"ID":"6e6c9f6d-36c5-4907-8861-a87dae725594","Type":"ContainerDied","Data":"ca735055036340f098cf786644e1bcc9a2332a527d7916567d2cae47c2008a3d"}
Sep 09 16:26:25.495852 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.495799    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:25.564176 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.564154    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:26:25.597730 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.597699    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:25.599711 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.599686    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj5cc\" (UniqueName: \"kubernetes.io/projected/6e6c9f6d-36c5-4907-8861-a87dae725594-kube-api-access-wj5cc\") pod \"6e6c9f6d-36c5-4907-8861-a87dae725594\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") "
Sep 09 16:26:25.599828 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.599764    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e6c9f6d-36c5-4907-8861-a87dae725594-openshift-service-ca\") pod \"6e6c9f6d-36c5-4907-8861-a87dae725594\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") "
Sep 09 16:26:25.599881 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.599856    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls\") pod \"6e6c9f6d-36c5-4907-8861-a87dae725594\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") "
Sep 09 16:26:25.599921 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.599900    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-metrics-certs\") pod \"6e6c9f6d-36c5-4907-8861-a87dae725594\" (UID: \"6e6c9f6d-36c5-4907-8861-a87dae725594\") "
Sep 09 16:26:25.600103 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.600075    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e6c9f6d-36c5-4907-8861-a87dae725594-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e6c9f6d-36c5-4907-8861-a87dae725594" (UID: "6e6c9f6d-36c5-4907-8861-a87dae725594"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:26:25.600331 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.600310    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e6c9f6d-36c5-4907-8861-a87dae725594-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:26:25.601996 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.601968    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e6c9f6d-36c5-4907-8861-a87dae725594" (UID: "6e6c9f6d-36c5-4907-8861-a87dae725594"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:26:25.601996 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.601987    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6e6c9f6d-36c5-4907-8861-a87dae725594" (UID: "6e6c9f6d-36c5-4907-8861-a87dae725594"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:26:25.602141 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.602027    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6c9f6d-36c5-4907-8861-a87dae725594-kube-api-access-wj5cc" (OuterVolumeSpecName: "kube-api-access-wj5cc") pod "6e6c9f6d-36c5-4907-8861-a87dae725594" (UID: "6e6c9f6d-36c5-4907-8861-a87dae725594"). InnerVolumeSpecName "kube-api-access-wj5cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:26:25.701598 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.701560    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj5cc\" (UniqueName: \"kubernetes.io/projected/6e6c9f6d-36c5-4907-8861-a87dae725594-kube-api-access-wj5cc\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:26:25.701598 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.701598    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:26:25.701867 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.701612    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e6c9f6d-36c5-4907-8861-a87dae725594-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:26:25.708718 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:25.708691    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:26.447676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:26.447646    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"
Sep 09 16:26:26.448158 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:26.447647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q" event={"ID":"6e6c9f6d-36c5-4907-8861-a87dae725594","Type":"ContainerDied","Data":"4e740aab9b8a51540a9b17d9cb4a4f69311e4c53428a288c39270a314bc7ba02"}
Sep 09 16:26:26.448158 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:26.447854    2567 scope.go:117] "RemoveContainer" containerID="ca735055036340f098cf786644e1bcc9a2332a527d7916567d2cae47c2008a3d"
Sep 09 16:26:26.471678 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:26.471652    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"]
Sep 09 16:26:26.474378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:26.474354    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fb79f974-7674df569f-t9g5q"]
Sep 09 16:26:26.743949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:26.743857    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e6c9f6d-36c5-4907-8861-a87dae725594" path="/var/lib/kubelet/pods/6e6c9f6d-36c5-4907-8861-a87dae725594/volumes"
Sep 09 16:26:26.778734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:26.778689    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:26.835292 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:26.835259    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:27.188783 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:27.188732    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:28.803088 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:28.803033    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:28.897930 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:28.897897    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:29.929132 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:29.929101    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"]
Sep 09 16:26:29.929862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:29.929838    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6c9f6d-36c5-4907-8861-a87dae725594" containerName="maas-api"
Sep 09 16:26:29.929862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:29.929862    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6c9f6d-36c5-4907-8861-a87dae725594" containerName="maas-api"
Sep 09 16:26:29.930037 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:29.930024    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6c9f6d-36c5-4907-8861-a87dae725594" containerName="maas-api"
Sep 09 16:26:29.934589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:29.934567    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:29.936908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:29.936889    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8a375fa0-serving-cert\""
Sep 09 16:26:29.946306 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:29.945106    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"]
Sep 09 16:26:29.969813 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:29.969766    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:30.044761 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.044727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-metrics-certs\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.044972 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.044902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-maas-api-tls\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.044972 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.044945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfjns\" (UniqueName: \"kubernetes.io/projected/66d09dfd-5445-4a20-91a2-b8734da79ee6-kube-api-access-pfjns\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.045078 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.045046    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66d09dfd-5445-4a20-91a2-b8734da79ee6-openshift-service-ca\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.073715 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.073654    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:30.146423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.146384    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-maas-api-tls\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.146613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.146433    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfjns\" (UniqueName: \"kubernetes.io/projected/66d09dfd-5445-4a20-91a2-b8734da79ee6-kube-api-access-pfjns\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.146613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.146466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66d09dfd-5445-4a20-91a2-b8734da79ee6-openshift-service-ca\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.146613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.146505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-metrics-certs\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.147163 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.147136    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66d09dfd-5445-4a20-91a2-b8734da79ee6-openshift-service-ca\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.148934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.148899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-metrics-certs\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.148934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.148927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-maas-api-tls\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.155815 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.155788    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfjns\" (UniqueName: \"kubernetes.io/projected/66d09dfd-5445-4a20-91a2-b8734da79ee6-kube-api-access-pfjns\") pod \"maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.184388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.184311    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:30.251311 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.251274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:30.495024 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.494951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:30.531275 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.531222    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"]
Sep 09 16:26:30.532859 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:26:30.532831    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d09dfd_5445_4a20_91a2_b8734da79ee6.slice/crio-d205e7968ca079ff5d918c6f789fa4afaf15e816dc97ca0e4edecc2c01840595 WatchSource:0}: Error finding container d205e7968ca079ff5d918c6f789fa4afaf15e816dc97ca0e4edecc2c01840595: Status 404 returned error can't find the container with id d205e7968ca079ff5d918c6f789fa4afaf15e816dc97ca0e4edecc2c01840595
Sep 09 16:26:30.587110 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.587078    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:30.634830 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.634791    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"]
Sep 09 16:26:30.639943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.639919    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:30.642559 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.642533    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8a375fa0-dockercfg-fgmjh\""
Sep 09 16:26:30.642688 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.642607    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8a375fa0\""
Sep 09 16:26:30.647686 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.647638    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"]
Sep 09 16:26:30.755369 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.755283    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/260ec0b7-4831-4692-8473-34b0d3ddb8d2-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw\" (UID: \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:30.755629 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.755610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vs5\" (UniqueName: \"kubernetes.io/projected/260ec0b7-4831-4692-8473-34b0d3ddb8d2-kube-api-access-59vs5\") pod \"payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw\" (UID: \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:30.856732 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.856686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59vs5\" (UniqueName: \"kubernetes.io/projected/260ec0b7-4831-4692-8473-34b0d3ddb8d2-kube-api-access-59vs5\") pod \"payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw\" (UID: \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:30.857205 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.857165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/260ec0b7-4831-4692-8473-34b0d3ddb8d2-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw\" (UID: \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:30.858093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.858064    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/260ec0b7-4831-4692-8473-34b0d3ddb8d2-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw\" (UID: \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:30.864969 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.864936    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vs5\" (UniqueName: \"kubernetes.io/projected/260ec0b7-4831-4692-8473-34b0d3ddb8d2-kube-api-access-59vs5\") pod \"payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw\" (UID: \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:30.954510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:30.954471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:31.236422 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:31.236389    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"]
Sep 09 16:26:31.237287 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:26:31.237260    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260ec0b7_4831_4692_8473_34b0d3ddb8d2.slice/crio-df6dfee646cfb79d6fb223c6e0d1f24b001917ecef0f3ef1b44e99325a5689b3 WatchSource:0}: Error finding container df6dfee646cfb79d6fb223c6e0d1f24b001917ecef0f3ef1b44e99325a5689b3: Status 404 returned error can't find the container with id df6dfee646cfb79d6fb223c6e0d1f24b001917ecef0f3ef1b44e99325a5689b3
Sep 09 16:26:31.487892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:31.487856    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw" event={"ID":"260ec0b7-4831-4692-8473-34b0d3ddb8d2","Type":"ContainerStarted","Data":"49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff"}
Sep 09 16:26:31.488071 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:31.487910    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw" event={"ID":"260ec0b7-4831-4692-8473-34b0d3ddb8d2","Type":"ContainerStarted","Data":"df6dfee646cfb79d6fb223c6e0d1f24b001917ecef0f3ef1b44e99325a5689b3"}
Sep 09 16:26:31.488071 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:31.487970    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:31.489355 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:31.489331    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f" event={"ID":"66d09dfd-5445-4a20-91a2-b8734da79ee6","Type":"ContainerStarted","Data":"d205e7968ca079ff5d918c6f789fa4afaf15e816dc97ca0e4edecc2c01840595"}
Sep 09 16:26:31.505947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:31.505902    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw" podStartSLOduration=1.505889233 podStartE2EDuration="1.505889233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:26:31.503736935 +0000 UTC m=+1089.274828184" watchObservedRunningTime="2026-09-09 16:26:31.505889233 +0000 UTC m=+1089.276980513"
Sep 09 16:26:32.499889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:32.499809    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f" event={"ID":"66d09dfd-5445-4a20-91a2-b8734da79ee6","Type":"ContainerStarted","Data":"6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5"}
Sep 09 16:26:32.500219 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:32.499900    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:32.517175 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:32.517128    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f" podStartSLOduration=1.908995534 podStartE2EDuration="3.517113774s" totalImagesPullingTime="1.60811824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:26:32.515126984 +0000 UTC m=+1090.286218231" watchObservedRunningTime="2026-09-09 16:26:32.517113774 +0000 UTC m=+1090.288205052"
Sep 09 16:26:33.002267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:33.002232    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:38.512051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:38.512016    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:26:42.502125 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:42.502095    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:26:43.413359 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:43.413330    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:49.664748 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:49.664716    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:50.313980 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:50.313942    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:50.528515 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:50.528481    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:51.320048 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:51.320012    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:52.051405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:52.051372    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:52.757184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:26:52.757149    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:00.541979 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.541945    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"]
Sep 09 16:27:00.544579 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.542152    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq" podUID="c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" containerName="maas-api" containerID="cri-o://8912e557737525d4282e3f555395e0cd12904ca8b0de0ca5ff1a4c82b2b7ce02" gracePeriod=30
Sep 09 16:27:00.570583 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.570553    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:00.593705 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.593672    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"]
Sep 09 16:27:00.593928 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.593901    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st" podUID="cb1582ad-3107-4582-944b-caa1bdf752c7" containerName="payload-processing" containerID="cri-o://2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9" gracePeriod=30
Sep 09 16:27:00.674735 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.674702    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:00.680114 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.680084    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"]
Sep 09 16:27:00.680314 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.680285    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f" podUID="66d09dfd-5445-4a20-91a2-b8734da79ee6" containerName="maas-api" containerID="cri-o://6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5" gracePeriod=30
Sep 09 16:27:00.710820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.710657    2567 generic.go:356] "Generic (PLEG): container finished" podID="c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" containerID="8912e557737525d4282e3f555395e0cd12904ca8b0de0ca5ff1a4c82b2b7ce02" exitCode=0
Sep 09 16:27:00.710820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.710728    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq" event={"ID":"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a","Type":"ContainerDied","Data":"8912e557737525d4282e3f555395e0cd12904ca8b0de0ca5ff1a4c82b2b7ce02"}
Sep 09 16:27:00.745618 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.745579    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"]
Sep 09 16:27:00.745988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.745892    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw" podUID="260ec0b7-4831-4692-8473-34b0d3ddb8d2" containerName="payload-processing" containerID="cri-o://49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff" gracePeriod=30
Sep 09 16:27:00.758794 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.758374    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:00.825613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.825578    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:00.876759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.876724    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:27:00.893965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.893481    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:00.925173 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.925149    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:27:00.974081 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.974051    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-openshift-service-ca\") pod \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") "
Sep 09 16:27:00.974241 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.974103    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb1582ad-3107-4582-944b-caa1bdf752c7-plugins-config-volume\") pod \"cb1582ad-3107-4582-944b-caa1bdf752c7\" (UID: \"cb1582ad-3107-4582-944b-caa1bdf752c7\") "
Sep 09 16:27:00.974241 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.974162    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-maas-api-tls\") pod \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") "
Sep 09 16:27:00.974241 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.974186    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vvcc\" (UniqueName: \"kubernetes.io/projected/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-kube-api-access-6vvcc\") pod \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") "
Sep 09 16:27:00.974416 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.974244    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrbzw\" (UniqueName: \"kubernetes.io/projected/cb1582ad-3107-4582-944b-caa1bdf752c7-kube-api-access-lrbzw\") pod \"cb1582ad-3107-4582-944b-caa1bdf752c7\" (UID: \"cb1582ad-3107-4582-944b-caa1bdf752c7\") "
Sep 09 16:27:00.974416 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.974264    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-metrics-certs\") pod \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\" (UID: \"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a\") "
Sep 09 16:27:00.974836 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.974800    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb1582ad-3107-4582-944b-caa1bdf752c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb1582ad-3107-4582-944b-caa1bdf752c7" (UID: "cb1582ad-3107-4582-944b-caa1bdf752c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:27:00.974976 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.974876    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" (UID: "c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:27:00.976845 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.976816    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" (UID: "c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:27:00.977085 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.977058    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" (UID: "c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:27:00.978372 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.978333    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-kube-api-access-6vvcc" (OuterVolumeSpecName: "kube-api-access-6vvcc") pod "c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" (UID: "c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a"). InnerVolumeSpecName "kube-api-access-6vvcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:27:00.978466 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.978384    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb1582ad-3107-4582-944b-caa1bdf752c7-kube-api-access-lrbzw" (OuterVolumeSpecName: "kube-api-access-lrbzw") pod "cb1582ad-3107-4582-944b-caa1bdf752c7" (UID: "cb1582ad-3107-4582-944b-caa1bdf752c7"). InnerVolumeSpecName "kube-api-access-lrbzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:27:00.999694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:00.999672    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:27:01.027551 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.027494    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:27:01.075677 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.075589    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-maas-api-tls\") pod \"66d09dfd-5445-4a20-91a2-b8734da79ee6\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") "
Sep 09 16:27:01.075677 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.075635    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66d09dfd-5445-4a20-91a2-b8734da79ee6-openshift-service-ca\") pod \"66d09dfd-5445-4a20-91a2-b8734da79ee6\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") "
Sep 09 16:27:01.075915 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.075741    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfjns\" (UniqueName: \"kubernetes.io/projected/66d09dfd-5445-4a20-91a2-b8734da79ee6-kube-api-access-pfjns\") pod \"66d09dfd-5445-4a20-91a2-b8734da79ee6\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") "
Sep 09 16:27:01.075915 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.075807    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59vs5\" (UniqueName: \"kubernetes.io/projected/260ec0b7-4831-4692-8473-34b0d3ddb8d2-kube-api-access-59vs5\") pod \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\" (UID: \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\") "
Sep 09 16:27:01.075915 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.075846    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-metrics-certs\") pod \"66d09dfd-5445-4a20-91a2-b8734da79ee6\" (UID: \"66d09dfd-5445-4a20-91a2-b8734da79ee6\") "
Sep 09 16:27:01.075915 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.075869    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/260ec0b7-4831-4692-8473-34b0d3ddb8d2-plugins-config-volume\") pod \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\" (UID: \"260ec0b7-4831-4692-8473-34b0d3ddb8d2\") "
Sep 09 16:27:01.076274 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.076249    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb1582ad-3107-4582-944b-caa1bdf752c7-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.076370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.076278    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.076370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.076291    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vvcc\" (UniqueName: \"kubernetes.io/projected/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-kube-api-access-6vvcc\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.076370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.076304    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrbzw\" (UniqueName: \"kubernetes.io/projected/cb1582ad-3107-4582-944b-caa1bdf752c7-kube-api-access-lrbzw\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.076370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.076317    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.076370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.076329    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.076630 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.076356    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d09dfd-5445-4a20-91a2-b8734da79ee6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "66d09dfd-5445-4a20-91a2-b8734da79ee6" (UID: "66d09dfd-5445-4a20-91a2-b8734da79ee6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:27:01.076824 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.076767    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260ec0b7-4831-4692-8473-34b0d3ddb8d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "260ec0b7-4831-4692-8473-34b0d3ddb8d2" (UID: "260ec0b7-4831-4692-8473-34b0d3ddb8d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:27:01.077900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.077870    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "66d09dfd-5445-4a20-91a2-b8734da79ee6" (UID: "66d09dfd-5445-4a20-91a2-b8734da79ee6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:27:01.078208 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.078188    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "66d09dfd-5445-4a20-91a2-b8734da79ee6" (UID: "66d09dfd-5445-4a20-91a2-b8734da79ee6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:27:01.078371 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.078358    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d09dfd-5445-4a20-91a2-b8734da79ee6-kube-api-access-pfjns" (OuterVolumeSpecName: "kube-api-access-pfjns") pod "66d09dfd-5445-4a20-91a2-b8734da79ee6" (UID: "66d09dfd-5445-4a20-91a2-b8734da79ee6"). InnerVolumeSpecName "kube-api-access-pfjns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:27:01.078750 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.078727    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260ec0b7-4831-4692-8473-34b0d3ddb8d2-kube-api-access-59vs5" (OuterVolumeSpecName: "kube-api-access-59vs5") pod "260ec0b7-4831-4692-8473-34b0d3ddb8d2" (UID: "260ec0b7-4831-4692-8473-34b0d3ddb8d2"). InnerVolumeSpecName "kube-api-access-59vs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:27:01.177952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.177922    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.177952 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.177953    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66d09dfd-5445-4a20-91a2-b8734da79ee6-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.178112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.177969    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfjns\" (UniqueName: \"kubernetes.io/projected/66d09dfd-5445-4a20-91a2-b8734da79ee6-kube-api-access-pfjns\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.178112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.177983    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59vs5\" (UniqueName: \"kubernetes.io/projected/260ec0b7-4831-4692-8473-34b0d3ddb8d2-kube-api-access-59vs5\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.178112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.177996    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66d09dfd-5445-4a20-91a2-b8734da79ee6-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.178112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.178036    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/260ec0b7-4831-4692-8473-34b0d3ddb8d2-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:01.247217 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.247188    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:01.348093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.347990    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:01.718256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.718222    2567 generic.go:356] "Generic (PLEG): container finished" podID="260ec0b7-4831-4692-8473-34b0d3ddb8d2" containerID="49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff" exitCode=0
Sep 09 16:27:01.718631 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.718266    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"
Sep 09 16:27:01.718631 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.718298    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw" event={"ID":"260ec0b7-4831-4692-8473-34b0d3ddb8d2","Type":"ContainerDied","Data":"49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff"}
Sep 09 16:27:01.718631 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.718380    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw" event={"ID":"260ec0b7-4831-4692-8473-34b0d3ddb8d2","Type":"ContainerDied","Data":"df6dfee646cfb79d6fb223c6e0d1f24b001917ecef0f3ef1b44e99325a5689b3"}
Sep 09 16:27:01.718631 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.718415    2567 scope.go:117] "RemoveContainer" containerID="49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff"
Sep 09 16:27:01.719856 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.719726    2567 generic.go:356] "Generic (PLEG): container finished" podID="66d09dfd-5445-4a20-91a2-b8734da79ee6" containerID="6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5" exitCode=0
Sep 09 16:27:01.719856 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.719788    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"
Sep 09 16:27:01.719856 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.719807    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f" event={"ID":"66d09dfd-5445-4a20-91a2-b8734da79ee6","Type":"ContainerDied","Data":"6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5"}
Sep 09 16:27:01.719856 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.719852    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f" event={"ID":"66d09dfd-5445-4a20-91a2-b8734da79ee6","Type":"ContainerDied","Data":"d205e7968ca079ff5d918c6f789fa4afaf15e816dc97ca0e4edecc2c01840595"}
Sep 09 16:27:01.721448 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.721424    2567 generic.go:356] "Generic (PLEG): container finished" podID="cb1582ad-3107-4582-944b-caa1bdf752c7" containerID="2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9" exitCode=0
Sep 09 16:27:01.721555 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.721465    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"
Sep 09 16:27:01.721555 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.721501    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st" event={"ID":"cb1582ad-3107-4582-944b-caa1bdf752c7","Type":"ContainerDied","Data":"2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9"}
Sep 09 16:27:01.721679 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.721556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st" event={"ID":"cb1582ad-3107-4582-944b-caa1bdf752c7","Type":"ContainerDied","Data":"66e40b84fe00677c24f9a6edfdbf8df010dde468770c72357da6e84badfd130a"}
Sep 09 16:27:01.723134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.723109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq" event={"ID":"c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a","Type":"ContainerDied","Data":"185c9d68f2fa4cb3975249df37c2a7edc75df1c46a5c81fc28a6db38242eb8d2"}
Sep 09 16:27:01.723229 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.723209    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"
Sep 09 16:27:01.729119 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.729099    2567 scope.go:117] "RemoveContainer" containerID="49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff"
Sep 09 16:27:01.729427 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:27:01.729398    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff\": container with ID starting with 49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff not found: ID does not exist" containerID="49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff"
Sep 09 16:27:01.729516 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.729433    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff"} err="failed to get container status \"49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff\": rpc error: code = NotFound desc = could not find container \"49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff\": container with ID starting with 49a00d1cc9e727e0ab01725c08fca2b7ea18d84029b0de6b96ed5d2c5b04e1ff not found: ID does not exist"
Sep 09 16:27:01.729516 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.729456    2567 scope.go:117] "RemoveContainer" containerID="6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5"
Sep 09 16:27:01.739602 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.739587    2567 scope.go:117] "RemoveContainer" containerID="6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5"
Sep 09 16:27:01.739905 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:27:01.739882    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5\": container with ID starting with 6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5 not found: ID does not exist" containerID="6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5"
Sep 09 16:27:01.739978 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.739910    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5"} err="failed to get container status \"6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5\": rpc error: code = NotFound desc = could not find container \"6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5\": container with ID starting with 6afb35543ae765931e172ca2f9748faef26a28e1545ab4440d5f72d5b6f176e5 not found: ID does not exist"
Sep 09 16:27:01.739978 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.739927    2567 scope.go:117] "RemoveContainer" containerID="2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9"
Sep 09 16:27:01.750205 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.750129    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"]
Sep 09 16:27:01.750269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.750257    2567 scope.go:117] "RemoveContainer" containerID="2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9"
Sep 09 16:27:01.750531 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:27:01.750512    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9\": container with ID starting with 2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9 not found: ID does not exist" containerID="2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9"
Sep 09 16:27:01.750602 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.750542    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9"} err="failed to get container status \"2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9\": rpc error: code = NotFound desc = could not find container \"2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9\": container with ID starting with 2e201111462228534b06801a0b66d6f7d935b14e3939baef84345f49a961a4f9 not found: ID does not exist"
Sep 09 16:27:01.750602 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.750566    2567 scope.go:117] "RemoveContainer" containerID="8912e557737525d4282e3f555395e0cd12904ca8b0de0ca5ff1a4c82b2b7ce02"
Sep 09 16:27:01.755290 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.755266    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a375fa0-6b6976876f-25vzw"]
Sep 09 16:27:01.762536 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.762515    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"]
Sep 09 16:27:01.769659 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.769626    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a375fa0-5f8db7c6d5-fb54f"]
Sep 09 16:27:01.781869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.781849    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"]
Sep 09 16:27:01.786060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.786040    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-743aed-c6bdb7499-znlrq"]
Sep 09 16:27:01.796427 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.796406    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"]
Sep 09 16:27:01.798789 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:01.798758    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-743aed-f98c89b9c-rc2st"]
Sep 09 16:27:02.182813 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.182754    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:02.675076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.675040    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:02.740014 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.739984    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="260ec0b7-4831-4692-8473-34b0d3ddb8d2" path="/var/lib/kubelet/pods/260ec0b7-4831-4692-8473-34b0d3ddb8d2/volumes"
Sep 09 16:27:02.740415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.740402    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66d09dfd-5445-4a20-91a2-b8734da79ee6" path="/var/lib/kubelet/pods/66d09dfd-5445-4a20-91a2-b8734da79ee6/volumes"
Sep 09 16:27:02.740751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.740739    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" path="/var/lib/kubelet/pods/c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a/volumes"
Sep 09 16:27:02.741372 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.741357    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb1582ad-3107-4582-944b-caa1bdf752c7" path="/var/lib/kubelet/pods/cb1582ad-3107-4582-944b-caa1bdf752c7/volumes"
Sep 09 16:27:02.994840 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.994750    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"]
Sep 09 16:27:02.995464 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995447    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d09dfd-5445-4a20-91a2-b8734da79ee6" containerName="maas-api"
Sep 09 16:27:02.995516 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995467    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d09dfd-5445-4a20-91a2-b8734da79ee6" containerName="maas-api"
Sep 09 16:27:02.995516 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995503    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" containerName="maas-api"
Sep 09 16:27:02.995638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995512    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" containerName="maas-api"
Sep 09 16:27:02.995638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995534    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260ec0b7-4831-4692-8473-34b0d3ddb8d2" containerName="payload-processing"
Sep 09 16:27:02.995638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995543    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="260ec0b7-4831-4692-8473-34b0d3ddb8d2" containerName="payload-processing"
Sep 09 16:27:02.995638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995574    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb1582ad-3107-4582-944b-caa1bdf752c7" containerName="payload-processing"
Sep 09 16:27:02.995638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995584    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb1582ad-3107-4582-944b-caa1bdf752c7" containerName="payload-processing"
Sep 09 16:27:02.995949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995682    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb1582ad-3107-4582-944b-caa1bdf752c7" containerName="payload-processing"
Sep 09 16:27:02.995949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995696    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8a5df0e-3e2f-4933-a7a3-8ebbec9b987a" containerName="maas-api"
Sep 09 16:27:02.995949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995706    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="260ec0b7-4831-4692-8473-34b0d3ddb8d2" containerName="payload-processing"
Sep 09 16:27:02.995949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:02.995716    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="66d09dfd-5445-4a20-91a2-b8734da79ee6" containerName="maas-api"
Sep 09 16:27:03.001149 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.001126    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.003478 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.003456    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2dc4f62b-openshift-default-dockercfg-t5t6d\""
Sep 09 16:27:03.010109 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.010088    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"]
Sep 09 16:27:03.022366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.022338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:03.095965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.095930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-socket\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.095965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.095967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-istio-token\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.096204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.096006    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319dc766-4b28-409b-b115-cd0169201269-istiod-ca-cert\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.096204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.096070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-envoy\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.096204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.096119    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp7xw\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-kube-api-access-zp7xw\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.096204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.096149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-data\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.096336 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.096212    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-certs\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.096336 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.096276    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319dc766-4b28-409b-b115-cd0169201269-istio-podinfo\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.096336 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.096322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-credential-socket\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197035 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197001    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-socket\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197035 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-istio-token\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197271 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197080    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319dc766-4b28-409b-b115-cd0169201269-istiod-ca-cert\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197271 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197114    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-envoy\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197271 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp7xw\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-kube-api-access-zp7xw\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197271 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-data\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197404    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-certs\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197530 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197473    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319dc766-4b28-409b-b115-cd0169201269-istio-podinfo\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-data\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-credential-socket\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197476    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-socket\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197723    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-certs\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.197893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.197876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-credential-socket\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.198062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.198041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319dc766-4b28-409b-b115-cd0169201269-istiod-ca-cert\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.199367 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.199348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-envoy\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.199856 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.199835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319dc766-4b28-409b-b115-cd0169201269-istio-podinfo\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.205719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.205690    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp7xw\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-kube-api-access-zp7xw\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.205819 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.205697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-istio-token\") pod \"e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") " pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.315647 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.315561    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:03.599784 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.599677    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"]
Sep 09 16:27:03.602841 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:27:03.602810    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319dc766_4b28_409b_b115_cd0169201269.slice/crio-b7d2fdbb50a369562fa862962359f2c284a2d4d895f94fb9d13d56bd07ac54da WatchSource:0}: Error finding container b7d2fdbb50a369562fa862962359f2c284a2d4d895f94fb9d13d56bd07ac54da: Status 404 returned error can't find the container with id b7d2fdbb50a369562fa862962359f2c284a2d4d895f94fb9d13d56bd07ac54da
Sep 09 16:27:03.605202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.605170    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:27:03.605290 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.605252    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:27:03.605348 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.605293    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:27:03.747907 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.747871    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" event={"ID":"319dc766-4b28-409b-b115-cd0169201269","Type":"ContainerStarted","Data":"47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c"}
Sep 09 16:27:03.748304 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.747930    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" event={"ID":"319dc766-4b28-409b-b115-cd0169201269","Type":"ContainerStarted","Data":"b7d2fdbb50a369562fa862962359f2c284a2d4d895f94fb9d13d56bd07ac54da"}
Sep 09 16:27:03.771051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:03.770977    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" podStartSLOduration=1.770955619 podStartE2EDuration="1.770955619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:27:03.766408099 +0000 UTC m=+1121.537499357" watchObservedRunningTime="2026-09-09 16:27:03.770955619 +0000 UTC m=+1121.542046900"
Sep 09 16:27:04.021351 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:04.021312    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:04.316150 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:04.316073    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:04.321066 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:04.321040    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:04.759922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:04.759891    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:04.761094 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:04.761074    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:05.118181 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:05.118100    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:05.267674 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:05.267637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:05.661020 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:05.660981    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:06.416289 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.416247    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"]
Sep 09 16:27:06.420175 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.420156    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.422275 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.422252    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2dc4f62b-serving-cert\""
Sep 09 16:27:06.431806 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.431745    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"]
Sep 09 16:27:06.529067 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.529037    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-metrics-certs\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.529244 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.529096    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7012ebd7-e917-4682-a5ea-cf7682f6f587-openshift-service-ca\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.529335 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.529245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cxm2\" (UniqueName: \"kubernetes.io/projected/7012ebd7-e917-4682-a5ea-cf7682f6f587-kube-api-access-9cxm2\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.529396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.529340    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.613070 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.613015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:06.630098 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.630068    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cxm2\" (UniqueName: \"kubernetes.io/projected/7012ebd7-e917-4682-a5ea-cf7682f6f587-kube-api-access-9cxm2\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.630227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.630127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.630227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.630193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-metrics-certs\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.630333 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:27:06.630240    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-serving-cert: secret "maas-api-e2e-derive-2dc4f62b-serving-cert" not found
Sep 09 16:27:06.630333 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.630258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7012ebd7-e917-4682-a5ea-cf7682f6f587-openshift-service-ca\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.630333 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:27:06.630320    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls podName:7012ebd7-e917-4682-a5ea-cf7682f6f587 nodeName:}" failed. No retries permitted until 2026-09-09 16:27:07.130297753 +0000 UTC m=+1124.901388998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls") pod "maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96" (UID: "7012ebd7-e917-4682-a5ea-cf7682f6f587") : secret "maas-api-e2e-derive-2dc4f62b-serving-cert" not found
Sep 09 16:27:06.631015 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.630996    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7012ebd7-e917-4682-a5ea-cf7682f6f587-openshift-service-ca\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.632690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.632667    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-metrics-certs\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.638704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.638680    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cxm2\" (UniqueName: \"kubernetes.io/projected/7012ebd7-e917-4682-a5ea-cf7682f6f587-kube-api-access-9cxm2\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:06.713644 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.713562    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:06.827886 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:06.827857    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:07.079189 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:07.079096    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:07.135963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:07.135930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:07.138236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:07.138208    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls\") pod \"maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:07.177124 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:07.177097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:07.332095 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:07.332009    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:07.622752 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:07.622725    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"]
Sep 09 16:27:07.624547 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:27:07.624522    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7012ebd7_e917_4682_a5ea_cf7682f6f587.slice/crio-f511ade115e04ef5e4f1aa1ff8153c0d29eecc50b465a71c2d9186fed52da264 WatchSource:0}: Error finding container f511ade115e04ef5e4f1aa1ff8153c0d29eecc50b465a71c2d9186fed52da264: Status 404 returned error can't find the container with id f511ade115e04ef5e4f1aa1ff8153c0d29eecc50b465a71c2d9186fed52da264
Sep 09 16:27:07.782916 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:07.782873    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96" event={"ID":"7012ebd7-e917-4682-a5ea-cf7682f6f587","Type":"ContainerStarted","Data":"f511ade115e04ef5e4f1aa1ff8153c0d29eecc50b465a71c2d9186fed52da264"}
Sep 09 16:27:08.222400 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:08.222361    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:08.288886 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:08.288798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:08.494609 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:08.494579    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:08.791007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:08.790970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96" event={"ID":"7012ebd7-e917-4682-a5ea-cf7682f6f587","Type":"ContainerStarted","Data":"f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63"}
Sep 09 16:27:08.791396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:08.791078    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:08.808928 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:08.808881    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96" podStartSLOduration=2.415552419 podStartE2EDuration="2.808865924s" totalImagesPullingTime="393.313505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:27:08.808114629 +0000 UTC m=+1126.579205876" watchObservedRunningTime="2026-09-09 16:27:08.808865924 +0000 UTC m=+1126.579957170"
Sep 09 16:27:08.970352 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:08.970324    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:09.285291 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:09.285260    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:10.595902 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:10.595865    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:12.666936 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:12.666888    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:12.767009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:12.766975    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:13.921973 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:13.921943    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"]
Sep 09 16:27:13.926110 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:13.926081    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:13.928569 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:13.928523    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-3ad4f1-serving-cert\""
Sep 09 16:27:13.938976 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:13.938940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"]
Sep 09 16:27:13.951864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:13.951830    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:14.001298 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.001272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8lpj\" (UniqueName: \"kubernetes.io/projected/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-kube-api-access-t8lpj\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.001425 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.001316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-metrics-certs\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.001425 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.001381    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-openshift-service-ca\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.001519 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.001440    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-maas-api-tls\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.010860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.010817    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:14.102058 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.102021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-maas-api-tls\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.102237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.102123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8lpj\" (UniqueName: \"kubernetes.io/projected/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-kube-api-access-t8lpj\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.102237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.102191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-metrics-certs\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.102365 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.102257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-openshift-service-ca\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.102979 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.102955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-openshift-service-ca\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.105153 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.105131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-metrics-certs\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.105253 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.105159    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-maas-api-tls\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.110374 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.110348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8lpj\" (UniqueName: \"kubernetes.io/projected/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-kube-api-access-t8lpj\") pod \"maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.240870 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.240795    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:14.494799 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.494706    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:14.517705 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.517670    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"]
Sep 09 16:27:14.518767 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:27:14.518734    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2b6f15_c7bf_4a5a_90c8_54b7a3bb59e0.slice/crio-ed4d4374d15e71a806d0d7fdf02b8d3591038072eaef9871628eeb0abda0d665 WatchSource:0}: Error finding container ed4d4374d15e71a806d0d7fdf02b8d3591038072eaef9871628eeb0abda0d665: Status 404 returned error can't find the container with id ed4d4374d15e71a806d0d7fdf02b8d3591038072eaef9871628eeb0abda0d665
Sep 09 16:27:14.585237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.585193    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:14.803506 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.803430    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:14.832428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:14.832392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7" event={"ID":"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0","Type":"ContainerStarted","Data":"ed4d4374d15e71a806d0d7fdf02b8d3591038072eaef9871628eeb0abda0d665"}
Sep 09 16:27:15.843512 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:15.843481    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7" event={"ID":"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0","Type":"ContainerStarted","Data":"89960e63ae0fed74c65f0caaf8674a9b39d662ddd5c0a46f0086dcd72810da99"}
Sep 09 16:27:15.843909 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:15.843592    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:15.860254 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:15.860201    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7" podStartSLOduration=2.212889775 podStartE2EDuration="2.86018477s" totalImagesPullingTime="647.294995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:27:15.86006969 +0000 UTC m=+1133.631160938" watchObservedRunningTime="2026-09-09 16:27:15.86018477 +0000 UTC m=+1133.631276016"
Sep 09 16:27:21.861437 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:21.861409    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:27:22.047601 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:22.047564    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:23.609975 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:23.609888    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:26.936501 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:26.936468    2567 generic.go:356] "Generic (PLEG): container finished" podID="319dc766-4b28-409b-b115-cd0169201269" containerID="47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c" exitCode=0
Sep 09 16:27:26.936920 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:26.936542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" event={"ID":"319dc766-4b28-409b-b115-cd0169201269","Type":"ContainerDied","Data":"47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c"}
Sep 09 16:27:26.937030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:26.937012    2567 scope.go:117] "RemoveContainer" containerID="47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c"
Sep 09 16:27:26.938163 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:26.938126    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:27:26.938232 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:26.938205    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:27:26.938269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:26.938237    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:27:27.545381 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:27.545328    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:27.944627 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:27.944593    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" event={"ID":"319dc766-4b28-409b-b115-cd0169201269","Type":"ContainerStarted","Data":"bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b"}
Sep 09 16:27:28.316372 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:28.316287    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:28.316517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:28.316459    2567 patch_prober.go:28] interesting pod/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 09 16:27:28.316517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:28.316495    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 09 16:27:29.316318 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:29.316283    2567 patch_prober.go:28] interesting pod/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 09 16:27:29.316895 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:29.316346    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 09 16:27:30.316876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:30.316841    2567 patch_prober.go:28] interesting pod/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 09 16:27:30.317261 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:30.316909    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 09 16:27:31.316955 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:31.316906    2567 patch_prober.go:28] interesting pod/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 09 16:27:31.317334 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:31.316988    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 09 16:27:32.316645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:32.316608    2567 patch_prober.go:28] interesting pod/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 09 16:27:32.316866 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:32.316669    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 09 16:27:33.319942 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:33.319912    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:33.320368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:33.320348    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:33.321026 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:33.321008    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:34.814118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:34.814066    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:36.508386 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:36.508331    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:37.140893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.140857    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"]
Sep 09 16:27:37.141117 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.141077    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96" podUID="7012ebd7-e917-4682-a5ea-cf7682f6f587" containerName="maas-api" containerID="cri-o://f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63" gracePeriod=30
Sep 09 16:27:37.167155 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.167126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:37.240205 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.240135    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:37.335841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.335807    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:37.390949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.390890    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:37.411847 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.411525    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:37.461246 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.461195    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7012ebd7-e917-4682-a5ea-cf7682f6f587-openshift-service-ca\") pod \"7012ebd7-e917-4682-a5ea-cf7682f6f587\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") "
Sep 09 16:27:37.461423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.461285    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cxm2\" (UniqueName: \"kubernetes.io/projected/7012ebd7-e917-4682-a5ea-cf7682f6f587-kube-api-access-9cxm2\") pod \"7012ebd7-e917-4682-a5ea-cf7682f6f587\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") "
Sep 09 16:27:37.461423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.461348    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-metrics-certs\") pod \"7012ebd7-e917-4682-a5ea-cf7682f6f587\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") "
Sep 09 16:27:37.461423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.461421    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls\") pod \"7012ebd7-e917-4682-a5ea-cf7682f6f587\" (UID: \"7012ebd7-e917-4682-a5ea-cf7682f6f587\") "
Sep 09 16:27:37.461605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.461565    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7012ebd7-e917-4682-a5ea-cf7682f6f587-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7012ebd7-e917-4682-a5ea-cf7682f6f587" (UID: "7012ebd7-e917-4682-a5ea-cf7682f6f587"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:27:37.461885 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.461857    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7012ebd7-e917-4682-a5ea-cf7682f6f587-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:37.463736 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.463705    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7012ebd7-e917-4682-a5ea-cf7682f6f587" (UID: "7012ebd7-e917-4682-a5ea-cf7682f6f587"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:27:37.464088 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.464064    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7012ebd7-e917-4682-a5ea-cf7682f6f587" (UID: "7012ebd7-e917-4682-a5ea-cf7682f6f587"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:27:37.464165 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.464120    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7012ebd7-e917-4682-a5ea-cf7682f6f587-kube-api-access-9cxm2" (OuterVolumeSpecName: "kube-api-access-9cxm2") pod "7012ebd7-e917-4682-a5ea-cf7682f6f587" (UID: "7012ebd7-e917-4682-a5ea-cf7682f6f587"). InnerVolumeSpecName "kube-api-access-9cxm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:27:37.507439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.507402    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"]
Sep 09 16:27:37.507703 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.507666    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy" containerID="cri-o://bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b" gracePeriod=30
Sep 09 16:27:37.562541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.562510    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cxm2\" (UniqueName: \"kubernetes.io/projected/7012ebd7-e917-4682-a5ea-cf7682f6f587-kube-api-access-9cxm2\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:37.562541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.562539    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:37.562541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:37.562550    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7012ebd7-e917-4682-a5ea-cf7682f6f587-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:38.027049 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.027018    2567 generic.go:356] "Generic (PLEG): container finished" podID="7012ebd7-e917-4682-a5ea-cf7682f6f587" containerID="f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63" exitCode=0
Sep 09 16:27:38.027201 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.027064    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"
Sep 09 16:27:38.027201 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.027112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96" event={"ID":"7012ebd7-e917-4682-a5ea-cf7682f6f587","Type":"ContainerDied","Data":"f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63"}
Sep 09 16:27:38.027201 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.027159    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96" event={"ID":"7012ebd7-e917-4682-a5ea-cf7682f6f587","Type":"ContainerDied","Data":"f511ade115e04ef5e4f1aa1ff8153c0d29eecc50b465a71c2d9186fed52da264"}
Sep 09 16:27:38.027201 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.027184    2567 scope.go:117] "RemoveContainer" containerID="f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63"
Sep 09 16:27:38.037468 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.037452    2567 scope.go:117] "RemoveContainer" containerID="f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63"
Sep 09 16:27:38.037732 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:27:38.037715    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63\": container with ID starting with f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63 not found: ID does not exist" containerID="f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63"
Sep 09 16:27:38.037886 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.037739    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63"} err="failed to get container status \"f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63\": rpc error: code = NotFound desc = could not find container \"f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63\": container with ID starting with f8de60d7a405829e111c09408ec6a77248d56e4e1ce656301ef1090f70400e63 not found: ID does not exist"
Sep 09 16:27:38.049727 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.049705    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"]
Sep 09 16:27:38.056233 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.056208    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dc4f62b-b58bcfcd4-h4w96"]
Sep 09 16:27:38.166151 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.166120    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:38.278914 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.278837    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:38.420202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.420165    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:38.590594 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.590518    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:38.738324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:38.738290    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7012ebd7-e917-4682-a5ea-cf7682f6f587" path="/var/lib/kubelet/pods/7012ebd7-e917-4682-a5ea-cf7682f6f587/volumes"
Sep 09 16:27:39.902921 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:39.902889    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:42.772189 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.772129    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:42.816872 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.816845    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-socket\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817038 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.816903    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-certs\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817038 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.816921    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-data\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817038 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.816969    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-istio-token\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817038 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.816996    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-credential-socket\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817038 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817020    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-envoy\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817377 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817112    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319dc766-4b28-409b-b115-cd0169201269-istio-podinfo\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817377 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319dc766-4b28-409b-b115-cd0169201269-istiod-ca-cert\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817377 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817172    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp7xw\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-kube-api-access-zp7xw\") pod \"319dc766-4b28-409b-b115-cd0169201269\" (UID: \"319dc766-4b28-409b-b115-cd0169201269\") "
Sep 09 16:27:42.817377 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817195    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:27:42.817377 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817237    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:27:42.817377 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817322    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:27:42.817672 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817542    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319dc766-4b28-409b-b115-cd0169201269-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:27:42.817672 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817649    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319dc766-4b28-409b-b115-cd0169201269-istiod-ca-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:42.817832 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817675    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:42.817832 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817688    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-workload-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:42.817832 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817718    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-credential-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:42.818001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.817909    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-data" (OuterVolumeSpecName: "istio-data") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:27:42.819661 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.819627    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:27:42.819843 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.819746    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/319dc766-4b28-409b-b115-cd0169201269-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:27:42.819843 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.819759    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-kube-api-access-zp7xw" (OuterVolumeSpecName: "kube-api-access-zp7xw") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "kube-api-access-zp7xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:27:42.819843 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.819793    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-istio-token" (OuterVolumeSpecName: "istio-token") pod "319dc766-4b28-409b-b115-cd0169201269" (UID: "319dc766-4b28-409b-b115-cd0169201269"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:27:42.918368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.918339    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-data\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:42.918368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.918365    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-istio-token\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:42.918368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.918376    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319dc766-4b28-409b-b115-cd0169201269-istio-envoy\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:42.918608 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.918384    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319dc766-4b28-409b-b115-cd0169201269-istio-podinfo\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:42.918608 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:42.918394    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp7xw\" (UniqueName: \"kubernetes.io/projected/319dc766-4b28-409b-b115-cd0169201269-kube-api-access-zp7xw\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:27:43.061928 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.061842    2567 generic.go:356] "Generic (PLEG): container finished" podID="319dc766-4b28-409b-b115-cd0169201269" containerID="bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b" exitCode=0
Sep 09 16:27:43.061928 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.061896    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"
Sep 09 16:27:43.062121 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.061922    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" event={"ID":"319dc766-4b28-409b-b115-cd0169201269","Type":"ContainerDied","Data":"bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b"}
Sep 09 16:27:43.062121 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.061975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8" event={"ID":"319dc766-4b28-409b-b115-cd0169201269","Type":"ContainerDied","Data":"b7d2fdbb50a369562fa862962359f2c284a2d4d895f94fb9d13d56bd07ac54da"}
Sep 09 16:27:43.062121 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.061998    2567 scope.go:117] "RemoveContainer" containerID="bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b"
Sep 09 16:27:43.072410 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.072392    2567 scope.go:117] "RemoveContainer" containerID="47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c"
Sep 09 16:27:43.081622 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.081602    2567 scope.go:117] "RemoveContainer" containerID="bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b"
Sep 09 16:27:43.082019 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:27:43.081986    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b\": container with ID starting with bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b not found: ID does not exist" containerID="bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b"
Sep 09 16:27:43.082077 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.082029    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b"} err="failed to get container status \"bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b\": rpc error: code = NotFound desc = could not find container \"bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b\": container with ID starting with bfc9d8d1a6c196c8c39747b78fe224371a9fe62aa687fac01ea9c21c7a6e468b not found: ID does not exist"
Sep 09 16:27:43.082077 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.082048    2567 scope.go:117] "RemoveContainer" containerID="47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c"
Sep 09 16:27:43.082339 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:27:43.082321    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c\": container with ID starting with 47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c not found: ID does not exist" containerID="47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c"
Sep 09 16:27:43.082385 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.082346    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c"} err="failed to get container status \"47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c\": rpc error: code = NotFound desc = could not find container \"47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c\": container with ID starting with 47490a7d95ef6a47b2ef3e84914bcfd97bb286a1884ba7d42b1f546957a6131c not found: ID does not exist"
Sep 09 16:27:43.087064 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.087032    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"]
Sep 09 16:27:43.091113 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.091090    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2dc4f62b-openshift-default-d7d5c647b-jmgn8"]
Sep 09 16:27:43.415062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:43.415032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:44.738134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:44.738096    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="319dc766-4b28-409b-b115-cd0169201269" path="/var/lib/kubelet/pods/319dc766-4b28-409b-b115-cd0169201269/volumes"
Sep 09 16:27:46.012844 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:46.012808    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:46.081856 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:46.081810    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:46.186660 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:46.186617    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:46.277977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:46.277886    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:46.753511 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:46.753474    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:54.708635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:27:54.708604    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:00.446909 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:00.446872    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:00.638365 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:00.638330    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:08.504039 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:08.504006    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:10.985512 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:10.985477    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"]
Sep 09 16:28:10.986071 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:10.985698    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7" podUID="1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" containerName="maas-api" containerID="cri-o://89960e63ae0fed74c65f0caaf8674a9b39d662ddd5c0a46f0086dcd72810da99" gracePeriod=30
Sep 09 16:28:11.007719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.007690    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:11.247292 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.247263    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" containerID="89960e63ae0fed74c65f0caaf8674a9b39d662ddd5c0a46f0086dcd72810da99" exitCode=0
Sep 09 16:28:11.247427 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.247340    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7" event={"ID":"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0","Type":"ContainerDied","Data":"89960e63ae0fed74c65f0caaf8674a9b39d662ddd5c0a46f0086dcd72810da99"}
Sep 09 16:28:11.247427 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.247389    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7" event={"ID":"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0","Type":"ContainerDied","Data":"ed4d4374d15e71a806d0d7fdf02b8d3591038072eaef9871628eeb0abda0d665"}
Sep 09 16:28:11.247427 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.247410    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed4d4374d15e71a806d0d7fdf02b8d3591038072eaef9871628eeb0abda0d665"
Sep 09 16:28:11.256567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.256543    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:28:11.303475 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.303443    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-metrics-certs\") pod \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") "
Sep 09 16:28:11.303644 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.303588    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-maas-api-tls\") pod \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") "
Sep 09 16:28:11.303706 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.303639    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-openshift-service-ca\") pod \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") "
Sep 09 16:28:11.303706 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.303681    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8lpj\" (UniqueName: \"kubernetes.io/projected/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-kube-api-access-t8lpj\") pod \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\" (UID: \"1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0\") "
Sep 09 16:28:11.304082 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.304056    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" (UID: "1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:28:11.305807 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.305756    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" (UID: "1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:28:11.305807 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.305793    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" (UID: "1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:28:11.305807 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.305762    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-kube-api-access-t8lpj" (OuterVolumeSpecName: "kube-api-access-t8lpj") pod "1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" (UID: "1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0"). InnerVolumeSpecName "kube-api-access-t8lpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:28:11.405491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.405453    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:11.405491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.405496    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:11.405703 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.405507    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:11.405703 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:11.405517    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8lpj\" (UniqueName: \"kubernetes.io/projected/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0-kube-api-access-t8lpj\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:12.012869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:12.012831    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:12.112789 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:12.112752    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:12.255449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:12.255412    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"
Sep 09 16:28:12.280227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:12.280200    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"]
Sep 09 16:28:12.284320 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:12.284295    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3ad4f1-86bb49fbc5-d9sq7"]
Sep 09 16:28:12.708759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:12.708727    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:12.744165 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:12.744126    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" path="/var/lib/kubelet/pods/1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0/volumes"
Sep 09 16:28:17.423067 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:17.423031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:17.488178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:17.488107    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:17.753229 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:17.753129    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:18.168715 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.168685    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:18.442473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.442380    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"]
Sep 09 16:28:18.442956 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.442940    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy"
Sep 09 16:28:18.442956 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.442956    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy"
Sep 09 16:28:18.443072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.442974    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" containerName="maas-api"
Sep 09 16:28:18.443072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.442981    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" containerName="maas-api"
Sep 09 16:28:18.443072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.442997    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7012ebd7-e917-4682-a5ea-cf7682f6f587" containerName="maas-api"
Sep 09 16:28:18.443072 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.443003    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7012ebd7-e917-4682-a5ea-cf7682f6f587" containerName="maas-api"
Sep 09 16:28:18.443284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.443084    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7012ebd7-e917-4682-a5ea-cf7682f6f587" containerName="maas-api"
Sep 09 16:28:18.443284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.443091    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2b6f15-c7bf-4a5a-90c8-54b7a3bb59e0" containerName="maas-api"
Sep 09 16:28:18.443284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.443097    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy"
Sep 09 16:28:18.443284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.443104    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy"
Sep 09 16:28:18.447460 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.447437    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.449818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.449798    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-639363-openshift-default-dockercfg-wgwqn\""
Sep 09 16:28:18.460929 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.460891    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"]
Sep 09 16:28:18.475077 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.475048    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:18.575137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575086    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8jps\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-kube-api-access-s8jps\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.575323 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-credential-socket\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.575323 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575251    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-envoy\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.575323 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-podinfo\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.575450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575327    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istiod-ca-cert\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.575450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-socket\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.575450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575390    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-token\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.575548 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-data\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.575548 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.575485    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-certs\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.660662 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.660571    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:18.676862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.676822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-credential-socket\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677046 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.676868    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-envoy\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677046 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.676908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-podinfo\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677046 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.676935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istiod-ca-cert\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677046 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.676961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-socket\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677105    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-token\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-data\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677229    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-certs\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677270    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-credential-socket\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-socket\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8jps\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-kube-api-access-s8jps\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677499    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-data\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677700 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677647    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-certs\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.677870 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.677846    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istiod-ca-cert\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.679356 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.679336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-envoy\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.679551 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.679534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-podinfo\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.689896 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.689873    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8jps\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-kube-api-access-s8jps\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.689994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.689874    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-token\") pod \"e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") " pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.762152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.762064    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:18.991171 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:18.991135    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:19.049979 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.049955    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"]
Sep 09 16:28:19.052632 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:28:19.052598    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa90fdc8_ec14_4a5e_b788_bb4a19aaf0f6.slice/crio-322228aacb467fafbb724170222bc1189852dd35de348be217968b8918f32c63 WatchSource:0}: Error finding container 322228aacb467fafbb724170222bc1189852dd35de348be217968b8918f32c63: Status 404 returned error can't find the container with id 322228aacb467fafbb724170222bc1189852dd35de348be217968b8918f32c63
Sep 09 16:28:19.055715 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.055671    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:28:19.055835 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.055766    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:28:19.055892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.055835    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:28:19.121126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.121092    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:19.311950 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.311853    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2" event={"ID":"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6","Type":"ContainerStarted","Data":"ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166"}
Sep 09 16:28:19.311950 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.311911    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2" event={"ID":"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6","Type":"ContainerStarted","Data":"322228aacb467fafbb724170222bc1189852dd35de348be217968b8918f32c63"}
Sep 09 16:28:19.374103 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.374032    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2" podStartSLOduration=1.374007454 podStartE2EDuration="1.374007454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:28:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:28:19.372161242 +0000 UTC m=+1197.143252501" watchObservedRunningTime="2026-09-09 16:28:19.374007454 +0000 UTC m=+1197.145098702"
Sep 09 16:28:19.762953 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:19.762917    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:20.220751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:20.220715    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:20.318851 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:20.318802    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:20.536897 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:20.536802    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:20.768254 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:20.768223    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:21.326193 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:21.326154    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:21.327237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:21.327217    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:30.738567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:30.738529    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:32.845160 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:32.845124    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"]
Sep 09 16:28:32.845627 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:32.845363    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2" podUID="aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" containerName="istio-proxy" containerID="cri-o://ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166" gracePeriod=30
Sep 09 16:28:34.202583 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:34.202545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:34.253586 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:34.253550    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:35.147438 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:35.147401    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:36.328197 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:36.328164    2567 patch_prober.go:28] interesting pod/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 16:28:36.328562 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:36.328254    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2" podUID="aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:28:38.113731 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.113665    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:38.279130 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279100    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-podinfo\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279130 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-certs\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279162    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-token\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279196    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-envoy\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279218    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-socket\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279275    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-credential-socket\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279302    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istiod-ca-cert\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279339    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8jps\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-kube-api-access-s8jps\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279377    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-data\") pod \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\" (UID: \"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6\") "
Sep 09 16:28:38.279759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279470    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:28:38.279759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279595    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:28:38.279908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279811    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:28:38.279908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279828    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:28:38.280030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279960    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-data\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.280030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279980    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.280030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.279996    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-workload-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.280030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.280010    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-credential-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.280240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.280201    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:28:38.281417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.281387    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:28:38.281563 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.281544    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:28:38.281623 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.281591    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:28:38.281660 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.281628    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-kube-api-access-s8jps" (OuterVolumeSpecName: "kube-api-access-s8jps") pod "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" (UID: "aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6"). InnerVolumeSpecName "kube-api-access-s8jps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:28:38.381407 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.381372    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istiod-ca-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.381407 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.381403    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8jps\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-kube-api-access-s8jps\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.381586 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.381418    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-podinfo\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.381586 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.381429    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-token\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.381586 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.381438    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6-istio-envoy\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:28:38.435917 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.435882    2567 generic.go:356] "Generic (PLEG): container finished" podID="aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" containerID="ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166" exitCode=0
Sep 09 16:28:38.436076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.435932    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"
Sep 09 16:28:38.436076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.435947    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2" event={"ID":"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6","Type":"ContainerDied","Data":"ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166"}
Sep 09 16:28:38.436076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.435990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2" event={"ID":"aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6","Type":"ContainerDied","Data":"322228aacb467fafbb724170222bc1189852dd35de348be217968b8918f32c63"}
Sep 09 16:28:38.436076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.436011    2567 scope.go:117] "RemoveContainer" containerID="ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166"
Sep 09 16:28:38.446347 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.446329    2567 scope.go:117] "RemoveContainer" containerID="ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166"
Sep 09 16:28:38.446653 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:28:38.446632    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166\": container with ID starting with ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166 not found: ID does not exist" containerID="ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166"
Sep 09 16:28:38.446730 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.446660    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166"} err="failed to get container status \"ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166\": rpc error: code = NotFound desc = could not find container \"ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166\": container with ID starting with ffe5ee2f03945884674041ca1f983eeddfd53414eb194a0bc6dc1ad5ebb24166 not found: ID does not exist"
Sep 09 16:28:38.458624 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.458599    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"]
Sep 09 16:28:38.464488 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.464464    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-639363-openshift-default-7dd4b64c6d-g6jq2"]
Sep 09 16:28:38.738812 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.738725    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" path="/var/lib/kubelet/pods/aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6/volumes"
Sep 09 16:28:38.822902 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:38.822868    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:40.900664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:40.900626    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:40.961559 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:40.961527    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:41.035376 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:41.035340    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:41.136147 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:41.136119    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:51.650490 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:51.650454    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:51.767982 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:51.767952    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:52.489147 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:52.489111    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:52.724114 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:52.724072    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:54.611502 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:54.611462    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:58.194265 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:58.194230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:58.303122 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:58.303086    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:58.394371 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:58.394335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:58.495696 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:58.495612    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:59.151783 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:59.151725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:59.251037 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:59.251002    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:59.350524 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:28:59.350489    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:00.873605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:00.873572    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:03.360759 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.360723    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"]
Sep 09 16:29:03.361711 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.360948    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt" podUID="560e07a1-662f-425f-9b1a-8f3032522413" containerName="maas-api" containerID="cri-o://403e88ba89eca4c648d3502de0aaf02ec8a6cacd4a352b2b0336680bb4d7a00e" gracePeriod=30
Sep 09 16:29:03.377523 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.377488    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:03.600113 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.600080    2567 generic.go:356] "Generic (PLEG): container finished" podID="560e07a1-662f-425f-9b1a-8f3032522413" containerID="403e88ba89eca4c648d3502de0aaf02ec8a6cacd4a352b2b0336680bb4d7a00e" exitCode=0
Sep 09 16:29:03.600271 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.600150    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt" event={"ID":"560e07a1-662f-425f-9b1a-8f3032522413","Type":"ContainerDied","Data":"403e88ba89eca4c648d3502de0aaf02ec8a6cacd4a352b2b0336680bb4d7a00e"}
Sep 09 16:29:03.639208 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.639186    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:29:03.726058 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.726023    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560e07a1-662f-425f-9b1a-8f3032522413-openshift-service-ca\") pod \"560e07a1-662f-425f-9b1a-8f3032522413\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") "
Sep 09 16:29:03.726253 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.726149    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls\") pod \"560e07a1-662f-425f-9b1a-8f3032522413\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") "
Sep 09 16:29:03.726253 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.726226    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvcx9\" (UniqueName: \"kubernetes.io/projected/560e07a1-662f-425f-9b1a-8f3032522413-kube-api-access-fvcx9\") pod \"560e07a1-662f-425f-9b1a-8f3032522413\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") "
Sep 09 16:29:03.726387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.726310    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-metrics-certs\") pod \"560e07a1-662f-425f-9b1a-8f3032522413\" (UID: \"560e07a1-662f-425f-9b1a-8f3032522413\") "
Sep 09 16:29:03.726452 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.726412    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/560e07a1-662f-425f-9b1a-8f3032522413-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "560e07a1-662f-425f-9b1a-8f3032522413" (UID: "560e07a1-662f-425f-9b1a-8f3032522413"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:29:03.726697 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.726671    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560e07a1-662f-425f-9b1a-8f3032522413-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:29:03.728255 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.728224    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:03.728596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.728570    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "560e07a1-662f-425f-9b1a-8f3032522413" (UID: "560e07a1-662f-425f-9b1a-8f3032522413"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:29:03.728658 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.728604    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "560e07a1-662f-425f-9b1a-8f3032522413" (UID: "560e07a1-662f-425f-9b1a-8f3032522413"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:29:03.728925 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.728905    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/560e07a1-662f-425f-9b1a-8f3032522413-kube-api-access-fvcx9" (OuterVolumeSpecName: "kube-api-access-fvcx9") pod "560e07a1-662f-425f-9b1a-8f3032522413" (UID: "560e07a1-662f-425f-9b1a-8f3032522413"). InnerVolumeSpecName "kube-api-access-fvcx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:29:03.818477 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.818444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:03.828249 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.828223    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:29:03.828249 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.828244    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560e07a1-662f-425f-9b1a-8f3032522413-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:29:03.828451 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.828255    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvcx9\" (UniqueName: \"kubernetes.io/projected/560e07a1-662f-425f-9b1a-8f3032522413-kube-api-access-fvcx9\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:29:03.940354 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:03.940320    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:04.608173 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:04.608142    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"
Sep 09 16:29:04.608575 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:04.608172    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt" event={"ID":"560e07a1-662f-425f-9b1a-8f3032522413","Type":"ContainerDied","Data":"9055f5cdbc894c5d7cd9cff123dd34c8abf514da6008e7883154894128357165"}
Sep 09 16:29:04.608575 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:04.608228    2567 scope.go:117] "RemoveContainer" containerID="403e88ba89eca4c648d3502de0aaf02ec8a6cacd4a352b2b0336680bb4d7a00e"
Sep 09 16:29:04.635551 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:04.635523    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"]
Sep 09 16:29:04.639388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:04.639354    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d44b6-856ffc8f69-swhlt"]
Sep 09 16:29:04.740922 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:04.740890    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="560e07a1-662f-425f-9b1a-8f3032522413" path="/var/lib/kubelet/pods/560e07a1-662f-425f-9b1a-8f3032522413/volumes"
Sep 09 16:29:06.427439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:06.427411    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:06.492170 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:06.492139    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:07.163818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:07.163782    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:09.671850 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:09.671820    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:09.730026 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:09.729992    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:09.924032 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:09.923947    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:10.384429 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:10.384393    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:11.675287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:11.675251    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:13.006458 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.006423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:13.067924 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.067890    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:13.246277 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.246246    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:13.529260 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.529225    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"]
Sep 09 16:29:13.530041 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.529991    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="560e07a1-662f-425f-9b1a-8f3032522413" containerName="maas-api"
Sep 09 16:29:13.530041 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.530015    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="560e07a1-662f-425f-9b1a-8f3032522413" containerName="maas-api"
Sep 09 16:29:13.530041 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.530037    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy"
Sep 09 16:29:13.530041 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.530043    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="319dc766-4b28-409b-b115-cd0169201269" containerName="istio-proxy"
Sep 09 16:29:13.530321 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.530050    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" containerName="istio-proxy"
Sep 09 16:29:13.530321 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.530056    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" containerName="istio-proxy"
Sep 09 16:29:13.530321 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.530170    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa90fdc8-ec14-4a5e-b788-bb4a19aaf0f6" containerName="istio-proxy"
Sep 09 16:29:13.530321 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.530182    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="560e07a1-662f-425f-9b1a-8f3032522413" containerName="maas-api"
Sep 09 16:29:13.535199 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.535173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.537892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.537869    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-13b02364-openshift-default-dockercfg-mfbff\""
Sep 09 16:29:13.546946 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.546921    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"]
Sep 09 16:29:13.557225 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.557197    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:13.626646 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626611    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istiod-ca-cert\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.626839 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626666    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-socket\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.626839 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-token\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.626839 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-podinfo\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.626839 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-certs\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.627036 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82cn7\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-kube-api-access-82cn7\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.627036 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626877    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-data\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.627036 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626893    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-envoy\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.627036 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.626923    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-credential-socket\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.656472 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.656437    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:13.728421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-certs\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.728421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82cn7\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-kube-api-access-82cn7\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.728744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-data\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.728744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-envoy\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.728744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-credential-socket\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.728744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istiod-ca-cert\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.728744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-socket\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.728744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-token\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.728744 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-podinfo\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.729112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-data\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.729112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-certs\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.729112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.728985    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-credential-socket\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.729112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.729032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-socket\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.729403 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.729380    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istiod-ca-cert\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.730976 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.730952    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-envoy\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.731056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.731012    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-podinfo\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.737307 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.737283    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-token\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.737509 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.737487    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82cn7\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-kube-api-access-82cn7\") pod \"e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") " pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:13.848883 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:13.848796    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:14.132065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:14.132038    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"]
Sep 09 16:29:14.133186 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:29:14.133158    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9fab37_6be1_4785_9d40_0b20f8c3164e.slice/crio-58f437cafbbcbc4b549990482dcb2eefa32c565730d447564a4611868ab88917 WatchSource:0}: Error finding container 58f437cafbbcbc4b549990482dcb2eefa32c565730d447564a4611868ab88917: Status 404 returned error can't find the container with id 58f437cafbbcbc4b549990482dcb2eefa32c565730d447564a4611868ab88917
Sep 09 16:29:14.135417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:14.135387    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:14.135482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:14.135452    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:14.135520 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:14.135480    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:14.674237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:14.674199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" event={"ID":"5a9fab37-6be1-4785-9d40-0b20f8c3164e","Type":"ContainerStarted","Data":"e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086"}
Sep 09 16:29:14.674415 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:14.674259    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" event={"ID":"5a9fab37-6be1-4785-9d40-0b20f8c3164e","Type":"ContainerStarted","Data":"58f437cafbbcbc4b549990482dcb2eefa32c565730d447564a4611868ab88917"}
Sep 09 16:29:14.694754 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:14.694702    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podStartSLOduration=1.694686558 podStartE2EDuration="1.694686558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:29:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:29:14.692311203 +0000 UTC m=+1252.463402461" watchObservedRunningTime="2026-09-09 16:29:14.694686558 +0000 UTC m=+1252.465777801"
Sep 09 16:29:14.849716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:14.849675    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:15.083785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:15.083627    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:15.854897 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:15.854854    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:16.626137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:16.626102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:16.687142 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:16.687104    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:16.688028 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:16.688005    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:16.723169 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:16.723131    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:17.778452 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:17.778421    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:17.876950 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:17.876914    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:18.203656 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:18.203615    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:18.306714 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:18.306677    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:18.381246 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:18.381218    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:20.417211 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:20.417168    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:21.050647 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.050606    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"]
Sep 09 16:29:21.050920 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.050868    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf" podUID="443ac23a-7218-4635-90c0-96d1fd7a7ae4" containerName="maas-api" containerID="cri-o://9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9" gracePeriod=30
Sep 09 16:29:21.069259 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.069228    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:21.146176 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.146141    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:21.208963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.208930    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:21.300258 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.300223    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:21.314386 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.314338    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:29:21.366565 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.366532    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:21.406685 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.406658    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mlr2\" (UniqueName: \"kubernetes.io/projected/443ac23a-7218-4635-90c0-96d1fd7a7ae4-kube-api-access-5mlr2\") pod \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") "
Sep 09 16:29:21.406877 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.406690    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls\") pod \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") "
Sep 09 16:29:21.406877 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.406754    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/443ac23a-7218-4635-90c0-96d1fd7a7ae4-openshift-service-ca\") pod \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") "
Sep 09 16:29:21.406877 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.406856    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-metrics-certs\") pod \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\" (UID: \"443ac23a-7218-4635-90c0-96d1fd7a7ae4\") "
Sep 09 16:29:21.407227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.407198    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/443ac23a-7218-4635-90c0-96d1fd7a7ae4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "443ac23a-7218-4635-90c0-96d1fd7a7ae4" (UID: "443ac23a-7218-4635-90c0-96d1fd7a7ae4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:29:21.407459 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.407413    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/443ac23a-7218-4635-90c0-96d1fd7a7ae4-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:29:21.409241 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.409213    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "443ac23a-7218-4635-90c0-96d1fd7a7ae4" (UID: "443ac23a-7218-4635-90c0-96d1fd7a7ae4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:29:21.409349 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.409240    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/443ac23a-7218-4635-90c0-96d1fd7a7ae4-kube-api-access-5mlr2" (OuterVolumeSpecName: "kube-api-access-5mlr2") pod "443ac23a-7218-4635-90c0-96d1fd7a7ae4" (UID: "443ac23a-7218-4635-90c0-96d1fd7a7ae4"). InnerVolumeSpecName "kube-api-access-5mlr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:29:21.409349 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.409281    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "443ac23a-7218-4635-90c0-96d1fd7a7ae4" (UID: "443ac23a-7218-4635-90c0-96d1fd7a7ae4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:29:21.508410 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.508374    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:29:21.508756 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.508417    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mlr2\" (UniqueName: \"kubernetes.io/projected/443ac23a-7218-4635-90c0-96d1fd7a7ae4-kube-api-access-5mlr2\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:29:21.508756 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.508432    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/443ac23a-7218-4635-90c0-96d1fd7a7ae4-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:29:21.667133 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.667081    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:21.721017 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.720983    2567 generic.go:356] "Generic (PLEG): container finished" podID="443ac23a-7218-4635-90c0-96d1fd7a7ae4" containerID="9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9" exitCode=0
Sep 09 16:29:21.721185 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.721031    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"
Sep 09 16:29:21.721185 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.721047    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf" event={"ID":"443ac23a-7218-4635-90c0-96d1fd7a7ae4","Type":"ContainerDied","Data":"9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9"}
Sep 09 16:29:21.721185 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.721102    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf" event={"ID":"443ac23a-7218-4635-90c0-96d1fd7a7ae4","Type":"ContainerDied","Data":"799b8c226c3da029cad8701dd7dad605b76abbd99ef472227948b81d3c4d7eab"}
Sep 09 16:29:21.721185 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.721125    2567 scope.go:117] "RemoveContainer" containerID="9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9"
Sep 09 16:29:21.731449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.731430    2567 scope.go:117] "RemoveContainer" containerID="9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9"
Sep 09 16:29:21.731735 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:29:21.731716    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9\": container with ID starting with 9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9 not found: ID does not exist" containerID="9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9"
Sep 09 16:29:21.731815 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.731743    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9"} err="failed to get container status \"9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9\": rpc error: code = NotFound desc = could not find container \"9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9\": container with ID starting with 9d017acb0c93269bb629c21a92904cc35c7d57b557a76bb216371d2fed3a96c9 not found: ID does not exist"
Sep 09 16:29:21.743097 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.743071    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"]
Sep 09 16:29:21.748926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:21.748899    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c23332-57ccf69cfb-c5djf"]
Sep 09 16:29:22.737446 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:22.737416    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="443ac23a-7218-4635-90c0-96d1fd7a7ae4" path="/var/lib/kubelet/pods/443ac23a-7218-4635-90c0-96d1fd7a7ae4/volumes"
Sep 09 16:29:26.162826 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:26.162764    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:27.429432 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:27.429399    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:27.529699 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:27.529668    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:27.693484 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:27.693388    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:28.553791 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.551265    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"]
Sep 09 16:29:28.565349 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.565317    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443ac23a-7218-4635-90c0-96d1fd7a7ae4" containerName="maas-api"
Sep 09 16:29:28.565538 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.565527    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="443ac23a-7218-4635-90c0-96d1fd7a7ae4" containerName="maas-api"
Sep 09 16:29:28.565825 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.565810    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="443ac23a-7218-4635-90c0-96d1fd7a7ae4" containerName="maas-api"
Sep 09 16:29:28.571074 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.571036    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"]
Sep 09 16:29:28.571208 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.571127    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.574198 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.574175    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-041bf1-openshift-default-dockercfg-85xdt\""
Sep 09 16:29:28.688694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.688661    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-data\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.688911 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.688714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-envoy\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.688911 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.688782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-token\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.688911 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.688812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-socket\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.688911 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.688894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f62cbe-45f8-49c4-8fea-d325085fb107-istiod-ca-cert\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.689076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.688953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-credential-socket\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.689076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.688986    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-certs\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.689076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.689063    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-podinfo\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.689189 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.689149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz8cs\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-kube-api-access-kz8cs\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.790426 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.790390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-data\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.790426 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.790440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-envoy\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.790694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.790475    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-token\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.790694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.790503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-socket\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.790694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.790532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f62cbe-45f8-49c4-8fea-d325085fb107-istiod-ca-cert\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.790902 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.790869    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-data\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.791042 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.791010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-credential-socket\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.791182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.791083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-certs\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.791182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.791173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-podinfo\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.791303 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.791227    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz8cs\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-kube-api-access-kz8cs\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.791303 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.791261    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f62cbe-45f8-49c4-8fea-d325085fb107-istiod-ca-cert\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.791439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.791418    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-credential-socket\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.791741 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.791715    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-socket\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.791902 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.791814    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-certs\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.793128 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.793108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-envoy\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.793654 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.793630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-podinfo\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.799013 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.798987    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-token\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.799566 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.799544    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz8cs\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-kube-api-access-kz8cs\") pod \"e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") " pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:28.883862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:28.883821    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:29.115267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.115224    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:29.168591 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.168555    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"]
Sep 09 16:29:29.169227 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:29:29.169197    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f62cbe_45f8_49c4_8fea_d325085fb107.slice/crio-60ad64bd68d62711940bc046e6bd13742218cf922856e2e306432c9f751442b0 WatchSource:0}: Error finding container 60ad64bd68d62711940bc046e6bd13742218cf922856e2e306432c9f751442b0: Status 404 returned error can't find the container with id 60ad64bd68d62711940bc046e6bd13742218cf922856e2e306432c9f751442b0
Sep 09 16:29:29.171559 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.171530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:29.172474 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.172442    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:29.172549 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.172525    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:29.172585 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.172570    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:29.792448 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.792409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" event={"ID":"c8f62cbe-45f8-49c4-8fea-d325085fb107","Type":"ContainerStarted","Data":"3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e"}
Sep 09 16:29:29.792853 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.792472    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" event={"ID":"c8f62cbe-45f8-49c4-8fea-d325085fb107","Type":"ContainerStarted","Data":"60ad64bd68d62711940bc046e6bd13742218cf922856e2e306432c9f751442b0"}
Sep 09 16:29:29.812429 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.812383    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podStartSLOduration=1.812367595 podStartE2EDuration="1.812367595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:29:29.810278653 +0000 UTC m=+1267.581369899" watchObservedRunningTime="2026-09-09 16:29:29.812367595 +0000 UTC m=+1267.583458841"
Sep 09 16:29:29.884064 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:29.884035    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:30.889940 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:30.889905    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:31.689186 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.689151    2567 patch_prober.go:28] interesting pod/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 09 16:29:31.689389 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.689209    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 09 16:29:31.750306 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.750267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:31.812996 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.812963    2567 generic.go:356] "Generic (PLEG): container finished" podID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerID="e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086" exitCode=0
Sep 09 16:29:31.813164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.813035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" event={"ID":"5a9fab37-6be1-4785-9d40-0b20f8c3164e","Type":"ContainerDied","Data":"e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086"}
Sep 09 16:29:31.813309 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.813287    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:31.813629 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.813605    2567 scope.go:117] "RemoveContainer" containerID="e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086"
Sep 09 16:29:31.814522 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.814304    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:31.814798 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.814759    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:31.814855 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.814845    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:31.814895 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.814879    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:31.881086 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:31.881052    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:32.821989 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.821950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" event={"ID":"5a9fab37-6be1-4785-9d40-0b20f8c3164e","Type":"ContainerStarted","Data":"129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2"}
Sep 09 16:29:32.849980 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.849944    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:32.850143 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.850114    2567 patch_prober.go:28] interesting pod/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 09 16:29:32.850192 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.850164    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 09 16:29:32.913786 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.913741    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"]
Sep 09 16:29:32.917515 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.917489    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:32.919861 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.919813    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-041bf1-serving-cert\""
Sep 09 16:29:32.927789 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.927660    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"]
Sep 09 16:29:32.947788 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:32.947745    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:33.006618 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.006577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:33.033902 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.033871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/191e35c2-5df6-4195-b669-efd0dd854138-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.034064 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.033916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55bpg\" (UniqueName: \"kubernetes.io/projected/191e35c2-5df6-4195-b669-efd0dd854138-kube-api-access-55bpg\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.034064 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.034041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.034152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.034134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.104140 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.104041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:33.134814 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.134751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.134982 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.134857    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.134982 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.134931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/191e35c2-5df6-4195-b669-efd0dd854138-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.134982 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.134969    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55bpg\" (UniqueName: \"kubernetes.io/projected/191e35c2-5df6-4195-b669-efd0dd854138-kube-api-access-55bpg\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.135625 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.135602    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/191e35c2-5df6-4195-b669-efd0dd854138-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.137339 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.137314    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.137434 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.137409    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.143439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.143412    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55bpg\" (UniqueName: \"kubernetes.io/projected/191e35c2-5df6-4195-b669-efd0dd854138-kube-api-access-55bpg\") pod \"maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.233331 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.233296    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:33.450037 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.450005    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:33.528281 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.528252    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:33.539795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.539755    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"]
Sep 09 16:29:33.540427 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:29:33.540404    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191e35c2_5df6_4195_b669_efd0dd854138.slice/crio-461439327acd0ffad8c11fb586cddd6fe822e463b53ac4e295b38ec814ee83e0 WatchSource:0}: Error finding container 461439327acd0ffad8c11fb586cddd6fe822e463b53ac4e295b38ec814ee83e0: Status 404 returned error can't find the container with id 461439327acd0ffad8c11fb586cddd6fe822e463b53ac4e295b38ec814ee83e0
Sep 09 16:29:33.829569 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.829481    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq" event={"ID":"191e35c2-5df6-4195-b669-efd0dd854138","Type":"ContainerStarted","Data":"461439327acd0ffad8c11fb586cddd6fe822e463b53ac4e295b38ec814ee83e0"}
Sep 09 16:29:33.850110 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.850076    2567 patch_prober.go:28] interesting pod/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 09 16:29:33.850270 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:33.850127    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 09 16:29:34.838975 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:34.838933    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq" event={"ID":"191e35c2-5df6-4195-b669-efd0dd854138","Type":"ContainerStarted","Data":"9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96"}
Sep 09 16:29:34.839466 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:34.839006    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:34.850045 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:34.850018    2567 patch_prober.go:28] interesting pod/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 09 16:29:34.850190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:34.850066    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 09 16:29:34.857096 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:34.857035    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq" podStartSLOduration=2.365378571 podStartE2EDuration="2.857016473s" totalImagesPullingTime="491.637902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:29:34.853510299 +0000 UTC m=+1272.624601539" watchObservedRunningTime="2026-09-09 16:29:34.857016473 +0000 UTC m=+1272.628107721"
Sep 09 16:29:35.849391 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:35.849357    2567 patch_prober.go:28] interesting pod/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 09 16:29:35.849811 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:35.849406    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 09 16:29:36.849789 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:36.849725    2567 patch_prober.go:28] interesting pod/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 09 16:29:36.850272 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:36.849833    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 09 16:29:37.849785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:37.849742    2567 patch_prober.go:28] interesting pod/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 09 16:29:37.849961 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:37.849855    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 09 16:29:38.665089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:38.665054    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:38.854059 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:38.854022    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:38.854544 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:38.854524    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:38.855296 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:38.855274    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:29:40.850416 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:40.850386    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:29:41.565153 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:41.565108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:42.763962 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:42.757556    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:47.856001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:47.855953    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 16:29:47.856421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:47.856054    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 16:29:48.546130 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:48.546097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:48.647127 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:48.647095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:48.947103 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:48.947069    2567 generic.go:356] "Generic (PLEG): container finished" podID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerID="3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e" exitCode=0
Sep 09 16:29:48.947473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:48.947142    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" event={"ID":"c8f62cbe-45f8-49c4-8fea-d325085fb107","Type":"ContainerDied","Data":"3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e"}
Sep 09 16:29:48.947589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:48.947574    2567 scope.go:117] "RemoveContainer" containerID="3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e"
Sep 09 16:29:48.948694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:48.948670    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:48.948751 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:48.948738    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:48.948800 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:48.948789    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:29:49.959291 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:49.959255    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" event={"ID":"c8f62cbe-45f8-49c4-8fea-d325085fb107","Type":"ContainerStarted","Data":"31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005"}
Sep 09 16:29:50.884186 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:50.884146    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:50.884382 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:50.884361    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:29:50.884436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:50.884410    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 09 16:29:51.885000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:51.884967    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:29:51.885354 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:51.885023    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 09 16:29:52.885149 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:52.885115    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:29:52.885538 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:52.885170    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 09 16:29:53.884786 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:53.884742    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:29:53.884975 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:53.884835    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 09 16:29:53.950360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:53.950322    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:54.338396 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:54.338306    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:54.885267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:54.885228    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 09 16:29:54.885488 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:54.885295    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 09 16:29:55.888237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:55.888204    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:55.888606 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:55.888586    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:55.889170 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:55.889152    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:29:56.723878 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:56.723847    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:57.045015 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:57.044930    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:57.349556 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:57.349475    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:57.744548 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:57.744511    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:59.164244 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:59.164208    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:59.718975 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:29:59.718943    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:01.674734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:01.674698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:01.774908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:01.774874    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:02.059027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:02.058919    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:02.215149 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:02.215106    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:02.342862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:02.342748    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:06.194874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:06.194842    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:06.295016 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:06.294983    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:06.424007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:06.423976    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"]
Sep 09 16:30:06.424206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:06.424183    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" containerID="cri-o://129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2" gracePeriod=30
Sep 09 16:30:06.995095 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:06.995058    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:07.095499 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:07.095464    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:08.857129 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:08.857083    2567 patch_prober.go:28] interesting pod/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 16:30:08.857603 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:08.857162    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:30:11.679959 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.679929    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:30:11.754343 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754261    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istiod-ca-cert\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754343 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754297    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-data\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754343 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754332    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-podinfo\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754375    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-socket\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82cn7\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-kube-api-access-82cn7\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754469    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-token\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754491    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-certs\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754527    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-envoy\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754564 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754559    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-credential-socket\") pod \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\" (UID: \"5a9fab37-6be1-4785-9d40-0b20f8c3164e\") "
Sep 09 16:30:11.754904 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754640    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:30:11.754904 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754753    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:30:11.754904 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754799    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:30:11.754904 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.754808    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:30:11.755111 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.755040    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:30:11.755240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.755219    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:11.755240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.755238    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-workload-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:11.755442 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.755247    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-credential-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:11.755442 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.755256    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istiod-ca-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:11.755442 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.755264    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-data\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:11.756878 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.756848    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:30:11.756994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.756935    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:30:11.757117 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.757096    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-kube-api-access-82cn7" (OuterVolumeSpecName: "kube-api-access-82cn7") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "kube-api-access-82cn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:30:11.757199 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.757181    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a9fab37-6be1-4785-9d40-0b20f8c3164e" (UID: "5a9fab37-6be1-4785-9d40-0b20f8c3164e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:30:11.856532 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.856494    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-podinfo\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:11.856532 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.856525    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82cn7\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-kube-api-access-82cn7\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:11.856532 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.856538    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-token\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:11.856756 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:11.856550    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9fab37-6be1-4785-9d40-0b20f8c3164e-istio-envoy\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:30:12.116607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.116518    2567 generic.go:356] "Generic (PLEG): container finished" podID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerID="129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2" exitCode=0
Sep 09 16:30:12.116607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.116573    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"
Sep 09 16:30:12.116883 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.116603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" event={"ID":"5a9fab37-6be1-4785-9d40-0b20f8c3164e","Type":"ContainerDied","Data":"129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2"}
Sep 09 16:30:12.116883 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.116660    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k" event={"ID":"5a9fab37-6be1-4785-9d40-0b20f8c3164e","Type":"ContainerDied","Data":"58f437cafbbcbc4b549990482dcb2eefa32c565730d447564a4611868ab88917"}
Sep 09 16:30:12.116883 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.116683    2567 scope.go:117] "RemoveContainer" containerID="129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2"
Sep 09 16:30:12.127602 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.127584    2567 scope.go:117] "RemoveContainer" containerID="e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086"
Sep 09 16:30:12.136817 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.136760    2567 scope.go:117] "RemoveContainer" containerID="129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2"
Sep 09 16:30:12.137267 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:30:12.137239    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2\": container with ID starting with 129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2 not found: ID does not exist" containerID="129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2"
Sep 09 16:30:12.137356 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.137268    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2"} err="failed to get container status \"129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2\": rpc error: code = NotFound desc = could not find container \"129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2\": container with ID starting with 129cc08aaa5bb33628deb1effa8f1761ff192a36a54a64cdaf4296ce19d37be2 not found: ID does not exist"
Sep 09 16:30:12.137356 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.137285    2567 scope.go:117] "RemoveContainer" containerID="e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086"
Sep 09 16:30:12.137533 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:30:12.137513    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086\": container with ID starting with e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086 not found: ID does not exist" containerID="e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086"
Sep 09 16:30:12.137588 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.137538    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086"} err="failed to get container status \"e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086\": rpc error: code = NotFound desc = could not find container \"e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086\": container with ID starting with e0ae771293b4fcda0fcf6798860e0bfc6830bc09c273b0405bc91a7501485086 not found: ID does not exist"
Sep 09 16:30:12.140409 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.140386    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"]
Sep 09 16:30:12.143202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.143183    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-13b02364-openshift-default-c6d8c8ff6-sz82k"]
Sep 09 16:30:12.746956 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:12.746926    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" path="/var/lib/kubelet/pods/5a9fab37-6be1-4785-9d40-0b20f8c3164e/volumes"
Sep 09 16:30:13.332848 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:13.332816    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:13.433137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:13.433099    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:18.839909 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:18.839872    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:18.940213 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:18.940172    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:19.770487 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:19.770452    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:20.070094 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:20.070014    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:20.517730 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:20.517697    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:22.699485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:22.699452    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:22.822863 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:22.822835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:24.098232 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.098196    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"]
Sep 09 16:30:24.098863 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.098829    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy"
Sep 09 16:30:24.098863 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.098854    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy"
Sep 09 16:30:24.099031 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.098877    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy"
Sep 09 16:30:24.099031 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.098883    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy"
Sep 09 16:30:24.099031 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.098955    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy"
Sep 09 16:30:24.103506 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.103481    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.106040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.106016    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-042f8b-serving-cert\""
Sep 09 16:30:24.113726 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.113698    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"]
Sep 09 16:30:24.132620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.132587    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:24.233544 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.233513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:24.281807 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.281761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.281989 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.281822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.281989 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.281934    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxk69\" (UniqueName: \"kubernetes.io/projected/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-kube-api-access-zxk69\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.282083 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.282007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.383101 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.383072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.383273 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.383117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.383273 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.383167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.383273 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.383224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxk69\" (UniqueName: \"kubernetes.io/projected/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-kube-api-access-zxk69\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.383393 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:30:24.383315    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-serving-cert: secret "maas-api-e2e-shared-a-w2-042f8b-serving-cert" not found
Sep 09 16:30:24.383440 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:30:24.383394    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls podName:5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c nodeName:}" failed. No retries permitted until 2026-09-09 16:30:24.883374489 +0000 UTC m=+1322.654465717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls") pod "maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph" (UID: "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c") : secret "maas-api-e2e-shared-a-w2-042f8b-serving-cert" not found
Sep 09 16:30:24.384020 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.383992    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.385544 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.385523    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.391507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.391479    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxk69\" (UniqueName: \"kubernetes.io/projected/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-kube-api-access-zxk69\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.708251 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.708150    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:24.800984 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.800951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:24.872860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.872825    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:24.889387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.889349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:24.891766 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:24.891740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:25.018624 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:25.018538    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:25.113120 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:25.113090    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:25.293146 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:25.293121    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"]
Sep 09 16:30:25.294239 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:30:25.294215    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5290b272_f8a0_4b9c_a0f6_0cd2cecebd2c.slice/crio-23a63192d271bf928384e59df01b59376215fd24fdb6076f02bec03d4ac10dc2 WatchSource:0}: Error finding container 23a63192d271bf928384e59df01b59376215fd24fdb6076f02bec03d4ac10dc2: Status 404 returned error can't find the container with id 23a63192d271bf928384e59df01b59376215fd24fdb6076f02bec03d4ac10dc2
Sep 09 16:30:25.295686 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:25.295669    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:30:25.479085 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:25.479053    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:25.781919 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:25.781886    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:26.212531 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:26.212495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph" event={"ID":"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c","Type":"ContainerStarted","Data":"23a63192d271bf928384e59df01b59376215fd24fdb6076f02bec03d4ac10dc2"}
Sep 09 16:30:27.219894 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:27.219851    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph" event={"ID":"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c","Type":"ContainerStarted","Data":"3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f"}
Sep 09 16:30:27.220358 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:27.219943    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:27.239614 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:27.239556    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph" podStartSLOduration=2.382874022 podStartE2EDuration="3.239541055s" totalImagesPullingTime="856.667033ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:30:27.236208093 +0000 UTC m=+1325.007299351" watchObservedRunningTime="2026-09-09 16:30:27.239541055 +0000 UTC m=+1325.010632300"
Sep 09 16:30:33.232457 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:33.232429    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:30:47.535257 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:47.535193    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:47.743715 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:47.743683    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:48.076243 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:48.076208    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:48.387225 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:48.387191    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:48.683827 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:48.683727    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:51.905172 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:51.905138    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:52.008908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:52.008871    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:53.091379 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.091349    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:53.193626 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.193592    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:53.292913 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.292880    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:53.660326 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.660293    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:53.766428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.766396    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"]
Sep 09 16:30:53.767004 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.766814    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:53.767131 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.767113    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a9fab37-6be1-4785-9d40-0b20f8c3164e" containerName="istio-proxy"
Sep 09 16:30:53.770268 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.770250    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:53.772851 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.772824    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-de97ae\""
Sep 09 16:30:53.777852 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.777828    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"]
Sep 09 16:30:53.802178 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.802145    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"]
Sep 09 16:30:53.805954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.805935    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:53.808847 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.808829    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-de97ae-dockercfg-85cgh\""
Sep 09 16:30:53.816657 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.816626    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"]
Sep 09 16:30:53.883654 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.883620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k76wv\" (UniqueName: \"kubernetes.io/projected/86d9da17-b828-44a3-bd15-4ab68962d698-kube-api-access-k76wv\") pod \"payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk\" (UID: \"86d9da17-b828-44a3-bd15-4ab68962d698\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:53.883865 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.883661    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d9da17-b828-44a3-bd15-4ab68962d698-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk\" (UID: \"86d9da17-b828-44a3-bd15-4ab68962d698\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:53.883865 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.883845    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec6e8bc-fef2-4653-af17-015fe15af372-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9\" (UID: \"0ec6e8bc-fef2-4653-af17-015fe15af372\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:53.883994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.883935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2j5h\" (UniqueName: \"kubernetes.io/projected/0ec6e8bc-fef2-4653-af17-015fe15af372-kube-api-access-s2j5h\") pod \"payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9\" (UID: \"0ec6e8bc-fef2-4653-af17-015fe15af372\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:53.984989 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.984909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec6e8bc-fef2-4653-af17-015fe15af372-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9\" (UID: \"0ec6e8bc-fef2-4653-af17-015fe15af372\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:53.984989 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.984962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2j5h\" (UniqueName: \"kubernetes.io/projected/0ec6e8bc-fef2-4653-af17-015fe15af372-kube-api-access-s2j5h\") pod \"payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9\" (UID: \"0ec6e8bc-fef2-4653-af17-015fe15af372\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:53.985227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.985011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k76wv\" (UniqueName: \"kubernetes.io/projected/86d9da17-b828-44a3-bd15-4ab68962d698-kube-api-access-k76wv\") pod \"payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk\" (UID: \"86d9da17-b828-44a3-bd15-4ab68962d698\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:53.985227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.985035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d9da17-b828-44a3-bd15-4ab68962d698-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk\" (UID: \"86d9da17-b828-44a3-bd15-4ab68962d698\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:53.985721 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.985699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec6e8bc-fef2-4653-af17-015fe15af372-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9\" (UID: \"0ec6e8bc-fef2-4653-af17-015fe15af372\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:53.985822 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.985712    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d9da17-b828-44a3-bd15-4ab68962d698-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk\" (UID: \"86d9da17-b828-44a3-bd15-4ab68962d698\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:53.992605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.992581    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2j5h\" (UniqueName: \"kubernetes.io/projected/0ec6e8bc-fef2-4653-af17-015fe15af372-kube-api-access-s2j5h\") pod \"payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9\" (UID: \"0ec6e8bc-fef2-4653-af17-015fe15af372\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:53.992708 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:53.992616    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k76wv\" (UniqueName: \"kubernetes.io/projected/86d9da17-b828-44a3-bd15-4ab68962d698-kube-api-access-k76wv\") pod \"payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk\" (UID: \"86d9da17-b828-44a3-bd15-4ab68962d698\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:54.082079 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:54.082037    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:54.120496 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:54.119056    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:54.372691 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:54.372656    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"]
Sep 09 16:30:54.373626 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:30:54.373599    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec6e8bc_fef2_4653_af17_015fe15af372.slice/crio-6306c12928151cdd249f87eb5464c5e3fdde191441596bdd178edc0f8f7c8234 WatchSource:0}: Error finding container 6306c12928151cdd249f87eb5464c5e3fdde191441596bdd178edc0f8f7c8234: Status 404 returned error can't find the container with id 6306c12928151cdd249f87eb5464c5e3fdde191441596bdd178edc0f8f7c8234
Sep 09 16:30:54.405395 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:54.405365    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9" event={"ID":"0ec6e8bc-fef2-4653-af17-015fe15af372","Type":"ContainerStarted","Data":"6306c12928151cdd249f87eb5464c5e3fdde191441596bdd178edc0f8f7c8234"}
Sep 09 16:30:54.442810 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:54.442763    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"]
Sep 09 16:30:54.443739 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:30:54.443713    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d9da17_b828_44a3_bd15_4ab68962d698.slice/crio-759356b8b0008e2b83fcddb611dc0bb6d0f8c5e6e4b7b8526acda1ab4b7c0250 WatchSource:0}: Error finding container 759356b8b0008e2b83fcddb611dc0bb6d0f8c5e6e4b7b8526acda1ab4b7c0250: Status 404 returned error can't find the container with id 759356b8b0008e2b83fcddb611dc0bb6d0f8c5e6e4b7b8526acda1ab4b7c0250
Sep 09 16:30:55.413373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:55.413335    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk" event={"ID":"86d9da17-b828-44a3-bd15-4ab68962d698","Type":"ContainerStarted","Data":"439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005"}
Sep 09 16:30:55.413825 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:55.413394    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk" event={"ID":"86d9da17-b828-44a3-bd15-4ab68962d698","Type":"ContainerStarted","Data":"759356b8b0008e2b83fcddb611dc0bb6d0f8c5e6e4b7b8526acda1ab4b7c0250"}
Sep 09 16:30:55.413825 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:55.413551    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:30:55.414981 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:55.414955    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9" event={"ID":"0ec6e8bc-fef2-4653-af17-015fe15af372","Type":"ContainerStarted","Data":"e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631"}
Sep 09 16:30:55.415082 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:55.415008    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:30:55.432653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:55.432607    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk" podStartSLOduration=2.432594135 podStartE2EDuration="2.432594135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:30:55.429433242 +0000 UTC m=+1353.200524491" watchObservedRunningTime="2026-09-09 16:30:55.432594135 +0000 UTC m=+1353.203685380"
Sep 09 16:30:55.445661 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:30:55.445606    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9" podStartSLOduration=2.445591927 podStartE2EDuration="2.445591927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:30:55.44334521 +0000 UTC m=+1353.214436455" watchObservedRunningTime="2026-09-09 16:30:55.445591927 +0000 UTC m=+1353.216683173"
Sep 09 16:31:06.424207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:06.424175    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:31:06.424625 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:06.424252    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:31:16.881637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:16.881600    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:21.605789 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:21.605728    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:23.085054 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.085020    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7685-139728178898528"]
Sep 09 16:31:23.089624 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.089596    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:23.092788 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.092743    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bzk7m\""
Sep 09 16:31:23.093188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.093160    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-139728178898528"]
Sep 09 16:31:23.190232 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.190189    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgx8v\" (UniqueName: \"kubernetes.io/projected/5d7af901-afcb-481e-860f-675c9299bee6-kube-api-access-tgx8v\") pod \"test-curl-7685-139728178898528\" (UID: \"5d7af901-afcb-481e-860f-675c9299bee6\") " pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:23.291562 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.291515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgx8v\" (UniqueName: \"kubernetes.io/projected/5d7af901-afcb-481e-860f-675c9299bee6-kube-api-access-tgx8v\") pod \"test-curl-7685-139728178898528\" (UID: \"5d7af901-afcb-481e-860f-675c9299bee6\") " pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:23.300236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.300208    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgx8v\" (UniqueName: \"kubernetes.io/projected/5d7af901-afcb-481e-860f-675c9299bee6-kube-api-access-tgx8v\") pod \"test-curl-7685-139728178898528\" (UID: \"5d7af901-afcb-481e-860f-675c9299bee6\") " pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:23.403061 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.403022    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:23.677642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:23.677608    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-139728178898528"]
Sep 09 16:31:23.678435 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:31:23.678404    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d7af901_afcb_481e_860f_675c9299bee6.slice/crio-5dbf355740bc34760eaacbb758352aa64641d088806bad8b9d81bb10de6e49a4 WatchSource:0}: Error finding container 5dbf355740bc34760eaacbb758352aa64641d088806bad8b9d81bb10de6e49a4: Status 404 returned error can't find the container with id 5dbf355740bc34760eaacbb758352aa64641d088806bad8b9d81bb10de6e49a4
Sep 09 16:31:24.612988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:24.612953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-139728178898528" event={"ID":"5d7af901-afcb-481e-860f-675c9299bee6","Type":"ContainerStarted","Data":"5dbf355740bc34760eaacbb758352aa64641d088806bad8b9d81bb10de6e49a4"}
Sep 09 16:31:25.620727 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:25.620690    2567 generic.go:356] "Generic (PLEG): container finished" podID="5d7af901-afcb-481e-860f-675c9299bee6" containerID="df05ad883beaad58b1da627048958eedf9c59ee57c301a6a99ad7f32d3c91762" exitCode=0
Sep 09 16:31:25.621122 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:25.620731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-139728178898528" event={"ID":"5d7af901-afcb-481e-860f-675c9299bee6","Type":"ContainerDied","Data":"df05ad883beaad58b1da627048958eedf9c59ee57c301a6a99ad7f32d3c91762"}
Sep 09 16:31:26.765199 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.765171    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:26.783758 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.783731    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7685-139728178898528_5d7af901-afcb-481e-860f-675c9299bee6/test-curl-7685-139728178898528/0.log"
Sep 09 16:31:26.807876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.807846    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7685-139728178898528"]
Sep 09 16:31:26.810617 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.810595    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7685-139728178898528"]
Sep 09 16:31:26.924642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.924559    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:26.925081 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.925065    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7af901-afcb-481e-860f-675c9299bee6" containerName="test-curl-7685-139728178898528"
Sep 09 16:31:26.925130 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.925083    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7af901-afcb-481e-860f-675c9299bee6" containerName="test-curl-7685-139728178898528"
Sep 09 16:31:26.925191 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.925181    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7af901-afcb-481e-860f-675c9299bee6" containerName="test-curl-7685-139728178898528"
Sep 09 16:31:26.928473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.928438    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:26.928671 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.928639    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgx8v\" (UniqueName: \"kubernetes.io/projected/5d7af901-afcb-481e-860f-675c9299bee6-kube-api-access-tgx8v\") pod \"5d7af901-afcb-481e-860f-675c9299bee6\" (UID: \"5d7af901-afcb-481e-860f-675c9299bee6\") "
Sep 09 16:31:26.931743 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.931715    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7af901-afcb-481e-860f-675c9299bee6-kube-api-access-tgx8v" (OuterVolumeSpecName: "kube-api-access-tgx8v") pod "5d7af901-afcb-481e-860f-675c9299bee6" (UID: "5d7af901-afcb-481e-860f-675c9299bee6"). InnerVolumeSpecName "kube-api-access-tgx8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:31:26.933521 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:26.933498    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:27.029585 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.029552    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8md54\" (UniqueName: \"kubernetes.io/projected/1b90b8cd-844d-47d7-acb4-7964ba82ec6d-kube-api-access-8md54\") pod \"test-curl-7685-139728178899104\" (UID: \"1b90b8cd-844d-47d7-acb4-7964ba82ec6d\") " pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:27.029760 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.029624    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgx8v\" (UniqueName: \"kubernetes.io/projected/5d7af901-afcb-481e-860f-675c9299bee6-kube-api-access-tgx8v\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:31:27.130638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.130599    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8md54\" (UniqueName: \"kubernetes.io/projected/1b90b8cd-844d-47d7-acb4-7964ba82ec6d-kube-api-access-8md54\") pod \"test-curl-7685-139728178899104\" (UID: \"1b90b8cd-844d-47d7-acb4-7964ba82ec6d\") " pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:27.139187 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.139154    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8md54\" (UniqueName: \"kubernetes.io/projected/1b90b8cd-844d-47d7-acb4-7964ba82ec6d-kube-api-access-8md54\") pod \"test-curl-7685-139728178899104\" (UID: \"1b90b8cd-844d-47d7-acb4-7964ba82ec6d\") " pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:27.249032 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.248942    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:27.523664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.523629    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:27.524900 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:31:27.524877    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b90b8cd_844d_47d7_acb4_7964ba82ec6d.slice/crio-28394a4c6e02ff265f806279b4d93e591fb00f07d9b6fec9622072904e230e68 WatchSource:0}: Error finding container 28394a4c6e02ff265f806279b4d93e591fb00f07d9b6fec9622072904e230e68: Status 404 returned error can't find the container with id 28394a4c6e02ff265f806279b4d93e591fb00f07d9b6fec9622072904e230e68
Sep 09 16:31:27.634538 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.634508    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:27.634538 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.634522    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dbf355740bc34760eaacbb758352aa64641d088806bad8b9d81bb10de6e49a4"
Sep 09 16:31:27.636010 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:27.635978    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-139728178899104" event={"ID":"1b90b8cd-844d-47d7-acb4-7964ba82ec6d","Type":"ContainerStarted","Data":"28394a4c6e02ff265f806279b4d93e591fb00f07d9b6fec9622072904e230e68"}
Sep 09 16:31:27.645312 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:31:27.645285    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7685-139728178898528\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="5d7af901-afcb-481e-860f-675c9299bee6" pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:28.644065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:28.644030    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b90b8cd-844d-47d7-acb4-7964ba82ec6d" containerID="9a7e50ff0461601d0c0a812196cf557c608f5d1250946f38da5f07808bba7e25" exitCode=0
Sep 09 16:31:28.644480 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:28.644109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-139728178899104" event={"ID":"1b90b8cd-844d-47d7-acb4-7964ba82ec6d","Type":"ContainerDied","Data":"9a7e50ff0461601d0c0a812196cf557c608f5d1250946f38da5f07808bba7e25"}
Sep 09 16:31:28.659753 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:31:28.659718    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7685-139728178898528\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="5d7af901-afcb-481e-860f-675c9299bee6" pod="opendatahub/test-curl-7685-139728178898528"
Sep 09 16:31:28.738829 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:28.738793    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d7af901-afcb-481e-860f-675c9299bee6" path="/var/lib/kubelet/pods/5d7af901-afcb-481e-860f-675c9299bee6/volumes"
Sep 09 16:31:29.791704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.791678    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:29.810292 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.810266    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7685-139728178899104_1b90b8cd-844d-47d7-acb4-7964ba82ec6d/test-curl-7685-139728178899104/0.log"
Sep 09 16:31:29.833837 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.833808    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:29.837063 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.837044    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:29.955503 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.955393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8md54\" (UniqueName: \"kubernetes.io/projected/1b90b8cd-844d-47d7-acb4-7964ba82ec6d-kube-api-access-8md54\") pod \"1b90b8cd-844d-47d7-acb4-7964ba82ec6d\" (UID: \"1b90b8cd-844d-47d7-acb4-7964ba82ec6d\") "
Sep 09 16:31:29.957637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.957602    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b90b8cd-844d-47d7-acb4-7964ba82ec6d-kube-api-access-8md54" (OuterVolumeSpecName: "kube-api-access-8md54") pod "1b90b8cd-844d-47d7-acb4-7964ba82ec6d" (UID: "1b90b8cd-844d-47d7-acb4-7964ba82ec6d"). InnerVolumeSpecName "kube-api-access-8md54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:31:29.958453 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.958426    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:29.959225 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.959203    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b90b8cd-844d-47d7-acb4-7964ba82ec6d" containerName="test-curl-7685-139728178899104"
Sep 09 16:31:29.959380 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.959367    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b90b8cd-844d-47d7-acb4-7964ba82ec6d" containerName="test-curl-7685-139728178899104"
Sep 09 16:31:29.959648 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.959610    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b90b8cd-844d-47d7-acb4-7964ba82ec6d" containerName="test-curl-7685-139728178899104"
Sep 09 16:31:29.963377 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.963343    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:29.964193 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:29.964166    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:30.056892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.056861    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm4d9\" (UniqueName: \"kubernetes.io/projected/c3130900-84fc-4fe3-b0ca-87b66ea3b827-kube-api-access-tm4d9\") pod \"test-curl-7685-139728178899104\" (UID: \"c3130900-84fc-4fe3-b0ca-87b66ea3b827\") " pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:30.057073 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.056988    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8md54\" (UniqueName: \"kubernetes.io/projected/1b90b8cd-844d-47d7-acb4-7964ba82ec6d-kube-api-access-8md54\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:31:30.158025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.157986    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm4d9\" (UniqueName: \"kubernetes.io/projected/c3130900-84fc-4fe3-b0ca-87b66ea3b827-kube-api-access-tm4d9\") pod \"test-curl-7685-139728178899104\" (UID: \"c3130900-84fc-4fe3-b0ca-87b66ea3b827\") " pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:30.166204 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.166172    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm4d9\" (UniqueName: \"kubernetes.io/projected/c3130900-84fc-4fe3-b0ca-87b66ea3b827-kube-api-access-tm4d9\") pod \"test-curl-7685-139728178899104\" (UID: \"c3130900-84fc-4fe3-b0ca-87b66ea3b827\") " pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:30.276561 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.276471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:30.548378 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.548348    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:30.548967 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:31:30.548942    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3130900_84fc_4fe3_b0ca_87b66ea3b827.slice/crio-8d90a79869ea4eb8c24311c6e582289329673280eaa9435f22049fef7e729b10 WatchSource:0}: Error finding container 8d90a79869ea4eb8c24311c6e582289329673280eaa9435f22049fef7e729b10: Status 404 returned error can't find the container with id 8d90a79869ea4eb8c24311c6e582289329673280eaa9435f22049fef7e729b10
Sep 09 16:31:30.661380 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.661350    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-139728178899104" event={"ID":"c3130900-84fc-4fe3-b0ca-87b66ea3b827","Type":"ContainerStarted","Data":"8d90a79869ea4eb8c24311c6e582289329673280eaa9435f22049fef7e729b10"}
Sep 09 16:31:30.662960 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.662933    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:30.662960 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.662951    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28394a4c6e02ff265f806279b4d93e591fb00f07d9b6fec9622072904e230e68"
Sep 09 16:31:30.675934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.675904    2567 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7685-139728178899104" oldPodUID="1b90b8cd-844d-47d7-acb4-7964ba82ec6d" podUID="c3130900-84fc-4fe3-b0ca-87b66ea3b827"
Sep 09 16:31:30.738093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:30.738061    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b90b8cd-844d-47d7-acb4-7964ba82ec6d" path="/var/lib/kubelet/pods/1b90b8cd-844d-47d7-acb4-7964ba82ec6d/volumes"
Sep 09 16:31:31.672986 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:31.672948    2567 generic.go:356] "Generic (PLEG): container finished" podID="c3130900-84fc-4fe3-b0ca-87b66ea3b827" containerID="51f2de1b8ab4bb4ef91bfbc5afe18766daa47cf3b774dccd15e20fc0680b7737" exitCode=0
Sep 09 16:31:31.673369 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:31.672983    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-139728178899104" event={"ID":"c3130900-84fc-4fe3-b0ca-87b66ea3b827","Type":"ContainerDied","Data":"51f2de1b8ab4bb4ef91bfbc5afe18766daa47cf3b774dccd15e20fc0680b7737"}
Sep 09 16:31:32.826382 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:32.826358    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:32.844262 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:32.844228    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7685-139728178899104_c3130900-84fc-4fe3-b0ca-87b66ea3b827/test-curl-7685-139728178899104/0.log"
Sep 09 16:31:32.870710 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:32.870675    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:32.873731 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:32.873704    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7685-139728178899104"]
Sep 09 16:31:32.988395 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:32.988308    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm4d9\" (UniqueName: \"kubernetes.io/projected/c3130900-84fc-4fe3-b0ca-87b66ea3b827-kube-api-access-tm4d9\") pod \"c3130900-84fc-4fe3-b0ca-87b66ea3b827\" (UID: \"c3130900-84fc-4fe3-b0ca-87b66ea3b827\") "
Sep 09 16:31:32.990442 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:32.990419    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3130900-84fc-4fe3-b0ca-87b66ea3b827-kube-api-access-tm4d9" (OuterVolumeSpecName: "kube-api-access-tm4d9") pod "c3130900-84fc-4fe3-b0ca-87b66ea3b827" (UID: "c3130900-84fc-4fe3-b0ca-87b66ea3b827"). InnerVolumeSpecName "kube-api-access-tm4d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:31:33.089276 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:33.089237    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm4d9\" (UniqueName: \"kubernetes.io/projected/c3130900-84fc-4fe3-b0ca-87b66ea3b827-kube-api-access-tm4d9\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:31:33.473472 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:33.473436    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:33.689040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:33.689009    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:33.689207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:33.689021    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d90a79869ea4eb8c24311c6e582289329673280eaa9435f22049fef7e729b10"
Sep 09 16:31:33.698817 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:31:33.698786    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7685-139728178899104\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="c3130900-84fc-4fe3-b0ca-87b66ea3b827" pod="opendatahub/test-curl-7685-139728178899104"
Sep 09 16:31:33.771672 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:33.771570    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:34.032968 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:34.032867    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:34.738753 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:34.738709    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3130900-84fc-4fe3-b0ca-87b66ea3b827" path="/var/lib/kubelet/pods/c3130900-84fc-4fe3-b0ca-87b66ea3b827/volumes"
Sep 09 16:31:37.134294 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:37.134247    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:38.240660 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.240627    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"]
Sep 09 16:31:38.241162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.241146    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3130900-84fc-4fe3-b0ca-87b66ea3b827" containerName="test-curl-7685-139728178899104"
Sep 09 16:31:38.241162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.241162    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3130900-84fc-4fe3-b0ca-87b66ea3b827" containerName="test-curl-7685-139728178899104"
Sep 09 16:31:38.241283 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.241240    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3130900-84fc-4fe3-b0ca-87b66ea3b827" containerName="test-curl-7685-139728178899104"
Sep 09 16:31:38.245213 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.245189    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.247574 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.247409    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a0d4fa04-serving-cert\""
Sep 09 16:31:38.258275 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.257409    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"]
Sep 09 16:31:38.341429 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.341387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5mg\" (UniqueName: \"kubernetes.io/projected/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-kube-api-access-2l5mg\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.341637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.341484    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-openshift-service-ca\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.341637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.341529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-maas-api-tls\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.341637 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.341579    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-metrics-certs\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.442134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.442096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-openshift-service-ca\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.442324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.442160    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-maas-api-tls\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.442324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.442188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-metrics-certs\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.442324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.442228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5mg\" (UniqueName: \"kubernetes.io/projected/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-kube-api-access-2l5mg\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.442736 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.442711    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-openshift-service-ca\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.444710 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.444686    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-maas-api-tls\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.444805 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.444749    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-metrics-certs\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.450203 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.450180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5mg\" (UniqueName: \"kubernetes.io/projected/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-kube-api-access-2l5mg\") pod \"maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.559590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.559503    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:38.840093 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.840061    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"]
Sep 09 16:31:38.841268 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:31:38.841239    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cbc153d_f8f8_4a17_b1c5_14b45be9dad6.slice/crio-b7707e5a1ac6590e3532b7097e2e825beae6529bf0452f33b3aa29521b41e8a9 WatchSource:0}: Error finding container b7707e5a1ac6590e3532b7097e2e825beae6529bf0452f33b3aa29521b41e8a9: Status 404 returned error can't find the container with id b7707e5a1ac6590e3532b7097e2e825beae6529bf0452f33b3aa29521b41e8a9
Sep 09 16:31:38.958552 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.958509    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"]
Sep 09 16:31:38.963666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.963636    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:38.966175 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.966137    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a0d4fa04-dockercfg-9x6f9\""
Sep 09 16:31:38.966408 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.966387    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a0d4fa04\""
Sep 09 16:31:38.976150 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:38.976124    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"]
Sep 09 16:31:39.048312 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.048277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-752xn\" (UniqueName: \"kubernetes.io/projected/8493467f-60e5-4195-a651-fdebca3755dd-kube-api-access-752xn\") pod \"payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw\" (UID: \"8493467f-60e5-4195-a651-fdebca3755dd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:39.048490 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.048345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8493467f-60e5-4195-a651-fdebca3755dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw\" (UID: \"8493467f-60e5-4195-a651-fdebca3755dd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:39.124954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.124902    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:39.149862 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.149821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-752xn\" (UniqueName: \"kubernetes.io/projected/8493467f-60e5-4195-a651-fdebca3755dd-kube-api-access-752xn\") pod \"payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw\" (UID: \"8493467f-60e5-4195-a651-fdebca3755dd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:39.150014 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.149905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8493467f-60e5-4195-a651-fdebca3755dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw\" (UID: \"8493467f-60e5-4195-a651-fdebca3755dd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:39.150568 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.150548    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8493467f-60e5-4195-a651-fdebca3755dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw\" (UID: \"8493467f-60e5-4195-a651-fdebca3755dd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:39.158686 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.158663    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-752xn\" (UniqueName: \"kubernetes.io/projected/8493467f-60e5-4195-a651-fdebca3755dd-kube-api-access-752xn\") pod \"payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw\" (UID: \"8493467f-60e5-4195-a651-fdebca3755dd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:39.226048 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.226016    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:39.276589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.276559    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:39.557076 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.557044    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"]
Sep 09 16:31:39.558382 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:31:39.558356    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8493467f_60e5_4195_a651_fdebca3755dd.slice/crio-76f97c1ae3fc7ae66ce149c5ba65a4ca0f71af6a412db1f217e4fd25e31234aa WatchSource:0}: Error finding container 76f97c1ae3fc7ae66ce149c5ba65a4ca0f71af6a412db1f217e4fd25e31234aa: Status 404 returned error can't find the container with id 76f97c1ae3fc7ae66ce149c5ba65a4ca0f71af6a412db1f217e4fd25e31234aa
Sep 09 16:31:39.729094 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.729058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq" event={"ID":"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6","Type":"ContainerStarted","Data":"0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7"}
Sep 09 16:31:39.729264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.729118    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq" event={"ID":"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6","Type":"ContainerStarted","Data":"b7707e5a1ac6590e3532b7097e2e825beae6529bf0452f33b3aa29521b41e8a9"}
Sep 09 16:31:39.729358 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.729259    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:39.730802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.730750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw" event={"ID":"8493467f-60e5-4195-a651-fdebca3755dd","Type":"ContainerStarted","Data":"50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9"}
Sep 09 16:31:39.730917 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.730824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw" event={"ID":"8493467f-60e5-4195-a651-fdebca3755dd","Type":"ContainerStarted","Data":"76f97c1ae3fc7ae66ce149c5ba65a4ca0f71af6a412db1f217e4fd25e31234aa"}
Sep 09 16:31:39.730917 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.730855    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:31:39.747644 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.747592    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq" podStartSLOduration=1.375203035 podStartE2EDuration="1.747576813s" totalImagesPullingTime="372.373778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:31:39.744032055 +0000 UTC m=+1397.515123300" watchObservedRunningTime="2026-09-09 16:31:39.747576813 +0000 UTC m=+1397.518668089"
Sep 09 16:31:39.760988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:39.760938    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw" podStartSLOduration=1.760918462 podStartE2EDuration="1.760918462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:31:39.758652997 +0000 UTC m=+1397.529744245" watchObservedRunningTime="2026-09-09 16:31:39.760918462 +0000 UTC m=+1397.532009709"
Sep 09 16:31:45.743364 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:45.743328    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:31:50.740256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:31:50.740227    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:32:02.213143 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:02.213102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:06.432049 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:06.432009    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:07.930333 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:07.930298    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:44.903866 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:44.903831    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:57.513158 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.513126    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"]
Sep 09 16:32:57.513994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.513344    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq" podUID="9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" containerName="maas-api" containerID="cri-o://0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7" gracePeriod=30
Sep 09 16:32:57.529455 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.529426    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:57.569930 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.569898    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"]
Sep 09 16:32:57.570506 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.570474    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw" podUID="8493467f-60e5-4195-a651-fdebca3755dd" containerName="payload-pre-processing" containerID="cri-o://50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9" gracePeriod=30
Sep 09 16:32:57.595095 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.595072    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:57.654147 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.654068    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:57.724667 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.724627    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:57.782464 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.782372    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:57.830791 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.830748    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:32:57.856187 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.855563    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-maas-api-tls\") pod \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") "
Sep 09 16:32:57.856187 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.855683    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-metrics-certs\") pod \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") "
Sep 09 16:32:57.856187 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.855721    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-openshift-service-ca\") pod \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") "
Sep 09 16:32:57.856187 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.855813    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l5mg\" (UniqueName: \"kubernetes.io/projected/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-kube-api-access-2l5mg\") pod \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\" (UID: \"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6\") "
Sep 09 16:32:57.856538 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.856188    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" (UID: "9cbc153d-f8f8-4a17-b1c5-14b45be9dad6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:32:57.858803 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.858755    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" (UID: "9cbc153d-f8f8-4a17-b1c5-14b45be9dad6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:32:57.860198 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.860171    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" (UID: "9cbc153d-f8f8-4a17-b1c5-14b45be9dad6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:32:57.860900 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.860879    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-kube-api-access-2l5mg" (OuterVolumeSpecName: "kube-api-access-2l5mg") pod "9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" (UID: "9cbc153d-f8f8-4a17-b1c5-14b45be9dad6"). InnerVolumeSpecName "kube-api-access-2l5mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:32:57.872068 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.872046    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:32:57.956887 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.956855    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8493467f-60e5-4195-a651-fdebca3755dd-plugins-config-volume\") pod \"8493467f-60e5-4195-a651-fdebca3755dd\" (UID: \"8493467f-60e5-4195-a651-fdebca3755dd\") "
Sep 09 16:32:57.957061 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.956945    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-752xn\" (UniqueName: \"kubernetes.io/projected/8493467f-60e5-4195-a651-fdebca3755dd-kube-api-access-752xn\") pod \"8493467f-60e5-4195-a651-fdebca3755dd\" (UID: \"8493467f-60e5-4195-a651-fdebca3755dd\") "
Sep 09 16:32:57.957308 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.957286    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8493467f-60e5-4195-a651-fdebca3755dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8493467f-60e5-4195-a651-fdebca3755dd" (UID: "8493467f-60e5-4195-a651-fdebca3755dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:32:57.957376 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.957364    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:32:57.957411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.957380    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l5mg\" (UniqueName: \"kubernetes.io/projected/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-kube-api-access-2l5mg\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:32:57.957411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.957390    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:32:57.957411 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.957398    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:32:57.959229 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:57.959200    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8493467f-60e5-4195-a651-fdebca3755dd-kube-api-access-752xn" (OuterVolumeSpecName: "kube-api-access-752xn") pod "8493467f-60e5-4195-a651-fdebca3755dd" (UID: "8493467f-60e5-4195-a651-fdebca3755dd"). InnerVolumeSpecName "kube-api-access-752xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:32:58.058562 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.058490    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8493467f-60e5-4195-a651-fdebca3755dd-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:32:58.058562 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.058515    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-752xn\" (UniqueName: \"kubernetes.io/projected/8493467f-60e5-4195-a651-fdebca3755dd-kube-api-access-752xn\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:32:58.280003 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.279967    2567 generic.go:356] "Generic (PLEG): container finished" podID="9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" containerID="0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7" exitCode=0
Sep 09 16:32:58.280151 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.280014    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"
Sep 09 16:32:58.280151 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.280053    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq" event={"ID":"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6","Type":"ContainerDied","Data":"0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7"}
Sep 09 16:32:58.280151 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.280115    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq" event={"ID":"9cbc153d-f8f8-4a17-b1c5-14b45be9dad6","Type":"ContainerDied","Data":"b7707e5a1ac6590e3532b7097e2e825beae6529bf0452f33b3aa29521b41e8a9"}
Sep 09 16:32:58.280151 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.280150    2567 scope.go:117] "RemoveContainer" containerID="0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7"
Sep 09 16:32:58.281541 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.281515    2567 generic.go:356] "Generic (PLEG): container finished" podID="8493467f-60e5-4195-a651-fdebca3755dd" containerID="50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9" exitCode=0
Sep 09 16:32:58.281680 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.281555    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"
Sep 09 16:32:58.281680 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.281598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw" event={"ID":"8493467f-60e5-4195-a651-fdebca3755dd","Type":"ContainerDied","Data":"50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9"}
Sep 09 16:32:58.281680 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.281663    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw" event={"ID":"8493467f-60e5-4195-a651-fdebca3755dd","Type":"ContainerDied","Data":"76f97c1ae3fc7ae66ce149c5ba65a4ca0f71af6a412db1f217e4fd25e31234aa"}
Sep 09 16:32:58.291566 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.291549    2567 scope.go:117] "RemoveContainer" containerID="0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7"
Sep 09 16:32:58.291943 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:32:58.291855    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7\": container with ID starting with 0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7 not found: ID does not exist" containerID="0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7"
Sep 09 16:32:58.291943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.291886    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7"} err="failed to get container status \"0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7\": rpc error: code = NotFound desc = could not find container \"0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7\": container with ID starting with 0924cc69be33651b9be502c753a88b97721d75300eaa176f238dda323613f9c7 not found: ID does not exist"
Sep 09 16:32:58.291943 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.291909    2567 scope.go:117] "RemoveContainer" containerID="50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9"
Sep 09 16:32:58.300686 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.300664    2567 scope.go:117] "RemoveContainer" containerID="50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9"
Sep 09 16:32:58.300984 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:32:58.300967    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9\": container with ID starting with 50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9 not found: ID does not exist" containerID="50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9"
Sep 09 16:32:58.301047 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.300991    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9"} err="failed to get container status \"50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9\": rpc error: code = NotFound desc = could not find container \"50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9\": container with ID starting with 50bd3c8a43ad1d07b318067fbc0d75f5ebff3bb7498f17d33671dd8e52f5b9d9 not found: ID does not exist"
Sep 09 16:32:58.307714 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.307694    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"]
Sep 09 16:32:58.310955 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.310910    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0d4fa04-9484f945-xjbnq"]
Sep 09 16:32:58.320060 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.320039    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"]
Sep 09 16:32:58.323101 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.323083    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0d4fa04-d7cc689db-2mkvw"]
Sep 09 16:32:58.739238 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.739199    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8493467f-60e5-4195-a651-fdebca3755dd" path="/var/lib/kubelet/pods/8493467f-60e5-4195-a651-fdebca3755dd/volumes"
Sep 09 16:32:58.739817 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:32:58.739767    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" path="/var/lib/kubelet/pods/9cbc153d-f8f8-4a17-b1c5-14b45be9dad6/volumes"
Sep 09 16:33:01.655080 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:01.655032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:06.729607 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:06.729571    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:22.967738 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:22.967699    2567 scope.go:117] "RemoveContainer" containerID="89960e63ae0fed74c65f0caaf8674a9b39d662ddd5c0a46f0086dcd72810da99"
Sep 09 16:33:25.859034 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:25.859001    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:26.656356 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:26.656316    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:31.833619 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.833587    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7688-2ad69c"]
Sep 09 16:33:31.834122 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.834106    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" containerName="maas-api"
Sep 09 16:33:31.834122 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.834123    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" containerName="maas-api"
Sep 09 16:33:31.834198 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.834143    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8493467f-60e5-4195-a651-fdebca3755dd" containerName="payload-pre-processing"
Sep 09 16:33:31.834198 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.834149    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8493467f-60e5-4195-a651-fdebca3755dd" containerName="payload-pre-processing"
Sep 09 16:33:31.834266 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.834221    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cbc153d-f8f8-4a17-b1c5-14b45be9dad6" containerName="maas-api"
Sep 09 16:33:31.834266 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.834231    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8493467f-60e5-4195-a651-fdebca3755dd" containerName="payload-pre-processing"
Sep 09 16:33:31.837509 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.837490    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-2ad69c"
Sep 09 16:33:31.840161 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.840142    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bzk7m\""
Sep 09 16:33:31.845156 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.844939    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7688-2ad69c"]
Sep 09 16:33:31.904530 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:31.904496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt42q\" (UniqueName: \"kubernetes.io/projected/649be539-56e1-4d9c-92c1-cb3cadc047a4-kube-api-access-mt42q\") pod \"mt-curl-7688-2ad69c\" (UID: \"649be539-56e1-4d9c-92c1-cb3cadc047a4\") " pod="opendatahub/mt-curl-7688-2ad69c"
Sep 09 16:33:32.005087 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:32.005054    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt42q\" (UniqueName: \"kubernetes.io/projected/649be539-56e1-4d9c-92c1-cb3cadc047a4-kube-api-access-mt42q\") pod \"mt-curl-7688-2ad69c\" (UID: \"649be539-56e1-4d9c-92c1-cb3cadc047a4\") " pod="opendatahub/mt-curl-7688-2ad69c"
Sep 09 16:33:32.013182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:32.013147    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt42q\" (UniqueName: \"kubernetes.io/projected/649be539-56e1-4d9c-92c1-cb3cadc047a4-kube-api-access-mt42q\") pod \"mt-curl-7688-2ad69c\" (UID: \"649be539-56e1-4d9c-92c1-cb3cadc047a4\") " pod="opendatahub/mt-curl-7688-2ad69c"
Sep 09 16:33:32.148115 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:32.148075    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-2ad69c"
Sep 09 16:33:32.297047 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:32.297010    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:32.369334 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:32.369300    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:32.419912 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:32.419883    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7688-2ad69c"]
Sep 09 16:33:32.421213 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:33:32.421188    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod649be539_56e1_4d9c_92c1_cb3cadc047a4.slice/crio-580fb91218f1ae1b86a716c73c090f2720aae589032afeb2a5f024ebc7f9feba WatchSource:0}: Error finding container 580fb91218f1ae1b86a716c73c090f2720aae589032afeb2a5f024ebc7f9feba: Status 404 returned error can't find the container with id 580fb91218f1ae1b86a716c73c090f2720aae589032afeb2a5f024ebc7f9feba
Sep 09 16:33:32.513400 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:32.513366    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7688-2ad69c" event={"ID":"649be539-56e1-4d9c-92c1-cb3cadc047a4","Type":"ContainerStarted","Data":"580fb91218f1ae1b86a716c73c090f2720aae589032afeb2a5f024ebc7f9feba"}
Sep 09 16:33:32.604370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:32.604336    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:33.075800 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:33.074587    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:33.522164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:33.522132    2567 generic.go:356] "Generic (PLEG): container finished" podID="649be539-56e1-4d9c-92c1-cb3cadc047a4" containerID="c7c673259151657bdb4e21c68152c1571380d4add786042a5fe87c2755570e0e" exitCode=0
Sep 09 16:33:33.522334 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:33.522224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7688-2ad69c" event={"ID":"649be539-56e1-4d9c-92c1-cb3cadc047a4","Type":"ContainerDied","Data":"c7c673259151657bdb4e21c68152c1571380d4add786042a5fe87c2755570e0e"}
Sep 09 16:33:33.956932 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:33.956901    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:34.052446 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.052408    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:34.170737 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.170704    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:34.672446 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.672421    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-2ad69c"
Sep 09 16:33:34.692447 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.692348    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7688-2ad69c_649be539-56e1-4d9c-92c1-cb3cadc047a4/mt-curl-7688-2ad69c/0.log"
Sep 09 16:33:34.721340 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.721299    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7688-2ad69c"]
Sep 09 16:33:34.727065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.727038    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7688-2ad69c"]
Sep 09 16:33:34.730260 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.730240    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt42q\" (UniqueName: \"kubernetes.io/projected/649be539-56e1-4d9c-92c1-cb3cadc047a4-kube-api-access-mt42q\") pod \"649be539-56e1-4d9c-92c1-cb3cadc047a4\" (UID: \"649be539-56e1-4d9c-92c1-cb3cadc047a4\") "
Sep 09 16:33:34.732350 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.732311    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/649be539-56e1-4d9c-92c1-cb3cadc047a4-kube-api-access-mt42q" (OuterVolumeSpecName: "kube-api-access-mt42q") pod "649be539-56e1-4d9c-92c1-cb3cadc047a4" (UID: "649be539-56e1-4d9c-92c1-cb3cadc047a4"). InnerVolumeSpecName "kube-api-access-mt42q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:33:34.738105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.738082    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="649be539-56e1-4d9c-92c1-cb3cadc047a4" path="/var/lib/kubelet/pods/649be539-56e1-4d9c-92c1-cb3cadc047a4/volumes"
Sep 09 16:33:34.831452 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.831350    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt42q\" (UniqueName: \"kubernetes.io/projected/649be539-56e1-4d9c-92c1-cb3cadc047a4-kube-api-access-mt42q\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:33:34.892864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.892826    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:34.990817 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:34.990786    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:35.090221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:35.090140    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:35.537298 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:35.537269    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-2ad69c"
Sep 09 16:33:35.537298 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:35.537302    2567 scope.go:117] "RemoveContainer" containerID="c7c673259151657bdb4e21c68152c1571380d4add786042a5fe87c2755570e0e"
Sep 09 16:33:36.226856 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:36.226827    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:36.542529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:36.542435    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:37.215963 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:37.215936    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:40.228317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:40.228280    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:42.407123 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:42.407087    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:42.507544 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:42.507511    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:43.171376 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:43.171338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:49.171345 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:49.171305    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:49.246991 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:49.246949    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:49.333755 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:49.333709    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:49.426271 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:49.426183    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:59.934553 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:33:59.934515    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:00.165288 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:00.165249    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:02.501492 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:02.501459    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:21.348559 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:21.348524    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:23.790902 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:23.790864    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:27.126351 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:27.126315    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:27.187888 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:27.187859    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:27.495131 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:27.495056    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:27.832756 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:27.832676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:28.446490 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:28.446458    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:31.088483 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:31.088446    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:31.187050 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:31.187015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:32.210566 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.210534    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"]
Sep 09 16:34:32.211201 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.211178    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="649be539-56e1-4d9c-92c1-cb3cadc047a4" containerName="mt-curl-7688-2ad69c"
Sep 09 16:34:32.211201 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.211201    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="649be539-56e1-4d9c-92c1-cb3cadc047a4" containerName="mt-curl-7688-2ad69c"
Sep 09 16:34:32.211346 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.211305    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="649be539-56e1-4d9c-92c1-cb3cadc047a4" containerName="mt-curl-7688-2ad69c"
Sep 09 16:34:32.214887 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.214864    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.217172 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.217148    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-5d8327-serving-cert\""
Sep 09 16:34:32.226129 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.226108    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"]
Sep 09 16:34:32.228473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.228446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.228590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.228557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-openshift-service-ca\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.228645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.228591    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7xq5\" (UniqueName: \"kubernetes.io/projected/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-kube-api-access-k7xq5\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.228704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.228648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-metrics-certs\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.239500 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.239475    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:32.302279 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.302250    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:32.330000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.329963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-openshift-service-ca\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.330182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.330003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7xq5\" (UniqueName: \"kubernetes.io/projected/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-kube-api-access-k7xq5\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.330182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.330067    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-metrics-certs\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.330182 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.330144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.330351 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:34:32.330303    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-serving-cert: secret "maas-api-e2e-api-a-5d8327-serving-cert" not found
Sep 09 16:34:32.330412 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:34:32.330382    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls podName:325b4200-cff5-4a26-ac8e-cb07ffe36b2b nodeName:}" failed. No retries permitted until 2026-09-09 16:34:32.830361875 +0000 UTC m=+1570.601453117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls") pod "maas-api-e2e-api-a-5d8327-6955467745-dxfgg" (UID: "325b4200-cff5-4a26-ac8e-cb07ffe36b2b") : secret "maas-api-e2e-api-a-5d8327-serving-cert" not found
Sep 09 16:34:32.330822 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.330766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-openshift-service-ca\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.332473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.332455    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-metrics-certs\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.338662 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.338638    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7xq5\" (UniqueName: \"kubernetes.io/projected/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-kube-api-access-k7xq5\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.715065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.715032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:32.819576 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.819530    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"]
Sep 09 16:34:32.823814 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.823785    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:32.826465 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.826435    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-5d8327\""
Sep 09 16:34:32.834498 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.834473    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"]
Sep 09 16:34:32.843958 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.843936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:32.844084 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.843985    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfqj\" (UniqueName: \"kubernetes.io/projected/9cd0409d-f81c-43cb-919e-94db1fad5d7a-kube-api-access-gwfqj\") pod \"payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59\" (UID: \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:32.844084 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.844033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cd0409d-f81c-43cb-919e-94db1fad5d7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59\" (UID: \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:32.844207 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:34:32.844088    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-serving-cert: secret "maas-api-e2e-api-a-5d8327-serving-cert" not found
Sep 09 16:34:32.844207 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:34:32.844152    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls podName:325b4200-cff5-4a26-ac8e-cb07ffe36b2b nodeName:}" failed. No retries permitted until 2026-09-09 16:34:33.844133036 +0000 UTC m=+1571.615224264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls") pod "maas-api-e2e-api-a-5d8327-6955467745-dxfgg" (UID: "325b4200-cff5-4a26-ac8e-cb07ffe36b2b") : secret "maas-api-e2e-api-a-5d8327-serving-cert" not found
Sep 09 16:34:32.945219 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.945188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfqj\" (UniqueName: \"kubernetes.io/projected/9cd0409d-f81c-43cb-919e-94db1fad5d7a-kube-api-access-gwfqj\") pod \"payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59\" (UID: \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:32.945409 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.945257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cd0409d-f81c-43cb-919e-94db1fad5d7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59\" (UID: \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:32.946028 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.945998    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cd0409d-f81c-43cb-919e-94db1fad5d7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59\" (UID: \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:32.953450 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:32.953424    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwfqj\" (UniqueName: \"kubernetes.io/projected/9cd0409d-f81c-43cb-919e-94db1fad5d7a-kube-api-access-gwfqj\") pod \"payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59\" (UID: \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:33.138114 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:33.138077    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:33.424842 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:33.424815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"]
Sep 09 16:34:33.426446 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:34:33.426415    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd0409d_f81c_43cb_919e_94db1fad5d7a.slice/crio-57ba7a0a0602394f5e5970fdeabbbd9284a4cf1b601a97e9e0f055cc2dbdbdff WatchSource:0}: Error finding container 57ba7a0a0602394f5e5970fdeabbbd9284a4cf1b601a97e9e0f055cc2dbdbdff: Status 404 returned error can't find the container with id 57ba7a0a0602394f5e5970fdeabbbd9284a4cf1b601a97e9e0f055cc2dbdbdff
Sep 09 16:34:33.856623 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:33.856523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:33.859736 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:33.859705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls\") pod \"maas-api-e2e-api-a-5d8327-6955467745-dxfgg\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:33.923070 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:33.923039    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59" event={"ID":"9cd0409d-f81c-43cb-919e-94db1fad5d7a","Type":"ContainerStarted","Data":"8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3"}
Sep 09 16:34:33.923210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:33.923089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59" event={"ID":"9cd0409d-f81c-43cb-919e-94db1fad5d7a","Type":"ContainerStarted","Data":"57ba7a0a0602394f5e5970fdeabbbd9284a4cf1b601a97e9e0f055cc2dbdbdff"}
Sep 09 16:34:33.923261 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:33.923230    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:33.940183 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:33.940125    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59" podStartSLOduration=1.940105611 podStartE2EDuration="1.940105611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:34:33.937575739 +0000 UTC m=+1571.708666982" watchObservedRunningTime="2026-09-09 16:34:33.940105611 +0000 UTC m=+1571.711196858"
Sep 09 16:34:34.029110 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:34.029078    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:34.306688 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:34.306660    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"]
Sep 09 16:34:34.308614 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:34:34.308589    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325b4200_cff5_4a26_ac8e_cb07ffe36b2b.slice/crio-bb0d7b07811eec16abb18fab280db866bfea48e37a8003ebd586200fd8dd81ab WatchSource:0}: Error finding container bb0d7b07811eec16abb18fab280db866bfea48e37a8003ebd586200fd8dd81ab: Status 404 returned error can't find the container with id bb0d7b07811eec16abb18fab280db866bfea48e37a8003ebd586200fd8dd81ab
Sep 09 16:34:34.935062 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:34.935034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg" event={"ID":"325b4200-cff5-4a26-ac8e-cb07ffe36b2b","Type":"ContainerStarted","Data":"f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea"}
Sep 09 16:34:34.935404 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:34.935084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg" event={"ID":"325b4200-cff5-4a26-ac8e-cb07ffe36b2b","Type":"ContainerStarted","Data":"bb0d7b07811eec16abb18fab280db866bfea48e37a8003ebd586200fd8dd81ab"}
Sep 09 16:34:34.950356 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:34.950311    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg" podStartSLOduration=2.404602168 podStartE2EDuration="2.950290353s" totalImagesPullingTime="545.688185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:34:34.949745738 +0000 UTC m=+1572.720836986" watchObservedRunningTime="2026-09-09 16:34:34.950290353 +0000 UTC m=+1572.721381602"
Sep 09 16:34:35.942157 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:35.942127    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:36.099236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:36.099200    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:36.157517 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:36.157489    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:41.955971 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:41.955942    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:34:44.937908 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:44.937879    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:34:45.351884 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:45.351803    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:46.946590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:46.946555    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7688-f9be63"]
Sep 09 16:34:46.950635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:46.950609    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-f9be63"
Sep 09 16:34:46.954105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:46.954079    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bzk7m\""
Sep 09 16:34:46.957079 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:46.957055    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7688-f9be63"]
Sep 09 16:34:47.089974 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:47.089926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xprzz\" (UniqueName: \"kubernetes.io/projected/687612b0-6dc7-4553-bedc-d6fe82d1359e-kube-api-access-xprzz\") pod \"mt-curl-7688-f9be63\" (UID: \"687612b0-6dc7-4553-bedc-d6fe82d1359e\") " pod="opendatahub/mt-curl-7688-f9be63"
Sep 09 16:34:47.190695 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:47.190655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xprzz\" (UniqueName: \"kubernetes.io/projected/687612b0-6dc7-4553-bedc-d6fe82d1359e-kube-api-access-xprzz\") pod \"mt-curl-7688-f9be63\" (UID: \"687612b0-6dc7-4553-bedc-d6fe82d1359e\") " pod="opendatahub/mt-curl-7688-f9be63"
Sep 09 16:34:47.199846 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:47.199764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xprzz\" (UniqueName: \"kubernetes.io/projected/687612b0-6dc7-4553-bedc-d6fe82d1359e-kube-api-access-xprzz\") pod \"mt-curl-7688-f9be63\" (UID: \"687612b0-6dc7-4553-bedc-d6fe82d1359e\") " pod="opendatahub/mt-curl-7688-f9be63"
Sep 09 16:34:47.265273 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:47.265241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-f9be63"
Sep 09 16:34:47.538590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:47.538556    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7688-f9be63"]
Sep 09 16:34:47.539758 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:34:47.539730    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod687612b0_6dc7_4553_bedc_d6fe82d1359e.slice/crio-c8e79af75891472930a77de595b3439daa13b00283a77f9c78ec1ef641c2dade WatchSource:0}: Error finding container c8e79af75891472930a77de595b3439daa13b00283a77f9c78ec1ef641c2dade: Status 404 returned error can't find the container with id c8e79af75891472930a77de595b3439daa13b00283a77f9c78ec1ef641c2dade
Sep 09 16:34:48.026510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:48.026402    2567 generic.go:356] "Generic (PLEG): container finished" podID="687612b0-6dc7-4553-bedc-d6fe82d1359e" containerID="94971a0eb14d44dd155143a73186d4a6fd03d985ba4e560b9da28f57704b5ec8" exitCode=0
Sep 09 16:34:48.026510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:48.026469    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7688-f9be63" event={"ID":"687612b0-6dc7-4553-bedc-d6fe82d1359e","Type":"ContainerDied","Data":"94971a0eb14d44dd155143a73186d4a6fd03d985ba4e560b9da28f57704b5ec8"}
Sep 09 16:34:48.026510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:48.026511    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7688-f9be63" event={"ID":"687612b0-6dc7-4553-bedc-d6fe82d1359e","Type":"ContainerStarted","Data":"c8e79af75891472930a77de595b3439daa13b00283a77f9c78ec1ef641c2dade"}
Sep 09 16:34:49.177007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.176980    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-f9be63"
Sep 09 16:34:49.197265 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.197237    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7688-f9be63_687612b0-6dc7-4553-bedc-d6fe82d1359e/mt-curl-7688-f9be63/0.log"
Sep 09 16:34:49.227890 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.227859    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7688-f9be63"]
Sep 09 16:34:49.230733 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.230711    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7688-f9be63"]
Sep 09 16:34:49.311089 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.311001    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xprzz\" (UniqueName: \"kubernetes.io/projected/687612b0-6dc7-4553-bedc-d6fe82d1359e-kube-api-access-xprzz\") pod \"687612b0-6dc7-4553-bedc-d6fe82d1359e\" (UID: \"687612b0-6dc7-4553-bedc-d6fe82d1359e\") "
Sep 09 16:34:49.313209 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.313178    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/687612b0-6dc7-4553-bedc-d6fe82d1359e-kube-api-access-xprzz" (OuterVolumeSpecName: "kube-api-access-xprzz") pod "687612b0-6dc7-4553-bedc-d6fe82d1359e" (UID: "687612b0-6dc7-4553-bedc-d6fe82d1359e"). InnerVolumeSpecName "kube-api-access-xprzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:34:49.351177 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.351147    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7688-ed42a0"]
Sep 09 16:34:49.351671 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.351658    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="687612b0-6dc7-4553-bedc-d6fe82d1359e" containerName="mt-curl-7688-f9be63"
Sep 09 16:34:49.351716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.351673    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="687612b0-6dc7-4553-bedc-d6fe82d1359e" containerName="mt-curl-7688-f9be63"
Sep 09 16:34:49.351793 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.351781    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="687612b0-6dc7-4553-bedc-d6fe82d1359e" containerName="mt-curl-7688-f9be63"
Sep 09 16:34:49.355056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.355036    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-ed42a0"
Sep 09 16:34:49.360965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.360942    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7688-ed42a0"]
Sep 09 16:34:49.412721 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.412692    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xprzz\" (UniqueName: \"kubernetes.io/projected/687612b0-6dc7-4553-bedc-d6fe82d1359e-kube-api-access-xprzz\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:34:49.513950 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.513916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdlfv\" (UniqueName: \"kubernetes.io/projected/5259f4c8-691d-43d9-ab64-43b52f6e7aea-kube-api-access-fdlfv\") pod \"mt-curl-7688-ed42a0\" (UID: \"5259f4c8-691d-43d9-ab64-43b52f6e7aea\") " pod="opendatahub/mt-curl-7688-ed42a0"
Sep 09 16:34:49.615165 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.615090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdlfv\" (UniqueName: \"kubernetes.io/projected/5259f4c8-691d-43d9-ab64-43b52f6e7aea-kube-api-access-fdlfv\") pod \"mt-curl-7688-ed42a0\" (UID: \"5259f4c8-691d-43d9-ab64-43b52f6e7aea\") " pod="opendatahub/mt-curl-7688-ed42a0"
Sep 09 16:34:49.623336 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.623313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdlfv\" (UniqueName: \"kubernetes.io/projected/5259f4c8-691d-43d9-ab64-43b52f6e7aea-kube-api-access-fdlfv\") pod \"mt-curl-7688-ed42a0\" (UID: \"5259f4c8-691d-43d9-ab64-43b52f6e7aea\") " pod="opendatahub/mt-curl-7688-ed42a0"
Sep 09 16:34:49.666325 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.666295    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-ed42a0"
Sep 09 16:34:49.940921 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:49.940892    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7688-ed42a0"]
Sep 09 16:34:49.941928 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:34:49.941904    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5259f4c8_691d_43d9_ab64_43b52f6e7aea.slice/crio-494c60d9e08c30b25d388314f2e1fd37b54767ada3030cca6e66dc75fd498c65 WatchSource:0}: Error finding container 494c60d9e08c30b25d388314f2e1fd37b54767ada3030cca6e66dc75fd498c65: Status 404 returned error can't find the container with id 494c60d9e08c30b25d388314f2e1fd37b54767ada3030cca6e66dc75fd498c65
Sep 09 16:34:50.041437 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:50.041401    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7688-ed42a0" event={"ID":"5259f4c8-691d-43d9-ab64-43b52f6e7aea","Type":"ContainerStarted","Data":"494c60d9e08c30b25d388314f2e1fd37b54767ada3030cca6e66dc75fd498c65"}
Sep 09 16:34:50.042621 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:50.042600    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8e79af75891472930a77de595b3439daa13b00283a77f9c78ec1ef641c2dade"
Sep 09 16:34:50.042733 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:50.042633    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-f9be63"
Sep 09 16:34:50.053584 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:34:50.053558    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7688-f9be63\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="687612b0-6dc7-4553-bedc-d6fe82d1359e" pod="opendatahub/mt-curl-7688-f9be63"
Sep 09 16:34:50.738079 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:50.738034    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="687612b0-6dc7-4553-bedc-d6fe82d1359e" path="/var/lib/kubelet/pods/687612b0-6dc7-4553-bedc-d6fe82d1359e/volumes"
Sep 09 16:34:51.051065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:51.050965    2567 generic.go:356] "Generic (PLEG): container finished" podID="5259f4c8-691d-43d9-ab64-43b52f6e7aea" containerID="82fe6080a816b9bfac5e8834c169e57e5f70960cc3aed61333a7bb39de2c447d" exitCode=0
Sep 09 16:34:51.051065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:51.051045    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7688-ed42a0" event={"ID":"5259f4c8-691d-43d9-ab64-43b52f6e7aea","Type":"ContainerDied","Data":"82fe6080a816b9bfac5e8834c169e57e5f70960cc3aed61333a7bb39de2c447d"}
Sep 09 16:34:51.186747 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:51.186712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:52.202007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:52.201976    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-ed42a0"
Sep 09 16:34:52.222233 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:52.222206    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7688-ed42a0_5259f4c8-691d-43d9-ab64-43b52f6e7aea/mt-curl-7688-ed42a0/0.log"
Sep 09 16:34:52.247814 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:52.247766    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7688-ed42a0"]
Sep 09 16:34:52.260606 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:52.253006    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7688-ed42a0"]
Sep 09 16:34:52.343302 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:52.343227    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdlfv\" (UniqueName: \"kubernetes.io/projected/5259f4c8-691d-43d9-ab64-43b52f6e7aea-kube-api-access-fdlfv\") pod \"5259f4c8-691d-43d9-ab64-43b52f6e7aea\" (UID: \"5259f4c8-691d-43d9-ab64-43b52f6e7aea\") "
Sep 09 16:34:52.345221 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:52.345190    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5259f4c8-691d-43d9-ab64-43b52f6e7aea-kube-api-access-fdlfv" (OuterVolumeSpecName: "kube-api-access-fdlfv") pod "5259f4c8-691d-43d9-ab64-43b52f6e7aea" (UID: "5259f4c8-691d-43d9-ab64-43b52f6e7aea"). InnerVolumeSpecName "kube-api-access-fdlfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:34:52.444750 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:52.444718    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdlfv\" (UniqueName: \"kubernetes.io/projected/5259f4c8-691d-43d9-ab64-43b52f6e7aea-kube-api-access-fdlfv\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:34:52.738328 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:52.738294    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5259f4c8-691d-43d9-ab64-43b52f6e7aea" path="/var/lib/kubelet/pods/5259f4c8-691d-43d9-ab64-43b52f6e7aea/volumes"
Sep 09 16:34:53.066332 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:53.066249    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7688-ed42a0"
Sep 09 16:34:53.066332 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:53.066291    2567 scope.go:117] "RemoveContainer" containerID="82fe6080a816b9bfac5e8834c169e57e5f70960cc3aed61333a7bb39de2c447d"
Sep 09 16:34:54.321666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:54.321630    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:54.738978 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:54.738945    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:55.500026 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:55.499987    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:56.053699 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:56.053664    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:56.505007 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:56.504972    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:56.833620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:56.833533    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:56.995043 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:34:56.995006    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:00.253587 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:00.253545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:00.349520 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:00.349477    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:01.562613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:01.562574    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:01.664088 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:01.664051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:02.179619 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.179585    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"]
Sep 09 16:35:02.180126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.180112    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5259f4c8-691d-43d9-ab64-43b52f6e7aea" containerName="mt-curl-7688-ed42a0"
Sep 09 16:35:02.180184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.180127    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5259f4c8-691d-43d9-ab64-43b52f6e7aea" containerName="mt-curl-7688-ed42a0"
Sep 09 16:35:02.180223 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.180214    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5259f4c8-691d-43d9-ab64-43b52f6e7aea" containerName="mt-curl-7688-ed42a0"
Sep 09 16:35:02.183584 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.183565    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:02.186365 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.186344    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ab78ef\""
Sep 09 16:35:02.186842 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.186822    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ab78ef-dockercfg-qrtjb\""
Sep 09 16:35:02.193117 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.193095    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"]
Sep 09 16:35:02.219905 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.219872    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:02.243314 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.243281    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87lj5\" (UniqueName: \"kubernetes.io/projected/14c7757c-0e24-4157-88c6-e66b37218e1c-kube-api-access-87lj5\") pod \"payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5\" (UID: \"14c7757c-0e24-4157-88c6-e66b37218e1c\") " pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:02.243470 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.243353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c7757c-0e24-4157-88c6-e66b37218e1c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5\" (UID: \"14c7757c-0e24-4157-88c6-e66b37218e1c\") " pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:02.283236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.283193    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:02.344262 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.344217    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87lj5\" (UniqueName: \"kubernetes.io/projected/14c7757c-0e24-4157-88c6-e66b37218e1c-kube-api-access-87lj5\") pod \"payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5\" (UID: \"14c7757c-0e24-4157-88c6-e66b37218e1c\") " pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:02.344461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.344312    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c7757c-0e24-4157-88c6-e66b37218e1c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5\" (UID: \"14c7757c-0e24-4157-88c6-e66b37218e1c\") " pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:02.345117 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.345096    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c7757c-0e24-4157-88c6-e66b37218e1c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5\" (UID: \"14c7757c-0e24-4157-88c6-e66b37218e1c\") " pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:02.352671 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.352642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87lj5\" (UniqueName: \"kubernetes.io/projected/14c7757c-0e24-4157-88c6-e66b37218e1c-kube-api-access-87lj5\") pod \"payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5\" (UID: \"14c7757c-0e24-4157-88c6-e66b37218e1c\") " pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:02.495795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.495669    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:02.794223 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:02.794192    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"]
Sep 09 16:35:03.138309 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:03.138266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5" event={"ID":"14c7757c-0e24-4157-88c6-e66b37218e1c","Type":"ContainerStarted","Data":"941e3709028c7b57388b8a15a2b4534dfc22115736bce1135876e7b3a2d8799f"}
Sep 09 16:35:03.138515 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:03.138330    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:03.138515 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:03.138354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5" event={"ID":"14c7757c-0e24-4157-88c6-e66b37218e1c","Type":"ContainerStarted","Data":"bcdcc9c42d0e4e8df5be93d508f7570f173624f9a3ccf17e311b0b01916ef523"}
Sep 09 16:35:03.158905 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:03.158830    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5" podStartSLOduration=1.158807213 podStartE2EDuration="1.158807213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:35:03.155726778 +0000 UTC m=+1600.926818026" watchObservedRunningTime="2026-09-09 16:35:03.158807213 +0000 UTC m=+1600.929898460"
Sep 09 16:35:08.828317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:08.828276    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:14.147891 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:14.147854    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:35:24.044580 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:24.044545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:25.431056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:25.431010    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:28.542323 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:28.542286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:43.850535 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:43.850491    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"]
Sep 09 16:35:43.851040 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:43.850755    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg" podUID="325b4200-cff5-4a26-ac8e-cb07ffe36b2b" containerName="maas-api" containerID="cri-o://f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea" gracePeriod=30
Sep 09 16:35:43.915047 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:43.915011    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"]
Sep 09 16:35:43.915379 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:43.915322    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59" podUID="9cd0409d-f81c-43cb-919e-94db1fad5d7a" containerName="payload-pre-processing" containerID="cri-o://8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3" gracePeriod=30
Sep 09 16:35:43.945887 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:43.945855    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:44.052336 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.052235    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:44.109472 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.109380    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:44.184529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.184496    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:35:44.219779 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.219753    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:35:44.267128 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267097    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cd0409d-f81c-43cb-919e-94db1fad5d7a-plugins-config-volume\") pod \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\" (UID: \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\") "
Sep 09 16:35:44.267317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267166    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7xq5\" (UniqueName: \"kubernetes.io/projected/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-kube-api-access-k7xq5\") pod \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") "
Sep 09 16:35:44.267317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267236    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-openshift-service-ca\") pod \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") "
Sep 09 16:35:44.267317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267267    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwfqj\" (UniqueName: \"kubernetes.io/projected/9cd0409d-f81c-43cb-919e-94db1fad5d7a-kube-api-access-gwfqj\") pod \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\" (UID: \"9cd0409d-f81c-43cb-919e-94db1fad5d7a\") "
Sep 09 16:35:44.267317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267297    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls\") pod \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") "
Sep 09 16:35:44.267538 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267361    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-metrics-certs\") pod \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\" (UID: \"325b4200-cff5-4a26-ac8e-cb07ffe36b2b\") "
Sep 09 16:35:44.267596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267530    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd0409d-f81c-43cb-919e-94db1fad5d7a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9cd0409d-f81c-43cb-919e-94db1fad5d7a" (UID: "9cd0409d-f81c-43cb-919e-94db1fad5d7a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:35:44.267596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267552    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "325b4200-cff5-4a26-ac8e-cb07ffe36b2b" (UID: "325b4200-cff5-4a26-ac8e-cb07ffe36b2b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:35:44.267795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267760    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:35:44.267889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.267800    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cd0409d-f81c-43cb-919e-94db1fad5d7a-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:35:44.269550 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.269524    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd0409d-f81c-43cb-919e-94db1fad5d7a-kube-api-access-gwfqj" (OuterVolumeSpecName: "kube-api-access-gwfqj") pod "9cd0409d-f81c-43cb-919e-94db1fad5d7a" (UID: "9cd0409d-f81c-43cb-919e-94db1fad5d7a"). InnerVolumeSpecName "kube-api-access-gwfqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:35:44.269906 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.269882    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-kube-api-access-k7xq5" (OuterVolumeSpecName: "kube-api-access-k7xq5") pod "325b4200-cff5-4a26-ac8e-cb07ffe36b2b" (UID: "325b4200-cff5-4a26-ac8e-cb07ffe36b2b"). InnerVolumeSpecName "kube-api-access-k7xq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:35:44.270064 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.270033    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "325b4200-cff5-4a26-ac8e-cb07ffe36b2b" (UID: "325b4200-cff5-4a26-ac8e-cb07ffe36b2b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:35:44.270064 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.270055    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "325b4200-cff5-4a26-ac8e-cb07ffe36b2b" (UID: "325b4200-cff5-4a26-ac8e-cb07ffe36b2b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:35:44.368987 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.368896    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7xq5\" (UniqueName: \"kubernetes.io/projected/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-kube-api-access-k7xq5\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:35:44.368987 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.368928    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwfqj\" (UniqueName: \"kubernetes.io/projected/9cd0409d-f81c-43cb-919e-94db1fad5d7a-kube-api-access-gwfqj\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:35:44.368987 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.368943    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:35:44.368987 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.368954    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/325b4200-cff5-4a26-ac8e-cb07ffe36b2b-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:35:44.429597 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.429559    2567 generic.go:356] "Generic (PLEG): container finished" podID="325b4200-cff5-4a26-ac8e-cb07ffe36b2b" containerID="f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea" exitCode=0
Sep 09 16:35:44.429818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.429622    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"
Sep 09 16:35:44.429818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.429647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg" event={"ID":"325b4200-cff5-4a26-ac8e-cb07ffe36b2b","Type":"ContainerDied","Data":"f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea"}
Sep 09 16:35:44.429818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.429738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg" event={"ID":"325b4200-cff5-4a26-ac8e-cb07ffe36b2b","Type":"ContainerDied","Data":"bb0d7b07811eec16abb18fab280db866bfea48e37a8003ebd586200fd8dd81ab"}
Sep 09 16:35:44.429818 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.429783    2567 scope.go:117] "RemoveContainer" containerID="f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea"
Sep 09 16:35:44.431316 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.431290    2567 generic.go:356] "Generic (PLEG): container finished" podID="9cd0409d-f81c-43cb-919e-94db1fad5d7a" containerID="8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3" exitCode=0
Sep 09 16:35:44.431430 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.431324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59" event={"ID":"9cd0409d-f81c-43cb-919e-94db1fad5d7a","Type":"ContainerDied","Data":"8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3"}
Sep 09 16:35:44.431430 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.431349    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"
Sep 09 16:35:44.431430 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.431370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59" event={"ID":"9cd0409d-f81c-43cb-919e-94db1fad5d7a","Type":"ContainerDied","Data":"57ba7a0a0602394f5e5970fdeabbbd9284a4cf1b601a97e9e0f055cc2dbdbdff"}
Sep 09 16:35:44.443792 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.443723    2567 scope.go:117] "RemoveContainer" containerID="f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea"
Sep 09 16:35:44.444627 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:35:44.444596    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea\": container with ID starting with f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea not found: ID does not exist" containerID="f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea"
Sep 09 16:35:44.444746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.444637    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea"} err="failed to get container status \"f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea\": rpc error: code = NotFound desc = could not find container \"f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea\": container with ID starting with f90e2dcaaa22211e8d61c61f0f753e86fc66635536f677d6acf38ab8845b28ea not found: ID does not exist"
Sep 09 16:35:44.444746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.444661    2567 scope.go:117] "RemoveContainer" containerID="8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3"
Sep 09 16:35:44.456461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.456435    2567 scope.go:117] "RemoveContainer" containerID="8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3"
Sep 09 16:35:44.456880 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:35:44.456793    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3\": container with ID starting with 8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3 not found: ID does not exist" containerID="8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3"
Sep 09 16:35:44.456880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.456825    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3"} err="failed to get container status \"8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3\": rpc error: code = NotFound desc = could not find container \"8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3\": container with ID starting with 8c5caa61c0796b89095a4b406a46052d90ecd1710a56785fbdbd2393c6aff7e3 not found: ID does not exist"
Sep 09 16:35:44.459726 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.459704    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"]
Sep 09 16:35:44.465704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.465681    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5d8327-6955467745-dxfgg"]
Sep 09 16:35:44.475806 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.475781    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"]
Sep 09 16:35:44.478535 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.478515    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5d8327-66dfbd6c7d-5dw59"]
Sep 09 16:35:44.490344 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.490319    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:44.739042 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.739009    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="325b4200-cff5-4a26-ac8e-cb07ffe36b2b" path="/var/lib/kubelet/pods/325b4200-cff5-4a26-ac8e-cb07ffe36b2b/volumes"
Sep 09 16:35:44.739442 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:44.739427    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd0409d-f81c-43cb-919e-94db1fad5d7a" path="/var/lib/kubelet/pods/9cd0409d-f81c-43cb-919e-94db1fad5d7a/volumes"
Sep 09 16:35:45.645974 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:45.645933    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:50.266373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:50.266338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:50.337852 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:50.337819    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:50.590177 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:50.590084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:51.041198 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:51.041163    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:58.903152 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:35:58.903117    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:06.367716 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.367680    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:06.401121 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.401082    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"]
Sep 09 16:36:06.401596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.401556    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5" podUID="14c7757c-0e24-4157-88c6-e66b37218e1c" containerName="payload-processing" containerID="cri-o://941e3709028c7b57388b8a15a2b4534dfc22115736bce1135876e7b3a2d8799f" gracePeriod=30
Sep 09 16:36:06.467704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.467668    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:06.558199 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.558158    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:06.591577 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.591547    2567 generic.go:356] "Generic (PLEG): container finished" podID="14c7757c-0e24-4157-88c6-e66b37218e1c" containerID="941e3709028c7b57388b8a15a2b4534dfc22115736bce1135876e7b3a2d8799f" exitCode=0
Sep 09 16:36:06.591732 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.591626    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5" event={"ID":"14c7757c-0e24-4157-88c6-e66b37218e1c","Type":"ContainerDied","Data":"941e3709028c7b57388b8a15a2b4534dfc22115736bce1135876e7b3a2d8799f"}
Sep 09 16:36:06.617192 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.617149    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:06.665953 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.665922    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:36:06.809048 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.809015    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87lj5\" (UniqueName: \"kubernetes.io/projected/14c7757c-0e24-4157-88c6-e66b37218e1c-kube-api-access-87lj5\") pod \"14c7757c-0e24-4157-88c6-e66b37218e1c\" (UID: \"14c7757c-0e24-4157-88c6-e66b37218e1c\") "
Sep 09 16:36:06.809255 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.809084    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c7757c-0e24-4157-88c6-e66b37218e1c-plugins-config-volume\") pod \"14c7757c-0e24-4157-88c6-e66b37218e1c\" (UID: \"14c7757c-0e24-4157-88c6-e66b37218e1c\") "
Sep 09 16:36:06.809439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.809415    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c7757c-0e24-4157-88c6-e66b37218e1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14c7757c-0e24-4157-88c6-e66b37218e1c" (UID: "14c7757c-0e24-4157-88c6-e66b37218e1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:36:06.811122 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.811100    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c7757c-0e24-4157-88c6-e66b37218e1c-kube-api-access-87lj5" (OuterVolumeSpecName: "kube-api-access-87lj5") pod "14c7757c-0e24-4157-88c6-e66b37218e1c" (UID: "14c7757c-0e24-4157-88c6-e66b37218e1c"). InnerVolumeSpecName "kube-api-access-87lj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:36:06.910813 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.910686    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87lj5\" (UniqueName: \"kubernetes.io/projected/14c7757c-0e24-4157-88c6-e66b37218e1c-kube-api-access-87lj5\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:06.910813 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.910717    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c7757c-0e24-4157-88c6-e66b37218e1c-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:06.973448 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:06.973408    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:07.600625 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:07.600590    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5" event={"ID":"14c7757c-0e24-4157-88c6-e66b37218e1c","Type":"ContainerDied","Data":"bcdcc9c42d0e4e8df5be93d508f7570f173624f9a3ccf17e311b0b01916ef523"}
Sep 09 16:36:07.600625 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:07.600613    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"
Sep 09 16:36:07.601150 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:07.600650    2567 scope.go:117] "RemoveContainer" containerID="941e3709028c7b57388b8a15a2b4534dfc22115736bce1135876e7b3a2d8799f"
Sep 09 16:36:07.627117 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:07.627072    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"]
Sep 09 16:36:07.631001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:07.630975    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ab78ef-844c9b58c5-6rtk5"]
Sep 09 16:36:08.737796 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:08.737735    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c7757c-0e24-4157-88c6-e66b37218e1c" path="/var/lib/kubelet/pods/14c7757c-0e24-4157-88c6-e66b37218e1c/volumes"
Sep 09 16:36:13.393307 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:13.393275    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:13.494264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:13.494232    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:13.860370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:13.860274    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:15.570030 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:15.569996    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:23.954092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:23.954033    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:24.599383 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.599347    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"]
Sep 09 16:36:24.599898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.599844    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph" podUID="5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" containerName="maas-api" containerID="cri-o://3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f" gracePeriod=30
Sep 09 16:36:24.617381 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.617347    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:24.719823 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.719791    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:24.800319 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.800280    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:24.868629 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.868567    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:36:24.978754 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.978723    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxk69\" (UniqueName: \"kubernetes.io/projected/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-kube-api-access-zxk69\") pod \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") "
Sep 09 16:36:24.979184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.978825    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-openshift-service-ca\") pod \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") "
Sep 09 16:36:24.979184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.978877    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-metrics-certs\") pod \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") "
Sep 09 16:36:24.979184 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.978935    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls\") pod \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\" (UID: \"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c\") "
Sep 09 16:36:24.979361 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.979180    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" (UID: "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:36:24.979361 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.979329    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:24.981029 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.981003    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-kube-api-access-zxk69" (OuterVolumeSpecName: "kube-api-access-zxk69") pod "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" (UID: "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c"). InnerVolumeSpecName "kube-api-access-zxk69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:36:24.981137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.981024    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" (UID: "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:36:24.981294 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:24.981273    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" (UID: "5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:36:25.080146 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.080115    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:25.080146 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.080143    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxk69\" (UniqueName: \"kubernetes.io/projected/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-kube-api-access-zxk69\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:25.080146 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.080154    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:25.440113 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.440079    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:25.725526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.725438    2567 generic.go:356] "Generic (PLEG): container finished" podID="5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" containerID="3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f" exitCode=0
Sep 09 16:36:25.725526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.725484    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"
Sep 09 16:36:25.725526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.725523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph" event={"ID":"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c","Type":"ContainerDied","Data":"3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f"}
Sep 09 16:36:25.725796 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.725567    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph" event={"ID":"5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c","Type":"ContainerDied","Data":"23a63192d271bf928384e59df01b59376215fd24fdb6076f02bec03d4ac10dc2"}
Sep 09 16:36:25.725796 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.725591    2567 scope.go:117] "RemoveContainer" containerID="3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f"
Sep 09 16:36:25.735687 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.735669    2567 scope.go:117] "RemoveContainer" containerID="3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f"
Sep 09 16:36:25.735979 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:36:25.735959    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f\": container with ID starting with 3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f not found: ID does not exist" containerID="3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f"
Sep 09 16:36:25.736057 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.735991    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f"} err="failed to get container status \"3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f\": rpc error: code = NotFound desc = could not find container \"3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f\": container with ID starting with 3bf224f545ade444fd9b94afc719e55ef351c34ade88547cc144d4c1acd1f65f not found: ID does not exist"
Sep 09 16:36:25.748099 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.748056    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"]
Sep 09 16:36:25.751388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.751362    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-042f8b-74bb9c79d7-2zmph"]
Sep 09 16:36:25.925839 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:25.925806    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:26.738355 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:26.738318    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" path="/var/lib/kubelet/pods/5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c/volumes"
Sep 09 16:36:30.962059 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:30.961987    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:31.061967 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:31.061926    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:31.285659 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:31.285582    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:31.724379 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:31.724344    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:42.077487 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.077450    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:42.103207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.103173    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"]
Sep 09 16:36:42.103434 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.103410    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk" podUID="86d9da17-b828-44a3-bd15-4ab68962d698" containerName="payload-processing" containerID="cri-o://439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005" gracePeriod=30
Sep 09 16:36:42.112491 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.112459    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"]
Sep 09 16:36:42.112715 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.112689    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9" podUID="0ec6e8bc-fef2-4653-af17-015fe15af372" containerName="payload-pre-processing" containerID="cri-o://e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631" gracePeriod=30
Sep 09 16:36:42.230313 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.230283    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:42.288385 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.288348    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:42.396980 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.396958    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:36:42.399896 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.399876    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:36:42.551665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.551626    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec6e8bc-fef2-4653-af17-015fe15af372-plugins-config-volume\") pod \"0ec6e8bc-fef2-4653-af17-015fe15af372\" (UID: \"0ec6e8bc-fef2-4653-af17-015fe15af372\") "
Sep 09 16:36:42.551665 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.551672    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d9da17-b828-44a3-bd15-4ab68962d698-plugins-config-volume\") pod \"86d9da17-b828-44a3-bd15-4ab68962d698\" (UID: \"86d9da17-b828-44a3-bd15-4ab68962d698\") "
Sep 09 16:36:42.551983 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.551720    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k76wv\" (UniqueName: \"kubernetes.io/projected/86d9da17-b828-44a3-bd15-4ab68962d698-kube-api-access-k76wv\") pod \"86d9da17-b828-44a3-bd15-4ab68962d698\" (UID: \"86d9da17-b828-44a3-bd15-4ab68962d698\") "
Sep 09 16:36:42.551983 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.551739    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2j5h\" (UniqueName: \"kubernetes.io/projected/0ec6e8bc-fef2-4653-af17-015fe15af372-kube-api-access-s2j5h\") pod \"0ec6e8bc-fef2-4653-af17-015fe15af372\" (UID: \"0ec6e8bc-fef2-4653-af17-015fe15af372\") "
Sep 09 16:36:42.552134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.552101    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec6e8bc-fef2-4653-af17-015fe15af372-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ec6e8bc-fef2-4653-af17-015fe15af372" (UID: "0ec6e8bc-fef2-4653-af17-015fe15af372"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:36:42.552217 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.552176    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d9da17-b828-44a3-bd15-4ab68962d698-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86d9da17-b828-44a3-bd15-4ab68962d698" (UID: "86d9da17-b828-44a3-bd15-4ab68962d698"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:36:42.554137 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.554099    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec6e8bc-fef2-4653-af17-015fe15af372-kube-api-access-s2j5h" (OuterVolumeSpecName: "kube-api-access-s2j5h") pod "0ec6e8bc-fef2-4653-af17-015fe15af372" (UID: "0ec6e8bc-fef2-4653-af17-015fe15af372"). InnerVolumeSpecName "kube-api-access-s2j5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:36:42.554253 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.554185    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d9da17-b828-44a3-bd15-4ab68962d698-kube-api-access-k76wv" (OuterVolumeSpecName: "kube-api-access-k76wv") pod "86d9da17-b828-44a3-bd15-4ab68962d698" (UID: "86d9da17-b828-44a3-bd15-4ab68962d698"). InnerVolumeSpecName "kube-api-access-k76wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:36:42.636141 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.636109    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:42.653308 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.653271    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k76wv\" (UniqueName: \"kubernetes.io/projected/86d9da17-b828-44a3-bd15-4ab68962d698-kube-api-access-k76wv\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:42.653308 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.653303    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2j5h\" (UniqueName: \"kubernetes.io/projected/0ec6e8bc-fef2-4653-af17-015fe15af372-kube-api-access-s2j5h\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:42.653494 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.653314    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec6e8bc-fef2-4653-af17-015fe15af372-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:42.653494 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.653325    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d9da17-b828-44a3-bd15-4ab68962d698-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:36:42.840617 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.840582    2567 generic.go:356] "Generic (PLEG): container finished" podID="86d9da17-b828-44a3-bd15-4ab68962d698" containerID="439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005" exitCode=0
Sep 09 16:36:42.840802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.840623    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"
Sep 09 16:36:42.840802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.840672    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk" event={"ID":"86d9da17-b828-44a3-bd15-4ab68962d698","Type":"ContainerDied","Data":"439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005"}
Sep 09 16:36:42.840802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.840724    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk" event={"ID":"86d9da17-b828-44a3-bd15-4ab68962d698","Type":"ContainerDied","Data":"759356b8b0008e2b83fcddb611dc0bb6d0f8c5e6e4b7b8526acda1ab4b7c0250"}
Sep 09 16:36:42.840802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.840748    2567 scope.go:117] "RemoveContainer" containerID="439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005"
Sep 09 16:36:42.842112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.842089    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ec6e8bc-fef2-4653-af17-015fe15af372" containerID="e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631" exitCode=0
Sep 09 16:36:42.842210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.842136    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"
Sep 09 16:36:42.842210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.842171    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9" event={"ID":"0ec6e8bc-fef2-4653-af17-015fe15af372","Type":"ContainerDied","Data":"e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631"}
Sep 09 16:36:42.842320 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.842225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9" event={"ID":"0ec6e8bc-fef2-4653-af17-015fe15af372","Type":"ContainerDied","Data":"6306c12928151cdd249f87eb5464c5e3fdde191441596bdd178edc0f8f7c8234"}
Sep 09 16:36:42.850669 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.850648    2567 scope.go:117] "RemoveContainer" containerID="439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005"
Sep 09 16:36:42.851035 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:36:42.851006    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005\": container with ID starting with 439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005 not found: ID does not exist" containerID="439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005"
Sep 09 16:36:42.851142 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.851048    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005"} err="failed to get container status \"439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005\": rpc error: code = NotFound desc = could not find container \"439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005\": container with ID starting with 439ea98f187f4d853127ee1a96f7f442c5a444e5433c6db1b42d7f37ac285005 not found: ID does not exist"
Sep 09 16:36:42.851142 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.851071    2567 scope.go:117] "RemoveContainer" containerID="e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631"
Sep 09 16:36:42.861281 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.861251    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"]
Sep 09 16:36:42.864092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.864068    2567 scope.go:117] "RemoveContainer" containerID="e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631"
Sep 09 16:36:42.864409 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:36:42.864388    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631\": container with ID starting with e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631 not found: ID does not exist" containerID="e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631"
Sep 09 16:36:42.864492 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.864416    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631"} err="failed to get container status \"e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631\": rpc error: code = NotFound desc = could not find container \"e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631\": container with ID starting with e30e283bb271b04d5f1c047833577d619e9a74c86bec033be259b981e89d5631 not found: ID does not exist"
Sep 09 16:36:42.865347 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.865327    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-de97ae-6765f45d9d-28zx9"]
Sep 09 16:36:42.870440 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.870416    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"]
Sep 09 16:36:42.876207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:42.876184    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-de97ae-75b657c46f-9rshk"]
Sep 09 16:36:44.739019 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:44.738985    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec6e8bc-fef2-4653-af17-015fe15af372" path="/var/lib/kubelet/pods/0ec6e8bc-fef2-4653-af17-015fe15af372/volumes"
Sep 09 16:36:44.739455 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:44.739379    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d9da17-b828-44a3-bd15-4ab68962d698" path="/var/lib/kubelet/pods/86d9da17-b828-44a3-bd15-4ab68962d698/volumes"
Sep 09 16:36:49.404691 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:49.404658    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:49.466893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:36:49.466851    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:02.709599 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:02.709566    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:03.757444 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:03.757405    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:04.196823 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:04.196793    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:04.516325 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:04.516239    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:04.757021 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:04.756985    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:07.221567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:07.221533    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:08.029482 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:08.029440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:08.125929 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:08.125897    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:09.254202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.254167    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:09.355525 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.355487    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:09.590747 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.590649    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:09.727017 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.726982    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:09.827602 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.827564    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:09.841697 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.841624    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"]
Sep 09 16:37:09.842202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842183    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" containerName="maas-api"
Sep 09 16:37:09.842202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842204    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" containerName="maas-api"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842216    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec6e8bc-fef2-4653-af17-015fe15af372" containerName="payload-pre-processing"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842224    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec6e8bc-fef2-4653-af17-015fe15af372" containerName="payload-pre-processing"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842245    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d9da17-b828-44a3-bd15-4ab68962d698" containerName="payload-processing"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842253    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d9da17-b828-44a3-bd15-4ab68962d698" containerName="payload-processing"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842272    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325b4200-cff5-4a26-ac8e-cb07ffe36b2b" containerName="maas-api"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842281    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="325b4200-cff5-4a26-ac8e-cb07ffe36b2b" containerName="maas-api"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842293    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd0409d-f81c-43cb-919e-94db1fad5d7a" containerName="payload-pre-processing"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842301    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd0409d-f81c-43cb-919e-94db1fad5d7a" containerName="payload-pre-processing"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842310    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c7757c-0e24-4157-88c6-e66b37218e1c" containerName="payload-processing"
Sep 09 16:37:09.842360 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842319    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c7757c-0e24-4157-88c6-e66b37218e1c" containerName="payload-processing"
Sep 09 16:37:09.842934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842431    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec6e8bc-fef2-4653-af17-015fe15af372" containerName="payload-pre-processing"
Sep 09 16:37:09.842934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842446    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d9da17-b828-44a3-bd15-4ab68962d698" containerName="payload-processing"
Sep 09 16:37:09.842934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842456    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5290b272-f8a0-4b9c-a0f6-0cd2cecebd2c" containerName="maas-api"
Sep 09 16:37:09.842934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842466    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c7757c-0e24-4157-88c6-e66b37218e1c" containerName="payload-processing"
Sep 09 16:37:09.842934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842478    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd0409d-f81c-43cb-919e-94db1fad5d7a" containerName="payload-pre-processing"
Sep 09 16:37:09.842934 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.842486    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="325b4200-cff5-4a26-ac8e-cb07ffe36b2b" containerName="maas-api"
Sep 09 16:37:09.846025 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.846000    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:09.848394 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.848373    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-54370d\""
Sep 09 16:37:09.855586 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.855564    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"]
Sep 09 16:37:09.873367 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.873336    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"]
Sep 09 16:37:09.878016 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.877994    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:09.880388 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.880365    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-54370d-dockercfg-rr5wg\""
Sep 09 16:37:09.886951 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.886925    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"]
Sep 09 16:37:09.938914 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.938877    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db13e041-833a-4039-a8bf-1e3e57d4aaea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q\" (UID: \"db13e041-833a-4039-a8bf-1e3e57d4aaea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:09.939073 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.938941    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b48116de-897e-4af8-b034-64ae0a364320-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b\" (UID: \"b48116de-897e-4af8-b034-64ae0a364320\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:09.939073 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.939006    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfvb\" (UniqueName: \"kubernetes.io/projected/b48116de-897e-4af8-b034-64ae0a364320-kube-api-access-8bfvb\") pod \"payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b\" (UID: \"b48116de-897e-4af8-b034-64ae0a364320\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:09.939151 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:09.939114    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl5zm\" (UniqueName: \"kubernetes.io/projected/db13e041-833a-4039-a8bf-1e3e57d4aaea-kube-api-access-nl5zm\") pod \"payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q\" (UID: \"db13e041-833a-4039-a8bf-1e3e57d4aaea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:10.040612 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.040575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db13e041-833a-4039-a8bf-1e3e57d4aaea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q\" (UID: \"db13e041-833a-4039-a8bf-1e3e57d4aaea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:10.040841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.040645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b48116de-897e-4af8-b034-64ae0a364320-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b\" (UID: \"b48116de-897e-4af8-b034-64ae0a364320\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:10.040841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.040681    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfvb\" (UniqueName: \"kubernetes.io/projected/b48116de-897e-4af8-b034-64ae0a364320-kube-api-access-8bfvb\") pod \"payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b\" (UID: \"b48116de-897e-4af8-b034-64ae0a364320\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:10.040841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.040820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl5zm\" (UniqueName: \"kubernetes.io/projected/db13e041-833a-4039-a8bf-1e3e57d4aaea-kube-api-access-nl5zm\") pod \"payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q\" (UID: \"db13e041-833a-4039-a8bf-1e3e57d4aaea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:10.041340 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.041317    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b48116de-897e-4af8-b034-64ae0a364320-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b\" (UID: \"b48116de-897e-4af8-b034-64ae0a364320\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:10.041421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.041402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db13e041-833a-4039-a8bf-1e3e57d4aaea-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q\" (UID: \"db13e041-833a-4039-a8bf-1e3e57d4aaea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:10.048706 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.048674    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl5zm\" (UniqueName: \"kubernetes.io/projected/db13e041-833a-4039-a8bf-1e3e57d4aaea-kube-api-access-nl5zm\") pod \"payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q\" (UID: \"db13e041-833a-4039-a8bf-1e3e57d4aaea\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:10.048841 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.048765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfvb\" (UniqueName: \"kubernetes.io/projected/b48116de-897e-4af8-b034-64ae0a364320-kube-api-access-8bfvb\") pod \"payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b\" (UID: \"b48116de-897e-4af8-b034-64ae0a364320\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:10.159118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.159072    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:10.190049 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.190020    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:10.442101 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.442069    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"]
Sep 09 16:37:10.443074 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:37:10.443047    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48116de_897e_4af8_b034_64ae0a364320.slice/crio-7dc809ab8f94b956aa5642ef708369184029ef434c5ad10084766146f2c8b9f9 WatchSource:0}: Error finding container 7dc809ab8f94b956aa5642ef708369184029ef434c5ad10084766146f2c8b9f9: Status 404 returned error can't find the container with id 7dc809ab8f94b956aa5642ef708369184029ef434c5ad10084766146f2c8b9f9
Sep 09 16:37:10.477325 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:10.477155    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"]
Sep 09 16:37:10.480041 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:37:10.480011    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb13e041_833a_4039_a8bf_1e3e57d4aaea.slice/crio-57026a718fb592b55153f4f5b31e0cac210b726b13a4347e042b48f370ba79a0 WatchSource:0}: Error finding container 57026a718fb592b55153f4f5b31e0cac210b726b13a4347e042b48f370ba79a0: Status 404 returned error can't find the container with id 57026a718fb592b55153f4f5b31e0cac210b726b13a4347e042b48f370ba79a0
Sep 09 16:37:11.036245 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:11.036209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b" event={"ID":"b48116de-897e-4af8-b034-64ae0a364320","Type":"ContainerStarted","Data":"fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5"}
Sep 09 16:37:11.036449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:11.036271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b" event={"ID":"b48116de-897e-4af8-b034-64ae0a364320","Type":"ContainerStarted","Data":"7dc809ab8f94b956aa5642ef708369184029ef434c5ad10084766146f2c8b9f9"}
Sep 09 16:37:11.036449 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:11.036421    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:11.038109 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:11.038081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q" event={"ID":"db13e041-833a-4039-a8bf-1e3e57d4aaea","Type":"ContainerStarted","Data":"f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1"}
Sep 09 16:37:11.038242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:11.038129    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q" event={"ID":"db13e041-833a-4039-a8bf-1e3e57d4aaea","Type":"ContainerStarted","Data":"57026a718fb592b55153f4f5b31e0cac210b726b13a4347e042b48f370ba79a0"}
Sep 09 16:37:11.038242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:11.038164    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:11.054675 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:11.054620    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b" podStartSLOduration=2.05459885 podStartE2EDuration="2.05459885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:37:11.05157601 +0000 UTC m=+1728.822667260" watchObservedRunningTime="2026-09-09 16:37:11.05459885 +0000 UTC m=+1728.825690098"
Sep 09 16:37:11.069420 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:11.069362    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q" podStartSLOduration=2.06934237 podStartE2EDuration="2.06934237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:37:11.06720687 +0000 UTC m=+1728.838298117" watchObservedRunningTime="2026-09-09 16:37:11.06934237 +0000 UTC m=+1728.840433617"
Sep 09 16:37:22.045795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:22.045747    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:37:22.046280 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:22.045991    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:37:33.082390 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:33.082357    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:33.823661 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:33.823608    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:34.537436 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:34.537402    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:34.844115 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:34.844026    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:37.859464 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:37.859432    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:37.913610 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:37.913580    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:38.318324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.318280    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"]
Sep 09 16:37:38.343860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.343823    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.346521 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.346342    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-3c6036-serving-cert\""
Sep 09 16:37:38.347851 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.347766    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"]
Sep 09 16:37:38.349119 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.349098    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:38.410605 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.410568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xnc\" (UniqueName: \"kubernetes.io/projected/c6de6533-d046-4de3-af7c-2c545e2d3915-kube-api-access-42xnc\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.410764 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.410622    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-metrics-certs\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.410764 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.410652    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6de6533-d046-4de3-af7c-2c545e2d3915-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.410764 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.410718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.452867 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.452822    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:38.511295 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.511256    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42xnc\" (UniqueName: \"kubernetes.io/projected/c6de6533-d046-4de3-af7c-2c545e2d3915-kube-api-access-42xnc\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.511468 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.511328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-metrics-certs\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.511468 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.511380    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6de6533-d046-4de3-af7c-2c545e2d3915-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.511468 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.511416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.512151 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.512124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6de6533-d046-4de3-af7c-2c545e2d3915-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.513884 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.513854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-metrics-certs\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.514023 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.513999    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.519001 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.518974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xnc\" (UniqueName: \"kubernetes.io/projected/c6de6533-d046-4de3-af7c-2c545e2d3915-kube-api-access-42xnc\") pod \"maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.549532 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.549480    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:38.665546 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.665513    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:38.839657 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.839627    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:38.941278 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.941181    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:38.943613 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.943586    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"]
Sep 09 16:37:38.944943 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:37:38.944916    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6de6533_d046_4de3_af7c_2c545e2d3915.slice/crio-980584d996978fdc87fcb7889a6758ba819566080ce2c08a90048853e104f8bf WatchSource:0}: Error finding container 980584d996978fdc87fcb7889a6758ba819566080ce2c08a90048853e104f8bf: Status 404 returned error can't find the container with id 980584d996978fdc87fcb7889a6758ba819566080ce2c08a90048853e104f8bf
Sep 09 16:37:38.946442 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:38.946422    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:37:39.224698 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:39.224609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph" event={"ID":"c6de6533-d046-4de3-af7c-2c545e2d3915","Type":"ContainerStarted","Data":"980584d996978fdc87fcb7889a6758ba819566080ce2c08a90048853e104f8bf"}
Sep 09 16:37:40.232141 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:40.232101    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph" event={"ID":"c6de6533-d046-4de3-af7c-2c545e2d3915","Type":"ContainerStarted","Data":"dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0"}
Sep 09 16:37:40.232610 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:40.232221    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:37:40.250628 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:40.250572    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph" podStartSLOduration=1.813730139 podStartE2EDuration="2.250554483s" totalImagesPullingTime="436.824344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:37:40.248631485 +0000 UTC m=+1758.019722731" watchObservedRunningTime="2026-09-09 16:37:40.250554483 +0000 UTC m=+1758.021645728"
Sep 09 16:37:46.244492 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:37:46.244453    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:38:02.352421 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:02.352377    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:13.855680 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:13.855614    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:23.085656 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:23.085622    2567 scope.go:117] "RemoveContainer" containerID="9a7e50ff0461601d0c0a812196cf557c608f5d1250946f38da5f07808bba7e25"
Sep 09 16:38:23.095144 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:23.095119    2567 scope.go:117] "RemoveContainer" containerID="51f2de1b8ab4bb4ef91bfbc5afe18766daa47cf3b774dccd15e20fc0680b7737"
Sep 09 16:38:23.104222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:23.104201    2567 scope.go:117] "RemoveContainer" containerID="df05ad883beaad58b1da627048958eedf9c59ee57c301a6a99ad7f32d3c91762"
Sep 09 16:38:40.634499 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:40.634472    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q_db13e041-833a-4039-a8bf-1e3e57d4aaea/payload-processing/0.log"
Sep 09 16:38:41.539718 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.539678    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"]
Sep 09 16:38:41.544145 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.544122    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.546655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.546633    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-936acc-openshift-default-dockercfg-6m4wl\""
Sep 09 16:38:41.558808 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.558783    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"]
Sep 09 16:38:41.590423 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.590383    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:41.641669 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.641633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-envoy\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.642162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.641696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-credential-socket\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.642162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.641881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzgzz\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-kube-api-access-dzgzz\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.642162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.641943    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-token\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.642162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.641969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f410b1ab-b9b5-49e9-831a-050c0d39071b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.642162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.642013    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-data\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.642162 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.642055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-podinfo\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.642461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.642219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-certs\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.642461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.642259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-socket\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.691238 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.691208    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:41.743480 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-credential-socket\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzgzz\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-kube-api-access-dzgzz\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-token\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f410b1ab-b9b5-49e9-831a-050c0d39071b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-data\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743664 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743637    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-podinfo\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-certs\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-socket\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743844    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-envoy\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.743965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-credential-socket\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.744169 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.743968    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-data\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.744227 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.744197    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-certs\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.744285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.744249    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-socket\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.744783 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.744740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f410b1ab-b9b5-49e9-831a-050c0d39071b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.746029 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.745998    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-envoy\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.746458 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.746438    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-podinfo\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.751494 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.751451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-token\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.751494 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.751473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzgzz\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-kube-api-access-dzgzz\") pod \"e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") " pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:41.840229 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.840142    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:41.857936 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:41.857909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:42.142978 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:42.142949    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"]
Sep 09 16:38:42.144179 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:38:42.144151    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf410b1ab_b9b5_49e9_831a_050c0d39071b.slice/crio-5664ddd8db6e3beeeec8e91da9152a078830d1459291084268996b6b94a72c47 WatchSource:0}: Error finding container 5664ddd8db6e3beeeec8e91da9152a078830d1459291084268996b6b94a72c47: Status 404 returned error can't find the container with id 5664ddd8db6e3beeeec8e91da9152a078830d1459291084268996b6b94a72c47
Sep 09 16:38:42.146460 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:42.146430    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:38:42.146524 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:42.146496    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:38:42.146562 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:42.146525    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:38:42.657977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:42.657934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" event={"ID":"f410b1ab-b9b5-49e9-831a-050c0d39071b","Type":"ContainerStarted","Data":"c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc"}
Sep 09 16:38:42.658444 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:42.657994    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" event={"ID":"f410b1ab-b9b5-49e9-831a-050c0d39071b","Type":"ContainerStarted","Data":"5664ddd8db6e3beeeec8e91da9152a078830d1459291084268996b6b94a72c47"}
Sep 09 16:38:42.679406 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:42.679346    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" podStartSLOduration=1.679326422 podStartE2EDuration="1.679326422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:38:42.676791977 +0000 UTC m=+1820.447883216" watchObservedRunningTime="2026-09-09 16:38:42.679326422 +0000 UTC m=+1820.450417667"
Sep 09 16:38:42.858048 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:42.858011    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:43.864735 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:43.864704    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:44.650304 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:44.650252    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:44.672285 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:44.672252    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:44.673296 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:44.673270    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:38:44.792649 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:44.792614    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:45.938061 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:45.938028    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:46.037865 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:46.037828    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:46.404470 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:46.404422    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:46.498334 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:46.498301    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:59.250796 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:38:59.250739    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:03.816919 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:03.816821    2567 generic.go:356] "Generic (PLEG): container finished" podID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerID="c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc" exitCode=0
Sep 09 16:39:03.816919 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:03.816894    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" event={"ID":"f410b1ab-b9b5-49e9-831a-050c0d39071b","Type":"ContainerDied","Data":"c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc"}
Sep 09 16:39:03.817479 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:03.817461    2567 scope.go:117] "RemoveContainer" containerID="c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc"
Sep 09 16:39:03.818670 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:03.818645    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:39:03.818734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:03.818714    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:39:03.818784 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:03.818748    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 16:39:04.825375 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:04.825341    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" event={"ID":"f410b1ab-b9b5-49e9-831a-050c0d39071b","Type":"ContainerStarted","Data":"1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed"}
Sep 09 16:39:04.858746 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:04.858710    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:39:04.859308 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:04.859212    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 09 16:39:04.859510 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:04.859487    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 09 16:39:05.859034 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:05.858992    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 09 16:39:05.859507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:05.859057    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 09 16:39:06.858928 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:06.858887    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 09 16:39:06.859128 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:06.858971    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 09 16:39:07.858722 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:07.858685    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 09 16:39:07.859058 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:07.859027    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 09 16:39:08.859796 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:08.858354    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 09 16:39:08.859796 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:08.858433    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 09 16:39:10.037921 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:10.037871    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:39:10.038406 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:10.038310    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:39:10.039066 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:10.039045    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:39:10.135236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:10.135200    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:16.584981 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:16.584942    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:16.671702 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:16.671660    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:16.771451 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:16.771417    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:16.871873 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:16.871790    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:17.264869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:17.264834    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:21.105620 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:21.105583    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:22.765095 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:22.765041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:22.822523 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:22.822486    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:23.037288 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:23.037199    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"]
Sep 09 16:39:23.037490 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:23.037464    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy" containerID="cri-o://1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed" gracePeriod=30
Sep 09 16:39:23.059823 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:23.059759    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:25.040824 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:25.040756    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 16:39:25.041212 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:25.040855    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:39:27.234696 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:27.234657    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:28.301366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.301300    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:39:28.326624 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326592    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-podinfo\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.326765 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326666    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-socket\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.326765 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326690    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-credential-socket\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.326765 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326712    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-data\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.326765 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326755    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-envoy\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.326988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326794    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-token\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.326988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326860    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f410b1ab-b9b5-49e9-831a-050c0d39071b-istiod-ca-cert\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.326988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326917    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-certs\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.326988 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.326955    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzgzz\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-kube-api-access-dzgzz\") pod \"f410b1ab-b9b5-49e9-831a-050c0d39071b\" (UID: \"f410b1ab-b9b5-49e9-831a-050c0d39071b\") "
Sep 09 16:39:28.327200 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327021    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:39:28.327200 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327030    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:39:28.327200 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327045    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:39:28.327327 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327232    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:39:28.327374 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327325    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f410b1ab-b9b5-49e9-831a-050c0d39071b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:39:28.327374 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327363    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.327489 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327377    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-workload-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.327489 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327390    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-credential-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.327489 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.327402    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-data\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.329183 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.329124    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:39:28.329524 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.329500    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:39:28.329632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.329491    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:39:28.329632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.329568    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-kube-api-access-dzgzz" (OuterVolumeSpecName: "kube-api-access-dzgzz") pod "f410b1ab-b9b5-49e9-831a-050c0d39071b" (UID: "f410b1ab-b9b5-49e9-831a-050c0d39071b"). InnerVolumeSpecName "kube-api-access-dzgzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:39:28.428417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.428366    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzgzz\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-kube-api-access-dzgzz\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.428417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.428413    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-podinfo\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.428417 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.428427    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-envoy\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.428670 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.428440    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f410b1ab-b9b5-49e9-831a-050c0d39071b-istio-token\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.428670 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.428452    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f410b1ab-b9b5-49e9-831a-050c0d39071b-istiod-ca-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:28.991794 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.991730    2567 generic.go:356] "Generic (PLEG): container finished" podID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerID="1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed" exitCode=0
Sep 09 16:39:28.991962 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.991811    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"
Sep 09 16:39:28.991962 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.991823    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" event={"ID":"f410b1ab-b9b5-49e9-831a-050c0d39071b","Type":"ContainerDied","Data":"1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed"}
Sep 09 16:39:28.991962 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.991880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq" event={"ID":"f410b1ab-b9b5-49e9-831a-050c0d39071b","Type":"ContainerDied","Data":"5664ddd8db6e3beeeec8e91da9152a078830d1459291084268996b6b94a72c47"}
Sep 09 16:39:28.991962 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:28.991903    2567 scope.go:117] "RemoveContainer" containerID="1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed"
Sep 09 16:39:29.002169 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:29.002152    2567 scope.go:117] "RemoveContainer" containerID="c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc"
Sep 09 16:39:29.010149 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:29.010106    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"]
Sep 09 16:39:29.011439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:29.011423    2567 scope.go:117] "RemoveContainer" containerID="1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed"
Sep 09 16:39:29.011731 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:39:29.011712    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed\": container with ID starting with 1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed not found: ID does not exist" containerID="1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed"
Sep 09 16:39:29.011802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:29.011741    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed"} err="failed to get container status \"1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed\": rpc error: code = NotFound desc = could not find container \"1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed\": container with ID starting with 1326ee78c1ab9b86c1e97f3bedbbf61d3298f599ad5501b5928db5116f52daed not found: ID does not exist"
Sep 09 16:39:29.011802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:29.011758    2567 scope.go:117] "RemoveContainer" containerID="c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc"
Sep 09 16:39:29.012002 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:39:29.011986    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc\": container with ID starting with c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc not found: ID does not exist" containerID="c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc"
Sep 09 16:39:29.012051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:29.012007    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc"} err="failed to get container status \"c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc\": rpc error: code = NotFound desc = could not find container \"c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc\": container with ID starting with c3590b6f5d3fd043aff2381faf1ad75528a28cc981c87417728c3b62d231d4fc not found: ID does not exist"
Sep 09 16:39:29.013795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:29.013762    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-936acc-openshift-default-64766d8578-hmtdq"]
Sep 09 16:39:30.739243 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:30.739209    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" path="/var/lib/kubelet/pods/f410b1ab-b9b5-49e9-831a-050c0d39071b/volumes"
Sep 09 16:39:42.607331 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:42.607298    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:42.639836 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:42.639799    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"]
Sep 09 16:39:42.640027 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:42.640001    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q" podUID="db13e041-833a-4039-a8bf-1e3e57d4aaea" containerName="payload-processing" containerID="cri-o://f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1" gracePeriod=30
Sep 09 16:39:42.647340 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:42.647309    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"]
Sep 09 16:39:42.647820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:42.647517    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b" podUID="b48116de-897e-4af8-b034-64ae0a364320" containerName="payload-pre-processing" containerID="cri-o://fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5" gracePeriod=30
Sep 09 16:39:42.678805 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:42.678759    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:42.925115 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:42.925091    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:39:42.956876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:42.956846    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:39:43.064638 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.064592    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:43.079329 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.079304    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl5zm\" (UniqueName: \"kubernetes.io/projected/db13e041-833a-4039-a8bf-1e3e57d4aaea-kube-api-access-nl5zm\") pod \"db13e041-833a-4039-a8bf-1e3e57d4aaea\" (UID: \"db13e041-833a-4039-a8bf-1e3e57d4aaea\") "
Sep 09 16:39:43.079439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.079403    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bfvb\" (UniqueName: \"kubernetes.io/projected/b48116de-897e-4af8-b034-64ae0a364320-kube-api-access-8bfvb\") pod \"b48116de-897e-4af8-b034-64ae0a364320\" (UID: \"b48116de-897e-4af8-b034-64ae0a364320\") "
Sep 09 16:39:43.079489 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.079462    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db13e041-833a-4039-a8bf-1e3e57d4aaea-plugins-config-volume\") pod \"db13e041-833a-4039-a8bf-1e3e57d4aaea\" (UID: \"db13e041-833a-4039-a8bf-1e3e57d4aaea\") "
Sep 09 16:39:43.079526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.079500    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b48116de-897e-4af8-b034-64ae0a364320-plugins-config-volume\") pod \"b48116de-897e-4af8-b034-64ae0a364320\" (UID: \"b48116de-897e-4af8-b034-64ae0a364320\") "
Sep 09 16:39:43.079904 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.079874    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db13e041-833a-4039-a8bf-1e3e57d4aaea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db13e041-833a-4039-a8bf-1e3e57d4aaea" (UID: "db13e041-833a-4039-a8bf-1e3e57d4aaea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:39:43.079904 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.079894    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48116de-897e-4af8-b034-64ae0a364320-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b48116de-897e-4af8-b034-64ae0a364320" (UID: "b48116de-897e-4af8-b034-64ae0a364320"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:39:43.081504 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.081485    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db13e041-833a-4039-a8bf-1e3e57d4aaea-kube-api-access-nl5zm" (OuterVolumeSpecName: "kube-api-access-nl5zm") pod "db13e041-833a-4039-a8bf-1e3e57d4aaea" (UID: "db13e041-833a-4039-a8bf-1e3e57d4aaea"). InnerVolumeSpecName "kube-api-access-nl5zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:39:43.081504 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.081492    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48116de-897e-4af8-b034-64ae0a364320-kube-api-access-8bfvb" (OuterVolumeSpecName: "kube-api-access-8bfvb") pod "b48116de-897e-4af8-b034-64ae0a364320" (UID: "b48116de-897e-4af8-b034-64ae0a364320"). InnerVolumeSpecName "kube-api-access-8bfvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:39:43.097522 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.097495    2567 generic.go:356] "Generic (PLEG): container finished" podID="db13e041-833a-4039-a8bf-1e3e57d4aaea" containerID="f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1" exitCode=0
Sep 09 16:39:43.097655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.097545    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"
Sep 09 16:39:43.097655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.097572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q" event={"ID":"db13e041-833a-4039-a8bf-1e3e57d4aaea","Type":"ContainerDied","Data":"f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1"}
Sep 09 16:39:43.097655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.097624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q" event={"ID":"db13e041-833a-4039-a8bf-1e3e57d4aaea","Type":"ContainerDied","Data":"57026a718fb592b55153f4f5b31e0cac210b726b13a4347e042b48f370ba79a0"}
Sep 09 16:39:43.097655 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.097653    2567 scope.go:117] "RemoveContainer" containerID="f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1"
Sep 09 16:39:43.099337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.099167    2567 generic.go:356] "Generic (PLEG): container finished" podID="b48116de-897e-4af8-b034-64ae0a364320" containerID="fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5" exitCode=0
Sep 09 16:39:43.099337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.099200    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b" event={"ID":"b48116de-897e-4af8-b034-64ae0a364320","Type":"ContainerDied","Data":"fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5"}
Sep 09 16:39:43.099337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.099264    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b" event={"ID":"b48116de-897e-4af8-b034-64ae0a364320","Type":"ContainerDied","Data":"7dc809ab8f94b956aa5642ef708369184029ef434c5ad10084766146f2c8b9f9"}
Sep 09 16:39:43.099337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.099214    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"
Sep 09 16:39:43.110026 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.109898    2567 scope.go:117] "RemoveContainer" containerID="f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1"
Sep 09 16:39:43.110433 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:39:43.110412    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1\": container with ID starting with f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1 not found: ID does not exist" containerID="f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1"
Sep 09 16:39:43.110516 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.110441    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1"} err="failed to get container status \"f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1\": rpc error: code = NotFound desc = could not find container \"f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1\": container with ID starting with f8ae3bc4ba752aa5d94470818802e660d954fda0a8a5659fd533de76e821d4d1 not found: ID does not exist"
Sep 09 16:39:43.110516 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.110459    2567 scope.go:117] "RemoveContainer" containerID="fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5"
Sep 09 16:39:43.125384 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.125363    2567 scope.go:117] "RemoveContainer" containerID="fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5"
Sep 09 16:39:43.125699 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:39:43.125675    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5\": container with ID starting with fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5 not found: ID does not exist" containerID="fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5"
Sep 09 16:39:43.125802 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.125709    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5"} err="failed to get container status \"fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5\": rpc error: code = NotFound desc = could not find container \"fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5\": container with ID starting with fc9d013302f41dacc8f517dcfaea7ab8a33622c259e7dbb0c989b66253b0c6d5 not found: ID does not exist"
Sep 09 16:39:43.135518 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.135493    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"]
Sep 09 16:39:43.145325 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.145297    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-54370d-9d7b84647-wqt7q"]
Sep 09 16:39:43.159439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.159410    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"]
Sep 09 16:39:43.164105 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.164079    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-54370d-57854f96db-zxq8b"]
Sep 09 16:39:43.180324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.180296    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bfvb\" (UniqueName: \"kubernetes.io/projected/b48116de-897e-4af8-b034-64ae0a364320-kube-api-access-8bfvb\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:43.180324 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.180321    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db13e041-833a-4039-a8bf-1e3e57d4aaea-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:43.180458 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.180332    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b48116de-897e-4af8-b034-64ae0a364320-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:43.180458 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.180342    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl5zm\" (UniqueName: \"kubernetes.io/projected/db13e041-833a-4039-a8bf-1e3e57d4aaea-kube-api-access-nl5zm\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:39:43.180569 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.180550    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:43.494199 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.494115    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:43.594272 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:43.594236    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:44.738642 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:44.738599    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b48116de-897e-4af8-b034-64ae0a364320" path="/var/lib/kubelet/pods/b48116de-897e-4af8-b034-64ae0a364320/volumes"
Sep 09 16:39:44.739109 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:44.739021    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db13e041-833a-4039-a8bf-1e3e57d4aaea" path="/var/lib/kubelet/pods/db13e041-833a-4039-a8bf-1e3e57d4aaea/volumes"
Sep 09 16:39:48.250698 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:48.250666    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:55.530888 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:39:55.530834    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:19.840969 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:19.840928    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:22.343832 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:22.343765    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:24.652630 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:24.652593    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:24.752529 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:24.752499    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:25.122581 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:25.122545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:30.647223 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:30.647176    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:31.551611 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:31.551574    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:31.650704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:31.650669    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:38.984046 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:38.984009    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:41.728809 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:41.728757    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"]
Sep 09 16:40:41.729242 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:41.729033    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph" podUID="c6de6533-d046-4de3-af7c-2c545e2d3915" containerName="maas-api" containerID="cri-o://dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0" gracePeriod=30
Sep 09 16:40:41.757727 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:41.757693    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:41.989287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:41.989229    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:40:42.066033 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.065996    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42xnc\" (UniqueName: \"kubernetes.io/projected/c6de6533-d046-4de3-af7c-2c545e2d3915-kube-api-access-42xnc\") pod \"c6de6533-d046-4de3-af7c-2c545e2d3915\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") "
Sep 09 16:40:42.066214 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.066045    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-metrics-certs\") pod \"c6de6533-d046-4de3-af7c-2c545e2d3915\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") "
Sep 09 16:40:42.066214 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.066118    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6de6533-d046-4de3-af7c-2c545e2d3915-openshift-service-ca\") pod \"c6de6533-d046-4de3-af7c-2c545e2d3915\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") "
Sep 09 16:40:42.066214 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.066183    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-maas-api-tls\") pod \"c6de6533-d046-4de3-af7c-2c545e2d3915\" (UID: \"c6de6533-d046-4de3-af7c-2c545e2d3915\") "
Sep 09 16:40:42.066573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.066542    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6de6533-d046-4de3-af7c-2c545e2d3915-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6de6533-d046-4de3-af7c-2c545e2d3915" (UID: "c6de6533-d046-4de3-af7c-2c545e2d3915"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:40:42.068441 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.068388    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6de6533-d046-4de3-af7c-2c545e2d3915-kube-api-access-42xnc" (OuterVolumeSpecName: "kube-api-access-42xnc") pod "c6de6533-d046-4de3-af7c-2c545e2d3915" (UID: "c6de6533-d046-4de3-af7c-2c545e2d3915"). InnerVolumeSpecName "kube-api-access-42xnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:40:42.068441 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.068417    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6de6533-d046-4de3-af7c-2c545e2d3915" (UID: "c6de6533-d046-4de3-af7c-2c545e2d3915"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:40:42.068646 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.068621    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c6de6533-d046-4de3-af7c-2c545e2d3915" (UID: "c6de6533-d046-4de3-af7c-2c545e2d3915"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:40:42.167590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.167547    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42xnc\" (UniqueName: \"kubernetes.io/projected/c6de6533-d046-4de3-af7c-2c545e2d3915-kube-api-access-42xnc\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:40:42.167590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.167587    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:40:42.167832 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.167603    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6de6533-d046-4de3-af7c-2c545e2d3915-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:40:42.167832 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.167617    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6de6533-d046-4de3-af7c-2c545e2d3915-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:40:42.490666 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.490631    2567 generic.go:356] "Generic (PLEG): container finished" podID="c6de6533-d046-4de3-af7c-2c545e2d3915" containerID="dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0" exitCode=0
Sep 09 16:40:42.490861 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.490677    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"
Sep 09 16:40:42.490861 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.490695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph" event={"ID":"c6de6533-d046-4de3-af7c-2c545e2d3915","Type":"ContainerDied","Data":"dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0"}
Sep 09 16:40:42.490861 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.490736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph" event={"ID":"c6de6533-d046-4de3-af7c-2c545e2d3915","Type":"ContainerDied","Data":"980584d996978fdc87fcb7889a6758ba819566080ce2c08a90048853e104f8bf"}
Sep 09 16:40:42.490861 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.490757    2567 scope.go:117] "RemoveContainer" containerID="dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0"
Sep 09 16:40:42.501146 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.501126    2567 scope.go:117] "RemoveContainer" containerID="dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0"
Sep 09 16:40:42.501641 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:40:42.501613    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0\": container with ID starting with dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0 not found: ID does not exist" containerID="dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0"
Sep 09 16:40:42.501734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.501651    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0"} err="failed to get container status \"dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0\": rpc error: code = NotFound desc = could not find container \"dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0\": container with ID starting with dd79e68ec92e46fd021b3d088020d1e8ebaa7b840a67b06966b28c9201cfb7e0 not found: ID does not exist"
Sep 09 16:40:42.512568 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.512544    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"]
Sep 09 16:40:42.515186 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.515165    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3c6036-778dbc65cc-zjfph"]
Sep 09 16:40:42.738453 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:42.738422    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6de6533-d046-4de3-af7c-2c545e2d3915" path="/var/lib/kubelet/pods/c6de6533-d046-4de3-af7c-2c545e2d3915/volumes"
Sep 09 16:40:43.327112 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:43.327073    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:44.986341 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:44.986306    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:47.983370 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:47.983335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:48.043757 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:48.043725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:48.355553 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:48.355473    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:49.049197 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:49.049162    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:59.255785 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.255727    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"]
Sep 09 16:40:59.256369 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.256015    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq" podUID="191e35c2-5df6-4195-b669-efd0dd854138" containerName="maas-api" containerID="cri-o://9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96" gracePeriod=30
Sep 09 16:40:59.271075 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.271040    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:59.296829 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:40:59.296789    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191e35c2_5df6_4195_b669_efd0dd854138.slice/crio-conmon-9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96.scope\": RecentStats: unable to find data in memory cache]"
Sep 09 16:40:59.297031 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:40:59.296799    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191e35c2_5df6_4195_b669_efd0dd854138.slice/crio-9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96.scope\": RecentStats: unable to find data in memory cache]"
Sep 09 16:40:59.345141 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.345112    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:59.469567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.469537    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:59.500827 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.500802    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:40:59.568147 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.568059    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:59.607727 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.607696    2567 generic.go:356] "Generic (PLEG): container finished" podID="191e35c2-5df6-4195-b669-efd0dd854138" containerID="9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96" exitCode=0
Sep 09 16:40:59.607925 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.607742    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"
Sep 09 16:40:59.607925 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.607791    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq" event={"ID":"191e35c2-5df6-4195-b669-efd0dd854138","Type":"ContainerDied","Data":"9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96"}
Sep 09 16:40:59.607925 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.607848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq" event={"ID":"191e35c2-5df6-4195-b669-efd0dd854138","Type":"ContainerDied","Data":"461439327acd0ffad8c11fb586cddd6fe822e463b53ac4e295b38ec814ee83e0"}
Sep 09 16:40:59.607925 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.607872    2567 scope.go:117] "RemoveContainer" containerID="9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96"
Sep 09 16:40:59.620634 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.620611    2567 scope.go:117] "RemoveContainer" containerID="9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96"
Sep 09 16:40:59.620967 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:40:59.620946    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96\": container with ID starting with 9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96 not found: ID does not exist" containerID="9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96"
Sep 09 16:40:59.621051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.620980    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96"} err="failed to get container status \"9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96\": rpc error: code = NotFound desc = could not find container \"9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96\": container with ID starting with 9256312a99f84aa223a0915f57b630b3432df5d7230fcde54c1ab1817a71ce96 not found: ID does not exist"
Sep 09 16:40:59.644524 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.644496    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-maas-api-tls\") pod \"191e35c2-5df6-4195-b669-efd0dd854138\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") "
Sep 09 16:40:59.644681 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.644559    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55bpg\" (UniqueName: \"kubernetes.io/projected/191e35c2-5df6-4195-b669-efd0dd854138-kube-api-access-55bpg\") pod \"191e35c2-5df6-4195-b669-efd0dd854138\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") "
Sep 09 16:40:59.644681 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.644615    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-metrics-certs\") pod \"191e35c2-5df6-4195-b669-efd0dd854138\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") "
Sep 09 16:40:59.644840 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.644713    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/191e35c2-5df6-4195-b669-efd0dd854138-openshift-service-ca\") pod \"191e35c2-5df6-4195-b669-efd0dd854138\" (UID: \"191e35c2-5df6-4195-b669-efd0dd854138\") "
Sep 09 16:40:59.645387 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.645356    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/191e35c2-5df6-4195-b669-efd0dd854138-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "191e35c2-5df6-4195-b669-efd0dd854138" (UID: "191e35c2-5df6-4195-b669-efd0dd854138"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:40:59.646942 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.646915    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "191e35c2-5df6-4195-b669-efd0dd854138" (UID: "191e35c2-5df6-4195-b669-efd0dd854138"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:40:59.647179 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.647152    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "191e35c2-5df6-4195-b669-efd0dd854138" (UID: "191e35c2-5df6-4195-b669-efd0dd854138"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:40:59.647369 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.647354    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/191e35c2-5df6-4195-b669-efd0dd854138-kube-api-access-55bpg" (OuterVolumeSpecName: "kube-api-access-55bpg") pod "191e35c2-5df6-4195-b669-efd0dd854138" (UID: "191e35c2-5df6-4195-b669-efd0dd854138"). InnerVolumeSpecName "kube-api-access-55bpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:40:59.745949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.745916    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/191e35c2-5df6-4195-b669-efd0dd854138-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:40:59.745949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.745943    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:40:59.745949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.745953    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55bpg\" (UniqueName: \"kubernetes.io/projected/191e35c2-5df6-4195-b669-efd0dd854138-kube-api-access-55bpg\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:40:59.746224 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.745962    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191e35c2-5df6-4195-b669-efd0dd854138-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:40:59.931820 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.931788    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"]
Sep 09 16:40:59.934426 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:40:59.934404    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-041bf1-669bc8c6-v9rfq"]
Sep 09 16:41:00.130118 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:00.130084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:00.738473 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:00.738440    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="191e35c2-5df6-4195-b669-efd0dd854138" path="/var/lib/kubelet/pods/191e35c2-5df6-4195-b669-efd0dd854138/volumes"
Sep 09 16:41:06.006931 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:06.006894    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:06.065981 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:06.065943    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:06.249628 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:06.249596    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"]
Sep 09 16:41:06.249926 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:06.249895    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy" containerID="cri-o://31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005" gracePeriod=30
Sep 09 16:41:06.274102 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:06.274024    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:06.965057 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:06.965024    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:10.890990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:10.890954    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 16:41:10.891371 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:10.891020    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:41:11.506603 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.506578    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:41:11.667810 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.667754    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f62cbe-45f8-49c4-8fea-d325085fb107-istiod-ca-cert\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.667843    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-socket\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.667882    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-token\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.667913    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-credential-socket\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.667941    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz8cs\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-kube-api-access-kz8cs\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668009 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.667977    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-podinfo\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668038    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-envoy\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668108    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-data\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668135    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-certs\") pod \"c8f62cbe-45f8-49c4-8fea-d325085fb107\" (UID: \"c8f62cbe-45f8-49c4-8fea-d325085fb107\") "
Sep 09 16:41:11.668287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668206    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:11.668287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668233    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f62cbe-45f8-49c4-8fea-d325085fb107-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:41:11.668533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668233    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:11.668533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668435    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:11.668533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668452    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:11.668690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668617    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-credential-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:11.668690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668638    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-data\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:11.668690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668652    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:11.668690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668666    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f62cbe-45f8-49c4-8fea-d325085fb107-istiod-ca-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:11.668690 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.668678    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-workload-socket\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:11.670193 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.670170    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:41:11.670362 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.670341    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-kube-api-access-kz8cs" (OuterVolumeSpecName: "kube-api-access-kz8cs") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "kube-api-access-kz8cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:41:11.670621 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.670596    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:41:11.670621 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.670608    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8f62cbe-45f8-49c4-8fea-d325085fb107" (UID: "c8f62cbe-45f8-49c4-8fea-d325085fb107"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:11.692019 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.691991    2567 generic.go:356] "Generic (PLEG): container finished" podID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerID="31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005" exitCode=0
Sep 09 16:41:11.692145 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.692039    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"
Sep 09 16:41:11.692145 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.692078    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" event={"ID":"c8f62cbe-45f8-49c4-8fea-d325085fb107","Type":"ContainerDied","Data":"31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005"}
Sep 09 16:41:11.692280 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.692147    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm" event={"ID":"c8f62cbe-45f8-49c4-8fea-d325085fb107","Type":"ContainerDied","Data":"60ad64bd68d62711940bc046e6bd13742218cf922856e2e306432c9f751442b0"}
Sep 09 16:41:11.692280 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.692179    2567 scope.go:117] "RemoveContainer" containerID="31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005"
Sep 09 16:41:11.701683 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.701668    2567 scope.go:117] "RemoveContainer" containerID="3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e"
Sep 09 16:41:11.710337 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.710315    2567 scope.go:117] "RemoveContainer" containerID="31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005"
Sep 09 16:41:11.710724 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:41:11.710661    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005\": container with ID starting with 31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005 not found: ID does not exist" containerID="31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005"
Sep 09 16:41:11.710724 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.710700    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005"} err="failed to get container status \"31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005\": rpc error: code = NotFound desc = could not find container \"31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005\": container with ID starting with 31ce597e7465ca877656a0bf53212dd3b27ceca21c6557a702c5b2299475b005 not found: ID does not exist"
Sep 09 16:41:11.710724 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.710725    2567 scope.go:117] "RemoveContainer" containerID="3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e"
Sep 09 16:41:11.711157 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:41:11.711128    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e\": container with ID starting with 3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e not found: ID does not exist" containerID="3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e"
Sep 09 16:41:11.711246 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.711165    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e"} err="failed to get container status \"3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e\": rpc error: code = NotFound desc = could not find container \"3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e\": container with ID starting with 3caa6f75029df3101abf9fd24041b39a8224125ecac90ea5b28932ef1cc0f70e not found: ID does not exist"
Sep 09 16:41:11.714694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.714572    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"]
Sep 09 16:41:11.717676 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.717649    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-041bf1-openshift-default-548f47f96-t7cvm"]
Sep 09 16:41:11.769236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.769204    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-token\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:11.769236 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.769231    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz8cs\" (UniqueName: \"kubernetes.io/projected/c8f62cbe-45f8-49c4-8fea-d325085fb107-kube-api-access-kz8cs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:11.769428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.769246    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-podinfo\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:11.769428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:11.769260    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f62cbe-45f8-49c4-8fea-d325085fb107-istio-envoy\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:12.738164 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:12.738132    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" path="/var/lib/kubelet/pods/c8f62cbe-45f8-49c4-8fea-d325085fb107/volumes"
Sep 09 16:41:17.229994 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:17.229914    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:17.301258 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:17.301228    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:18.452586 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:18.452555    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:19.008632 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:19.008597    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:23.172222 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:23.172187    2567 scope.go:117] "RemoveContainer" containerID="94971a0eb14d44dd155143a73186d4a6fd03d985ba4e560b9da28f57704b5ec8"
Sep 09 16:41:23.854956 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:23.854923    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:23.917368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:23.917335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:24.151667 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:24.151629    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:27.184717 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.184674    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-8pv2b"]
Sep 09 16:41:27.185212 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.184956    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-574cc95cb9-8pv2b" podUID="4ec378a0-5f63-4491-8a6f-c3077485b6b2" containerName="manager" containerID="cri-o://10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1" gracePeriod=30
Sep 09 16:41:27.437392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.437326    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:41:27.522425 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.522391    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs\") pod \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") "
Sep 09 16:41:27.522609 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.522446    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn8sg\" (UniqueName: \"kubernetes.io/projected/4ec378a0-5f63-4491-8a6f-c3077485b6b2-kube-api-access-fn8sg\") pod \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") "
Sep 09 16:41:27.522609 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.522482    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-webhook-cert\") pod \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\" (UID: \"4ec378a0-5f63-4491-8a6f-c3077485b6b2\") "
Sep 09 16:41:27.524544 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.524513    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec378a0-5f63-4491-8a6f-c3077485b6b2-kube-api-access-fn8sg" (OuterVolumeSpecName: "kube-api-access-fn8sg") pod "4ec378a0-5f63-4491-8a6f-c3077485b6b2" (UID: "4ec378a0-5f63-4491-8a6f-c3077485b6b2"). InnerVolumeSpecName "kube-api-access-fn8sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:41:27.524658 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.524550    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4ec378a0-5f63-4491-8a6f-c3077485b6b2" (UID: "4ec378a0-5f63-4491-8a6f-c3077485b6b2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:41:27.524658 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.524570    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4ec378a0-5f63-4491-8a6f-c3077485b6b2" (UID: "4ec378a0-5f63-4491-8a6f-c3077485b6b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:41:27.623188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.623154    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:27.623188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.623183    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn8sg\" (UniqueName: \"kubernetes.io/projected/4ec378a0-5f63-4491-8a6f-c3077485b6b2-kube-api-access-fn8sg\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:27.623188 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.623194    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ec378a0-5f63-4491-8a6f-c3077485b6b2-webhook-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:41:27.795990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.795885    2567 generic.go:356] "Generic (PLEG): container finished" podID="4ec378a0-5f63-4491-8a6f-c3077485b6b2" containerID="10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1" exitCode=0
Sep 09 16:41:27.795990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.795947    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-8pv2b"
Sep 09 16:41:27.795990 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.795977    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-8pv2b" event={"ID":"4ec378a0-5f63-4491-8a6f-c3077485b6b2","Type":"ContainerDied","Data":"10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1"}
Sep 09 16:41:27.796256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.796054    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-8pv2b" event={"ID":"4ec378a0-5f63-4491-8a6f-c3077485b6b2","Type":"ContainerDied","Data":"421528c2417929cc73fc7cb4d8323ed217fd04e22e5d9c695a22d8d74d7ba24a"}
Sep 09 16:41:27.796256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.796078    2567 scope.go:117] "RemoveContainer" containerID="10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1"
Sep 09 16:41:27.806650 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.806630    2567 scope.go:117] "RemoveContainer" containerID="10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1"
Sep 09 16:41:27.806968 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:41:27.806940    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1\": container with ID starting with 10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1 not found: ID does not exist" containerID="10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1"
Sep 09 16:41:27.807056 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.806976    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1"} err="failed to get container status \"10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1\": rpc error: code = NotFound desc = could not find container \"10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1\": container with ID starting with 10b3b09f0ee554f75ca2448034cdc17c728a2cfc1b0f4068b052caa2bc229bc1 not found: ID does not exist"
Sep 09 16:41:27.820461 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.820437    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-8pv2b"]
Sep 09 16:41:27.825968 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:27.825949    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-8pv2b"]
Sep 09 16:41:28.738708 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:41:28.738666    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ec378a0-5f63-4491-8a6f-c3077485b6b2" path="/var/lib/kubelet/pods/4ec378a0-5f63-4491-8a6f-c3077485b6b2/volumes"
Sep 09 16:42:29.033196 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033164    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-574cc95cb9-t4r4t"]
Sep 09 16:42:29.033653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033593    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b48116de-897e-4af8-b034-64ae0a364320" containerName="payload-pre-processing"
Sep 09 16:42:29.033653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033604    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b48116de-897e-4af8-b034-64ae0a364320" containerName="payload-pre-processing"
Sep 09 16:42:29.033653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033628    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec378a0-5f63-4491-8a6f-c3077485b6b2" containerName="manager"
Sep 09 16:42:29.033653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033636    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec378a0-5f63-4491-8a6f-c3077485b6b2" containerName="manager"
Sep 09 16:42:29.033653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033643    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6de6533-d046-4de3-af7c-2c545e2d3915" containerName="maas-api"
Sep 09 16:42:29.033653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033651    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6de6533-d046-4de3-af7c-2c545e2d3915" containerName="maas-api"
Sep 09 16:42:29.033653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033658    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="191e35c2-5df6-4195-b669-efd0dd854138" containerName="maas-api"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033664    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="191e35c2-5df6-4195-b669-efd0dd854138" containerName="maas-api"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033677    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db13e041-833a-4039-a8bf-1e3e57d4aaea" containerName="payload-processing"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033683    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="db13e041-833a-4039-a8bf-1e3e57d4aaea" containerName="payload-processing"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033690    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033695    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033705    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033710    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033715    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033720    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033804    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b48116de-897e-4af8-b034-64ae0a364320" containerName="payload-pre-processing"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033812    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033819    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033826    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f62cbe-45f8-49c4-8fea-d325085fb107" containerName="istio-proxy"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033834    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6de6533-d046-4de3-af7c-2c545e2d3915" containerName="maas-api"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033841    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec378a0-5f63-4491-8a6f-c3077485b6b2" containerName="manager"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033847    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="db13e041-833a-4039-a8bf-1e3e57d4aaea" containerName="payload-processing"
Sep 09 16:42:29.033965 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.033854    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="191e35c2-5df6-4195-b669-efd0dd854138" containerName="maas-api"
Sep 09 16:42:29.036977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.036960    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.039392 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.039370    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kxvzz\""
Sep 09 16:42:29.040859 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.040838    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 16:42:29.040961 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.040902    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 16:42:29.041032 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.041019    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 16:42:29.045980 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.045535    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-t4r4t"]
Sep 09 16:42:29.111407 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.111372    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-webhook-cert\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.111576 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.111413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-metrics-certs\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.111576 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.111457    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njf24\" (UniqueName: \"kubernetes.io/projected/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-kube-api-access-njf24\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.212954 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.212924    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-webhook-cert\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.213156 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.212968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-metrics-certs\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.213156 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.213008    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njf24\" (UniqueName: \"kubernetes.io/projected/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-kube-api-access-njf24\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.215528 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.215503    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-metrics-certs\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.215635 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.215503    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-webhook-cert\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.221319 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.221294    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njf24\" (UniqueName: \"kubernetes.io/projected/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-kube-api-access-njf24\") pod \"maas-controller-574cc95cb9-t4r4t\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") " pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.350046 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.349967    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:29.621896 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:29.621869    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-t4r4t"]
Sep 09 16:42:29.623472 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:42:29.623447    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97eb2e7_fdd7_4f17_8ba8_8c0db587e767.slice/crio-cb537b5f41224095a096d9d775d1515b84648ef640bb0083a4ba8cf0718758c2 WatchSource:0}: Error finding container cb537b5f41224095a096d9d775d1515b84648ef640bb0083a4ba8cf0718758c2: Status 404 returned error can't find the container with id cb537b5f41224095a096d9d775d1515b84648ef640bb0083a4ba8cf0718758c2
Sep 09 16:42:30.179383 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:30.179345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-t4r4t" event={"ID":"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767","Type":"ContainerStarted","Data":"cb537b5f41224095a096d9d775d1515b84648ef640bb0083a4ba8cf0718758c2"}
Sep 09 16:42:31.186312 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:31.186274    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-t4r4t" event={"ID":"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767","Type":"ContainerStarted","Data":"d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873"}
Sep 09 16:42:31.186809 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:31.186449    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:31.202829 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:31.202757    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-574cc95cb9-t4r4t" podStartSLOduration=1.62830493 podStartE2EDuration="2.202744658s" totalImagesPullingTime="574.439728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:42:31.201789911 +0000 UTC m=+2048.972881178" watchObservedRunningTime="2026-09-09 16:42:31.202744658 +0000 UTC m=+2048.973835904"
Sep 09 16:42:42.194878 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:42.194840    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:51.545133 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:51.545095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:53.622297 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:53.622260    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:53.731011 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:53.730971    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-t4r4t"]
Sep 09 16:42:53.731185 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:53.731160    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-574cc95cb9-t4r4t" podUID="d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" containerName="manager" containerID="cri-o://d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873" gracePeriod=30
Sep 09 16:42:53.983893 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:53.983865    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:54.052739 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.052709    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njf24\" (UniqueName: \"kubernetes.io/projected/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-kube-api-access-njf24\") pod \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") "
Sep 09 16:42:54.052942 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.052843    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-webhook-cert\") pod \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") "
Sep 09 16:42:54.052942 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.052864    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-metrics-certs\") pod \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\" (UID: \"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767\") "
Sep 09 16:42:54.055241 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.055207    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" (UID: "d97eb2e7-fdd7-4f17-8ba8-8c0db587e767"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:42:54.055241 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.055228    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" (UID: "d97eb2e7-fdd7-4f17-8ba8-8c0db587e767"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:42:54.055397 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.055328    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-kube-api-access-njf24" (OuterVolumeSpecName: "kube-api-access-njf24") pod "d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" (UID: "d97eb2e7-fdd7-4f17-8ba8-8c0db587e767"). InnerVolumeSpecName "kube-api-access-njf24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:42:54.154000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.153910    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-webhook-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:42:54.154000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.153943    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:42:54.154000 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.153953    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njf24\" (UniqueName: \"kubernetes.io/projected/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767-kube-api-access-njf24\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:42:54.329864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.329822    2567 generic.go:356] "Generic (PLEG): container finished" podID="d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" containerID="d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873" exitCode=0
Sep 09 16:42:54.330033 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.329873    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-t4r4t"
Sep 09 16:42:54.330033 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.329906    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-t4r4t" event={"ID":"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767","Type":"ContainerDied","Data":"d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873"}
Sep 09 16:42:54.330033 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.329984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-t4r4t" event={"ID":"d97eb2e7-fdd7-4f17-8ba8-8c0db587e767","Type":"ContainerDied","Data":"cb537b5f41224095a096d9d775d1515b84648ef640bb0083a4ba8cf0718758c2"}
Sep 09 16:42:54.330033 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.330007    2567 scope.go:117] "RemoveContainer" containerID="d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873"
Sep 09 16:42:54.340269 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.340249    2567 scope.go:117] "RemoveContainer" containerID="d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873"
Sep 09 16:42:54.340566 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:42:54.340547    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873\": container with ID starting with d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873 not found: ID does not exist" containerID="d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873"
Sep 09 16:42:54.340640 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.340573    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873"} err="failed to get container status \"d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873\": rpc error: code = NotFound desc = could not find container \"d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873\": container with ID starting with d613b525e2a48900187c1f31eddad8adeedaf60da2f4c79541f57c86762f2873 not found: ID does not exist"
Sep 09 16:42:54.353729 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.353698    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-t4r4t"]
Sep 09 16:42:54.356331 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.356312    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-t4r4t"]
Sep 09 16:42:54.739556 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:54.739524    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" path="/var/lib/kubelet/pods/d97eb2e7-fdd7-4f17-8ba8-8c0db587e767/volumes"
Sep 09 16:42:55.143365 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.143329    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-574cc95cb9-nvx6m"]
Sep 09 16:42:55.143814 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.143800    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy"
Sep 09 16:42:55.143876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.143816    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy"
Sep 09 16:42:55.143876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.143839    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" containerName="manager"
Sep 09 16:42:55.143876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.143846    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" containerName="manager"
Sep 09 16:42:55.143977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.143957    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f410b1ab-b9b5-49e9-831a-050c0d39071b" containerName="istio-proxy"
Sep 09 16:42:55.143977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.143967    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d97eb2e7-fdd7-4f17-8ba8-8c0db587e767" containerName="manager"
Sep 09 16:42:55.148581 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.148564    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.152212 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.152158    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kxvzz\""
Sep 09 16:42:55.152212 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.152182    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 16:42:55.152410 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.152212    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 16:42:55.152410 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.152190    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 16:42:55.156366 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.156339    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-nvx6m"]
Sep 09 16:42:55.265051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.265007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79fw\" (UniqueName: \"kubernetes.io/projected/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-kube-api-access-v79fw\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.265264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.265139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-webhook-cert\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.265264 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.265173    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-metrics-certs\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.366393 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.366353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v79fw\" (UniqueName: \"kubernetes.io/projected/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-kube-api-access-v79fw\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.366560 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.366463    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-webhook-cert\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.366560 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.366491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-metrics-certs\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.369126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.369098    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-webhook-cert\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.369126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.369120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-metrics-certs\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.373483 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.373460    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79fw\" (UniqueName: \"kubernetes.io/projected/17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb-kube-api-access-v79fw\") pod \"maas-controller-574cc95cb9-nvx6m\" (UID: \"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb\") " pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.437631 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.437545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:55.461530 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.461500    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:55.735584 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.735552    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-574cc95cb9-nvx6m"]
Sep 09 16:42:55.737141 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:42:55.737113    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d2c65f_6cdc_4e48_ad13_3b6e3869a3cb.slice/crio-0ab5a3a6a0a295de5dc9d72281b06bdf26e8e704bb332d59b69565418df5c6e6 WatchSource:0}: Error finding container 0ab5a3a6a0a295de5dc9d72281b06bdf26e8e704bb332d59b69565418df5c6e6: Status 404 returned error can't find the container with id 0ab5a3a6a0a295de5dc9d72281b06bdf26e8e704bb332d59b69565418df5c6e6
Sep 09 16:42:55.738606 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:55.738585    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:42:56.345005 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:56.344972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-nvx6m" event={"ID":"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb","Type":"ContainerStarted","Data":"0ab5a3a6a0a295de5dc9d72281b06bdf26e8e704bb332d59b69565418df5c6e6"}
Sep 09 16:42:58.358703 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:58.358652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-574cc95cb9-nvx6m" event={"ID":"17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb","Type":"ContainerStarted","Data":"aa72813f5cdf72eafc0ae599238a37a65c858b476d387df375c54f65b72dde04"}
Sep 09 16:42:58.359126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:58.358912    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:42:58.377967 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:42:58.377914    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-574cc95cb9-nvx6m" podStartSLOduration=0.975563831 podStartE2EDuration="3.37789867s" totalImagesPullingTime="2.402334839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:42:58.37463757 +0000 UTC m=+2076.145728849" watchObservedRunningTime="2026-09-09 16:42:58.37789867 +0000 UTC m=+2076.148989916"
Sep 09 16:43:09.367915 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:43:09.367877    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-574cc95cb9-nvx6m"
Sep 09 16:44:17.488424 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.488335    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"]
Sep 09 16:44:17.491051 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.488591    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9" podUID="de3585f1-7ccc-44ac-8482-ac153dec97f3" containerName="manager" containerID="cri-o://ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473" gracePeriod=10
Sep 09 16:44:17.745460 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.745393    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:44:17.858405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.858360    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-467l2\" (UniqueName: \"kubernetes.io/projected/de3585f1-7ccc-44ac-8482-ac153dec97f3-kube-api-access-467l2\") pod \"de3585f1-7ccc-44ac-8482-ac153dec97f3\" (UID: \"de3585f1-7ccc-44ac-8482-ac153dec97f3\") "
Sep 09 16:44:17.858582 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.858464    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3585f1-7ccc-44ac-8482-ac153dec97f3-extensions-socket-volume\") pod \"de3585f1-7ccc-44ac-8482-ac153dec97f3\" (UID: \"de3585f1-7ccc-44ac-8482-ac153dec97f3\") "
Sep 09 16:44:17.858869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.858839    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3585f1-7ccc-44ac-8482-ac153dec97f3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "de3585f1-7ccc-44ac-8482-ac153dec97f3" (UID: "de3585f1-7ccc-44ac-8482-ac153dec97f3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:17.860405 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.860385    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3585f1-7ccc-44ac-8482-ac153dec97f3-kube-api-access-467l2" (OuterVolumeSpecName: "kube-api-access-467l2") pod "de3585f1-7ccc-44ac-8482-ac153dec97f3" (UID: "de3585f1-7ccc-44ac-8482-ac153dec97f3"). InnerVolumeSpecName "kube-api-access-467l2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:44:17.870658 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.870628    2567 generic.go:356] "Generic (PLEG): container finished" podID="de3585f1-7ccc-44ac-8482-ac153dec97f3" containerID="ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473" exitCode=0
Sep 09 16:44:17.870787 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.870668    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9" event={"ID":"de3585f1-7ccc-44ac-8482-ac153dec97f3","Type":"ContainerDied","Data":"ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473"}
Sep 09 16:44:17.870787 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.870689    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"
Sep 09 16:44:17.870787 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.870732    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9" event={"ID":"de3585f1-7ccc-44ac-8482-ac153dec97f3","Type":"ContainerDied","Data":"548397a142e0140a34c6d87344d0ad7db275223b0d6fc5d0d5c5e1523820908c"}
Sep 09 16:44:17.870787 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.870754    2567 scope.go:117] "RemoveContainer" containerID="ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473"
Sep 09 16:44:17.881596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.881580    2567 scope.go:117] "RemoveContainer" containerID="ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473"
Sep 09 16:44:17.881920 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:44:17.881899    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473\": container with ID starting with ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473 not found: ID does not exist" containerID="ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473"
Sep 09 16:44:17.881995 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.881927    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473"} err="failed to get container status \"ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473\": rpc error: code = NotFound desc = could not find container \"ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473\": container with ID starting with ec223faf8c24b8368255ce2b74d6bcea86470dde0df360d42975933126316473 not found: ID does not exist"
Sep 09 16:44:17.893301 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.893254    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"]
Sep 09 16:44:17.896533 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.896509    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-hp7n9"]
Sep 09 16:44:17.959295 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.959246    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-467l2\" (UniqueName: \"kubernetes.io/projected/de3585f1-7ccc-44ac-8482-ac153dec97f3-kube-api-access-467l2\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:44:17.959474 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:17.959290    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de3585f1-7ccc-44ac-8482-ac153dec97f3-extensions-socket-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:44:18.737860 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:44:18.737826    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de3585f1-7ccc-44ac-8482-ac153dec97f3" path="/var/lib/kubelet/pods/de3585f1-7ccc-44ac-8482-ac153dec97f3/volumes"
Sep 09 16:45:06.556439 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:06.556400    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:18.241694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.241664    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"]
Sep 09 16:45:18.242123 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.242108    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3585f1-7ccc-44ac-8482-ac153dec97f3" containerName="manager"
Sep 09 16:45:18.242168 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.242124    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3585f1-7ccc-44ac-8482-ac153dec97f3" containerName="manager"
Sep 09 16:45:18.242224 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.242215    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="de3585f1-7ccc-44ac-8482-ac153dec97f3" containerName="manager"
Sep 09 16:45:18.245416 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.245399    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:18.248021 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.247994    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-plhqf\""
Sep 09 16:45:18.260122 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.260100    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"]
Sep 09 16:45:18.332758 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.332726    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e69df6c-439f-435d-8828-2c7ab8fc7b9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-csw86\" (UID: \"3e69df6c-439f-435d-8828-2c7ab8fc7b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:18.332923 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.332797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9db65\" (UniqueName: \"kubernetes.io/projected/3e69df6c-439f-435d-8828-2c7ab8fc7b9f-kube-api-access-9db65\") pod \"kuadrant-operator-controller-manager-5769f99d9f-csw86\" (UID: \"3e69df6c-439f-435d-8828-2c7ab8fc7b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:18.433795 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.433744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9db65\" (UniqueName: \"kubernetes.io/projected/3e69df6c-439f-435d-8828-2c7ab8fc7b9f-kube-api-access-9db65\") pod \"kuadrant-operator-controller-manager-5769f99d9f-csw86\" (UID: \"3e69df6c-439f-435d-8828-2c7ab8fc7b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:18.433955 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.433856    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e69df6c-439f-435d-8828-2c7ab8fc7b9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-csw86\" (UID: \"3e69df6c-439f-435d-8828-2c7ab8fc7b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:18.434171 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.434155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e69df6c-439f-435d-8828-2c7ab8fc7b9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-csw86\" (UID: \"3e69df6c-439f-435d-8828-2c7ab8fc7b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:18.442947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.442923    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9db65\" (UniqueName: \"kubernetes.io/projected/3e69df6c-439f-435d-8828-2c7ab8fc7b9f-kube-api-access-9db65\") pod \"kuadrant-operator-controller-manager-5769f99d9f-csw86\" (UID: \"3e69df6c-439f-435d-8828-2c7ab8fc7b9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:18.556621 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.556533    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:18.837874 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:18.837832    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"]
Sep 09 16:45:18.838281 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:45:18.838253    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e69df6c_439f_435d_8828_2c7ab8fc7b9f.slice/crio-71906fe04a1b41701623769d251ee8684d3239d25d06cd5227794c8b2e3d77d2 WatchSource:0}: Error finding container 71906fe04a1b41701623769d251ee8684d3239d25d06cd5227794c8b2e3d77d2: Status 404 returned error can't find the container with id 71906fe04a1b41701623769d251ee8684d3239d25d06cd5227794c8b2e3d77d2
Sep 09 16:45:19.261253 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:19.261220    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86" event={"ID":"3e69df6c-439f-435d-8828-2c7ab8fc7b9f","Type":"ContainerStarted","Data":"3d6841044ee5ad79ce53111c93c3ed8f01a5f0bbeca2928fbe01e25528872822"}
Sep 09 16:45:19.261612 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:19.261270    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86" event={"ID":"3e69df6c-439f-435d-8828-2c7ab8fc7b9f","Type":"ContainerStarted","Data":"71906fe04a1b41701623769d251ee8684d3239d25d06cd5227794c8b2e3d77d2"}
Sep 09 16:45:19.261612 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:19.261294    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:19.285254 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:19.285207    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86" podStartSLOduration=1.285191338 podStartE2EDuration="1.285191338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:45:19.282082386 +0000 UTC m=+2217.053173631" watchObservedRunningTime="2026-09-09 16:45:19.285191338 +0000 UTC m=+2217.056282584"
Sep 09 16:45:30.269526 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:30.269486    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-csw86"
Sep 09 16:45:53.450299 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:53.450258    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:57.437596 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:45:57.437558    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:04.467821 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:04.467752    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:09.399584 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:09.399542    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:26.526709 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:26.526668    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:28.538058 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:28.538018    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:44.850166 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:44.850128    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"]
Sep 09 16:46:44.854611 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:44.854580    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:44.869586 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:44.869553    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"]
Sep 09 16:46:44.980100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:44.980062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6b365a8-e390-4405-a20f-41c700ade1e9-metrics-certs\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:44.980100 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:44.980102    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6b365a8-e390-4405-a20f-41c700ade1e9-maas-api-tls\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:44.980304 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:44.980187    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6b365a8-e390-4405-a20f-41c700ade1e9-openshift-service-ca\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:44.980304 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:44.980250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp97k\" (UniqueName: \"kubernetes.io/projected/a6b365a8-e390-4405-a20f-41c700ade1e9-kube-api-access-xp97k\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.080782 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.080748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6b365a8-e390-4405-a20f-41c700ade1e9-metrics-certs\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.080947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.080795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6b365a8-e390-4405-a20f-41c700ade1e9-maas-api-tls\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.080947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.080835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6b365a8-e390-4405-a20f-41c700ade1e9-openshift-service-ca\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.080947 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.080876    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp97k\" (UniqueName: \"kubernetes.io/projected/a6b365a8-e390-4405-a20f-41c700ade1e9-kube-api-access-xp97k\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.081567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.081538    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6b365a8-e390-4405-a20f-41c700ade1e9-openshift-service-ca\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.083183 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.083151    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6b365a8-e390-4405-a20f-41c700ade1e9-maas-api-tls\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.083321 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.083272    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6b365a8-e390-4405-a20f-41c700ade1e9-metrics-certs\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.088189 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.088166    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp97k\" (UniqueName: \"kubernetes.io/projected/a6b365a8-e390-4405-a20f-41c700ade1e9-kube-api-access-xp97k\") pod \"maas-api-6cfd8fccdf-r58wb\" (UID: \"a6b365a8-e390-4405-a20f-41c700ade1e9\") " pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.168416 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.168380    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:45.443864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.443832    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"]
Sep 09 16:46:45.445678 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:46:45.445639    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b365a8_e390_4405_a20f_41c700ade1e9.slice/crio-2dfd7c1b88fa566856cbc360ad82152955ff55a0703e5f3256517d3d0328f521 WatchSource:0}: Error finding container 2dfd7c1b88fa566856cbc360ad82152955ff55a0703e5f3256517d3d0328f521: Status 404 returned error can't find the container with id 2dfd7c1b88fa566856cbc360ad82152955ff55a0703e5f3256517d3d0328f521
Sep 09 16:46:45.811589 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:45.811500    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb" event={"ID":"a6b365a8-e390-4405-a20f-41c700ade1e9","Type":"ContainerStarted","Data":"2dfd7c1b88fa566856cbc360ad82152955ff55a0703e5f3256517d3d0328f521"}
Sep 09 16:46:48.502438 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:48.502399    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:48.602335 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:48.602307    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:48.831892 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:48.831805    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb" event={"ID":"a6b365a8-e390-4405-a20f-41c700ade1e9","Type":"ContainerStarted","Data":"a060136a0178131c2811b0c591d548bfd9a41e667c3cd131c38440dce2ac6a31"}
Sep 09 16:46:48.832029 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:48.831930    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:48.851825 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:48.851759    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb" podStartSLOduration=1.701479833 podStartE2EDuration="4.851746025s" totalImagesPullingTime="3.150266192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:46:48.849920419 +0000 UTC m=+2306.621011665" watchObservedRunningTime="2026-09-09 16:46:48.851746025 +0000 UTC m=+2306.622837308"
Sep 09 16:46:54.844898 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:54.844864    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6cfd8fccdf-r58wb"
Sep 09 16:46:54.894653 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:54.894624    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"]
Sep 09 16:46:54.894869 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:54.894838    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx" podUID="e58aae1b-90e9-4bf0-88c2-beb936e3e723" containerName="maas-api" containerID="cri-o://93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa" gracePeriod=30
Sep 09 16:46:56.150080 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.150048    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:46:56.286218 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.286142    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbdhb\" (UniqueName: \"kubernetes.io/projected/e58aae1b-90e9-4bf0-88c2-beb936e3e723-kube-api-access-hbdhb\") pod \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") "
Sep 09 16:46:56.286218 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.286177    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e58aae1b-90e9-4bf0-88c2-beb936e3e723-openshift-service-ca\") pod \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") "
Sep 09 16:46:56.286395 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.286302    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-maas-api-tls\") pod \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") "
Sep 09 16:46:56.286434 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.286419    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-metrics-certs\") pod \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\" (UID: \"e58aae1b-90e9-4bf0-88c2-beb936e3e723\") "
Sep 09 16:46:56.286571 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.286543    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e58aae1b-90e9-4bf0-88c2-beb936e3e723-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e58aae1b-90e9-4bf0-88c2-beb936e3e723" (UID: "e58aae1b-90e9-4bf0-88c2-beb936e3e723"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:46:56.286856 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.286837    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e58aae1b-90e9-4bf0-88c2-beb936e3e723-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:46:56.288287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.288265    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e58aae1b-90e9-4bf0-88c2-beb936e3e723" (UID: "e58aae1b-90e9-4bf0-88c2-beb936e3e723"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:46:56.288368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.288286    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e58aae1b-90e9-4bf0-88c2-beb936e3e723" (UID: "e58aae1b-90e9-4bf0-88c2-beb936e3e723"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:46:56.288368 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.288341    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e58aae1b-90e9-4bf0-88c2-beb936e3e723-kube-api-access-hbdhb" (OuterVolumeSpecName: "kube-api-access-hbdhb") pod "e58aae1b-90e9-4bf0-88c2-beb936e3e723" (UID: "e58aae1b-90e9-4bf0-88c2-beb936e3e723"). InnerVolumeSpecName "kube-api-access-hbdhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:46:56.387490 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.387457    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:46:56.387490 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.387485    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbdhb\" (UniqueName: \"kubernetes.io/projected/e58aae1b-90e9-4bf0-88c2-beb936e3e723-kube-api-access-hbdhb\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:46:56.387656 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.387499    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e58aae1b-90e9-4bf0-88c2-beb936e3e723-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 16:46:56.884407 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.884373    2567 generic.go:356] "Generic (PLEG): container finished" podID="e58aae1b-90e9-4bf0-88c2-beb936e3e723" containerID="93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa" exitCode=0
Sep 09 16:46:56.884590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.884425    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"
Sep 09 16:46:56.884590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.884433    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx" event={"ID":"e58aae1b-90e9-4bf0-88c2-beb936e3e723","Type":"ContainerDied","Data":"93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa"}
Sep 09 16:46:56.884590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.884475    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx" event={"ID":"e58aae1b-90e9-4bf0-88c2-beb936e3e723","Type":"ContainerDied","Data":"037126b5bab991d33eb759675d0c4aa617c350f2625b87ee10e48d653cf13514"}
Sep 09 16:46:56.884590 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.884496    2567 scope.go:117] "RemoveContainer" containerID="93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa"
Sep 09 16:46:56.894287 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.894268    2567 scope.go:117] "RemoveContainer" containerID="93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa"
Sep 09 16:46:56.894543 ip-10-0-137-148 kubenswrapper[2567]: E0909 16:46:56.894523    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa\": container with ID starting with 93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa not found: ID does not exist" containerID="93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa"
Sep 09 16:46:56.894610 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.894553    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa"} err="failed to get container status \"93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa\": rpc error: code = NotFound desc = could not find container \"93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa\": container with ID starting with 93626007b684364a803039796cb06be9b851cf265d0d8b22b8d4ca63bf8347aa not found: ID does not exist"
Sep 09 16:46:56.906507 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.906484    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"]
Sep 09 16:46:56.909065 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:56.909046    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7b9ff5c-69dgx"]
Sep 09 16:46:58.738385 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:46:58.738352    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e58aae1b-90e9-4bf0-88c2-beb936e3e723" path="/var/lib/kubelet/pods/e58aae1b-90e9-4bf0-88c2-beb936e3e723/volumes"
Sep 09 16:47:20.657882 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:20.657848    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wv9ck_f94d706f-84ae-479d-a33f-2b74f580b953/manager/0.log"
Sep 09 16:47:20.785879 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:20.785848    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kfqtq_23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca/manager/0.log"
Sep 09 16:47:20.919726 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:20.919641    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-574cc95cb9-nvx6m_17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb/manager/0.log"
Sep 09 16:47:21.322864 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:21.322767    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67c7bcf47f-cm9dh_8a459374-9835-4b99-963e-0e698680e7b1/copy-manifests/0.log"
Sep 09 16:47:21.330705 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:21.330676    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67c7bcf47f-cm9dh_8a459374-9835-4b99-963e-0e698680e7b1/manager/0.log"
Sep 09 16:47:22.083335 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:22.083307    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6cfd8fccdf-r58wb_a6b365a8-e390-4405-a20f-41c700ade1e9/maas-api/0.log"
Sep 09 16:47:22.466004 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:22.465966    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kcvwg_a2e27758-fa57-4523-bf01-b09a9f08e700/postgres/0.log"
Sep 09 16:47:23.445299 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:23.445263    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bc8vj_2775f5b0-477d-467a-8c7f-6966bb1c53b7/manager/0.log"
Sep 09 16:47:23.568848 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:23.568754    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-kxbm6_7011f5e6-1ebb-4bd5-b5d6-52640a7de0af/manager/0.log"
Sep 09 16:47:23.824694 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:23.824612    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-csw86_3e69df6c-439f-435d-8828-2c7ab8fc7b9f/manager/0.log"
Sep 09 16:47:24.076299 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:24.076213    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jvjqz_4745fc4f-3986-40ae-a34a-80c0d8d26034/manager/0.log"
Sep 09 16:47:24.841190 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:24.841155    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54fc5d6dc5-bcpm7_5bf761a4-0c32-4d5c-bc11-a81fc826ab75/kube-auth-proxy/0.log"
Sep 09 16:47:24.972278 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:24.972248    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wlrgd_b65f6b94-6fb5-4e6c-963b-8aea377ea05e/istio-proxy/1.log"
Sep 09 16:47:25.704206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:25.704155    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-t9nz5_3954cc43-5910-45bb-baa3-9b15d7889b31/main/0.log"
Sep 09 16:47:25.932518 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:25.932491    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-b4z5b_51a78f96-187b-4094-b06f-55cd38dd0b55/main/0.log"
Sep 09 16:47:31.920567 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.920516    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jjpd4/must-gather-474xm"]
Sep 09 16:47:31.921134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.921115    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e58aae1b-90e9-4bf0-88c2-beb936e3e723" containerName="maas-api"
Sep 09 16:47:31.921134 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.921135    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e58aae1b-90e9-4bf0-88c2-beb936e3e723" containerName="maas-api"
Sep 09 16:47:31.921233 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.921223    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e58aae1b-90e9-4bf0-88c2-beb936e3e723" containerName="maas-api"
Sep 09 16:47:31.924511 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.924494    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjpd4/must-gather-474xm"
Sep 09 16:47:31.927153 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.927134    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjpd4\"/\"openshift-service-ca.crt\""
Sep 09 16:47:31.927437 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.927419    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjpd4\"/\"kube-root-ca.crt\""
Sep 09 16:47:31.928361 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.928323    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jjpd4\"/\"default-dockercfg-glm2f\""
Sep 09 16:47:31.935215 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.935195    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjpd4/must-gather-474xm"]
Sep 09 16:47:31.939434 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:31.939410    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:32.026083 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.026044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6mf\" (UniqueName: \"kubernetes.io/projected/986b0336-3168-447a-8cc6-d7148fc6791e-kube-api-access-sh6mf\") pod \"must-gather-474xm\" (UID: \"986b0336-3168-447a-8cc6-d7148fc6791e\") " pod="openshift-must-gather-jjpd4/must-gather-474xm"
Sep 09 16:47:32.026234 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.026116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/986b0336-3168-447a-8cc6-d7148fc6791e-must-gather-output\") pod \"must-gather-474xm\" (UID: \"986b0336-3168-447a-8cc6-d7148fc6791e\") " pod="openshift-must-gather-jjpd4/must-gather-474xm"
Sep 09 16:47:32.039481 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.039456    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:32.127678 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.127631    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6mf\" (UniqueName: \"kubernetes.io/projected/986b0336-3168-447a-8cc6-d7148fc6791e-kube-api-access-sh6mf\") pod \"must-gather-474xm\" (UID: \"986b0336-3168-447a-8cc6-d7148fc6791e\") " pod="openshift-must-gather-jjpd4/must-gather-474xm"
Sep 09 16:47:32.127912 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.127719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/986b0336-3168-447a-8cc6-d7148fc6791e-must-gather-output\") pod \"must-gather-474xm\" (UID: \"986b0336-3168-447a-8cc6-d7148fc6791e\") " pod="openshift-must-gather-jjpd4/must-gather-474xm"
Sep 09 16:47:32.128081 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.128060    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/986b0336-3168-447a-8cc6-d7148fc6791e-must-gather-output\") pod \"must-gather-474xm\" (UID: \"986b0336-3168-447a-8cc6-d7148fc6791e\") " pod="openshift-must-gather-jjpd4/must-gather-474xm"
Sep 09 16:47:32.139081 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.139049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6mf\" (UniqueName: \"kubernetes.io/projected/986b0336-3168-447a-8cc6-d7148fc6791e-kube-api-access-sh6mf\") pod \"must-gather-474xm\" (UID: \"986b0336-3168-447a-8cc6-d7148fc6791e\") " pod="openshift-must-gather-jjpd4/must-gather-474xm"
Sep 09 16:47:32.235318 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.235240    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjpd4/must-gather-474xm"
Sep 09 16:47:32.508915 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:32.508886    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjpd4/must-gather-474xm"]
Sep 09 16:47:32.510241 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:47:32.510199    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod986b0336_3168_447a_8cc6_d7148fc6791e.slice/crio-b40d71a5b790a2889e2f69e1fe4d87360c3c9a68b9433e2d15ed1cc2d2691c90 WatchSource:0}: Error finding container b40d71a5b790a2889e2f69e1fe4d87360c3c9a68b9433e2d15ed1cc2d2691c90: Status 404 returned error can't find the container with id b40d71a5b790a2889e2f69e1fe4d87360c3c9a68b9433e2d15ed1cc2d2691c90
Sep 09 16:47:33.111734 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:33.111697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjpd4/must-gather-474xm" event={"ID":"986b0336-3168-447a-8cc6-d7148fc6791e","Type":"ContainerStarted","Data":"b40d71a5b790a2889e2f69e1fe4d87360c3c9a68b9433e2d15ed1cc2d2691c90"}
Sep 09 16:47:36.132427 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:36.132395    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjpd4/must-gather-474xm" event={"ID":"986b0336-3168-447a-8cc6-d7148fc6791e","Type":"ContainerStarted","Data":"90896166232f0e9107dfc3304676710c6330653911c9ec81500d38af47d8aa1d"}
Sep 09 16:47:37.145195 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:37.145151    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjpd4/must-gather-474xm" event={"ID":"986b0336-3168-447a-8cc6-d7148fc6791e","Type":"ContainerStarted","Data":"c6c5b3f8ad2f645aab75a19f638d88607f0be63eaa751a14b35aff1ea20d0cb3"}
Sep 09 16:47:37.170445 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:37.170383    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jjpd4/must-gather-474xm" podStartSLOduration=2.667779775 podStartE2EDuration="6.170360928s" totalImagesPullingTime="3.502581153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:47:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:47:37.168713148 +0000 UTC m=+2354.939804394" watchObservedRunningTime="2026-09-09 16:47:37.170360928 +0000 UTC m=+2354.941452176"
Sep 09 16:47:37.627695 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:37.627666    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vqsxq_19e81986-d11f-4538-8975-961f0a59681f/global-pull-secret-syncer/0.log"
Sep 09 16:47:37.723719 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:37.723687    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-42v8l_fcf4a3e9-eec4-49f1-82df-6590d505ae68/konnectivity-agent/0.log"
Sep 09 16:47:37.859844 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:37.859812    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-148.ec2.internal_07650a7db62586f9e69be13fe56d6e10/haproxy/0.log"
Sep 09 16:47:41.764794 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:41.764749    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bc8vj_2775f5b0-477d-467a-8c7f-6966bb1c53b7/manager/0.log"
Sep 09 16:47:41.815791 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:41.815748    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-kxbm6_7011f5e6-1ebb-4bd5-b5d6-52640a7de0af/manager/0.log"
Sep 09 16:47:41.888880 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:41.888633    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-csw86_3e69df6c-439f-435d-8828-2c7ab8fc7b9f/manager/0.log"
Sep 09 16:47:42.006485 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:42.006454    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jvjqz_4745fc4f-3986-40ae-a34a-80c0d8d26034/manager/0.log"
Sep 09 16:47:43.709317 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.709285    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a92e59e-bcec-4a06-87e9-80dcf5d003e6/alertmanager/0.log"
Sep 09 16:47:43.739407 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.739377    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a92e59e-bcec-4a06-87e9-80dcf5d003e6/config-reloader/0.log"
Sep 09 16:47:43.763977 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.763949    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a92e59e-bcec-4a06-87e9-80dcf5d003e6/kube-rbac-proxy-web/0.log"
Sep 09 16:47:43.793949 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.793912    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a92e59e-bcec-4a06-87e9-80dcf5d003e6/kube-rbac-proxy/0.log"
Sep 09 16:47:43.821902 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.821866    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a92e59e-bcec-4a06-87e9-80dcf5d003e6/kube-rbac-proxy-metric/0.log"
Sep 09 16:47:43.842307 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.842272    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a92e59e-bcec-4a06-87e9-80dcf5d003e6/prom-label-proxy/0.log"
Sep 09 16:47:43.863721 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.863663    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a92e59e-bcec-4a06-87e9-80dcf5d003e6/init-config-reloader/0.log"
Sep 09 16:47:43.903352 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.903322    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-shxqk_e70db848-4b03-483a-b7a5-5bb1ca178da3/cluster-monitoring-operator/0.log"
Sep 09 16:47:43.929723 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.929693    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-f7mw5_3a16b8c7-e17b-4877-ae7a-b49e90ce59f6/kube-state-metrics/0.log"
Sep 09 16:47:43.958641 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.958599    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-f7mw5_3a16b8c7-e17b-4877-ae7a-b49e90ce59f6/kube-rbac-proxy-main/0.log"
Sep 09 16:47:43.981692 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:43.981571    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-f7mw5_3a16b8c7-e17b-4877-ae7a-b49e90ce59f6/kube-rbac-proxy-self/0.log"
Sep 09 16:47:44.057816 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.057785    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-vclc2_b531072a-e697-4c09-b2d8-ecebb0a94ed0/monitoring-plugin/0.log"
Sep 09 16:47:44.162279 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.161996    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dl67l_03e6d0cb-8051-4bdb-a223-aff107b4a725/node-exporter/0.log"
Sep 09 16:47:44.184207 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.184157    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dl67l_03e6d0cb-8051-4bdb-a223-aff107b4a725/kube-rbac-proxy/0.log"
Sep 09 16:47:44.209088 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.209059    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dl67l_03e6d0cb-8051-4bdb-a223-aff107b4a725/init-textfile/0.log"
Sep 09 16:47:44.774374 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.774336    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d56958bb7-kkmsg_f5815a7b-5e85-4d28-9231-f1f3c294f9e5/telemeter-client/0.log"
Sep 09 16:47:44.800308 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.800272    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d56958bb7-kkmsg_f5815a7b-5e85-4d28-9231-f1f3c294f9e5/reload/0.log"
Sep 09 16:47:44.829206 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.829175    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d56958bb7-kkmsg_f5815a7b-5e85-4d28-9231-f1f3c294f9e5/kube-rbac-proxy/0.log"
Sep 09 16:47:44.862740 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.862703    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6b5dc6b4-69b88_576ef001-48b9-464d-b166-07515afe75e9/thanos-query/0.log"
Sep 09 16:47:44.892057 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.892009    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6b5dc6b4-69b88_576ef001-48b9-464d-b166-07515afe75e9/kube-rbac-proxy-web/0.log"
Sep 09 16:47:44.918286 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.918252    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6b5dc6b4-69b88_576ef001-48b9-464d-b166-07515afe75e9/kube-rbac-proxy/0.log"
Sep 09 16:47:44.951588 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.951556    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6b5dc6b4-69b88_576ef001-48b9-464d-b166-07515afe75e9/prom-label-proxy/0.log"
Sep 09 16:47:44.990237 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:44.990205    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6b5dc6b4-69b88_576ef001-48b9-464d-b166-07515afe75e9/kube-rbac-proxy-rules/0.log"
Sep 09 16:47:45.018295 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:45.018254    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b6b5dc6b4-69b88_576ef001-48b9-464d-b166-07515afe75e9/kube-rbac-proxy-metrics/0.log"
Sep 09 16:47:46.615583 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:46.615481    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-c2s7d_2dc19098-673b-4f8e-907c-222c0fa46c18/networking-console-plugin/0.log"
Sep 09 16:47:47.785202 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:47.785168    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-695754c747-ngvf4_65e017ec-72c6-4bf8-9b8f-40b6493f92d9/console/0.log"
Sep 09 16:47:47.839609 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:47.839177    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-9fjxs_be4a802c-6f54-465f-af20-9ce7b4f52fa5/download-server/0.log"
Sep 09 16:47:48.209540 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.209508    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"]
Sep 09 16:47:48.217180 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.217150    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.221143 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.221111    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"]
Sep 09 16:47:48.312092 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.312044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktmbk\" (UniqueName: \"kubernetes.io/projected/2eebd6c7-998a-4949-b0b9-afd12df5e66f-kube-api-access-ktmbk\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.312288 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.312116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-sys\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.312288 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.312249    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-lib-modules\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.312419 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.312305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-proc\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.312419 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.312365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-podres\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413208 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-proc\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413397 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-podres\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413397 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413292    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktmbk\" (UniqueName: \"kubernetes.io/projected/2eebd6c7-998a-4949-b0b9-afd12df5e66f-kube-api-access-ktmbk\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413397 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-proc\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413397 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-sys\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413397 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-sys\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413696 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-lib-modules\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413696 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413492    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-podres\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.413696 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.413578    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eebd6c7-998a-4949-b0b9-afd12df5e66f-lib-modules\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.423140 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.423054    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktmbk\" (UniqueName: \"kubernetes.io/projected/2eebd6c7-998a-4949-b0b9-afd12df5e66f-kube-api-access-ktmbk\") pod \"perf-node-gather-daemonset-gh9pt\" (UID: \"2eebd6c7-998a-4949-b0b9-afd12df5e66f\") " pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.542181 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.541765    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:48.567704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.567674    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-lf7sm_ba9b17f8-21cf-4855-a0b8-5159396b0900/volume-data-source-validator/0.log"
Sep 09 16:47:48.837593 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:48.837558    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"]
Sep 09 16:47:48.838523 ip-10-0-137-148 kubenswrapper[2567]: W0909 16:47:48.838493    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2eebd6c7_998a_4949_b0b9_afd12df5e66f.slice/crio-77bf1bf9597326e12c829105b319d9a28822e318c5ca8ad84d2940352670b76b WatchSource:0}: Error finding container 77bf1bf9597326e12c829105b319d9a28822e318c5ca8ad84d2940352670b76b: Status 404 returned error can't find the container with id 77bf1bf9597326e12c829105b319d9a28822e318c5ca8ad84d2940352670b76b
Sep 09 16:47:49.262031 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:49.261990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt" event={"ID":"2eebd6c7-998a-4949-b0b9-afd12df5e66f","Type":"ContainerStarted","Data":"ddbfd8ef36b288aa3575d5a086d293614e18641820bb16c3a413e685e91e07fd"}
Sep 09 16:47:49.262256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:49.262137    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt" event={"ID":"2eebd6c7-998a-4949-b0b9-afd12df5e66f","Type":"ContainerStarted","Data":"77bf1bf9597326e12c829105b319d9a28822e318c5ca8ad84d2940352670b76b"}
Sep 09 16:47:49.262256 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:49.262171    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:49.281205 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:49.281140    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt" podStartSLOduration=1.28110958 podStartE2EDuration="1.28110958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:47:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:47:49.278936355 +0000 UTC m=+2367.050027600" watchObservedRunningTime="2026-09-09 16:47:49.28110958 +0000 UTC m=+2367.052200827"
Sep 09 16:47:49.835210 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:49.835173    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmlbz_ad3d00b2-26db-4cd6-ab74-9a284e6552a6/dns/0.log"
Sep 09 16:47:49.864462 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:49.864433    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmlbz_ad3d00b2-26db-4cd6-ab74-9a284e6552a6/kube-rbac-proxy/0.log"
Sep 09 16:47:49.988467 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:49.988438    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mc4sp_57d8707f-7f36-4b05-b159-83a6d3bf2987/dns-node-resolver/0.log"
Sep 09 16:47:50.584284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:50.584256    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvjw4_d299899c-8552-439f-a03d-0d643d9a3268/node-ca/0.log"
Sep 09 16:47:51.992628 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:51.992598    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54fc5d6dc5-bcpm7_5bf761a4-0c32-4d5c-bc11-a81fc826ab75/kube-auth-proxy/0.log"
Sep 09 16:47:52.022876 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:52.022843    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wlrgd_b65f6b94-6fb5-4e6c-963b-8aea377ea05e/istio-proxy/0.log"
Sep 09 16:47:52.041838 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:52.041804    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wlrgd_b65f6b94-6fb5-4e6c-963b-8aea377ea05e/istio-proxy/1.log"
Sep 09 16:47:52.999075 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:52.999027    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gz8f_da78760a-b579-4a43-83cf-0a0f0a7bd11c/serve-healthcheck-canary/0.log"
Sep 09 16:47:53.532904 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:53.532865    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-w6mxn_78278da3-be7a-4082-8193-47bf1351254d/insights-operator/0.log"
Sep 09 16:47:53.533244 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:53.533227    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-w6mxn_78278da3-be7a-4082-8193-47bf1351254d/insights-operator/1.log"
Sep 09 16:47:53.557556 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:53.557516    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k59c2_67a83495-fd18-446f-aa7b-cafcfba2d846/kube-rbac-proxy/0.log"
Sep 09 16:47:53.577346 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:53.577310    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k59c2_67a83495-fd18-446f-aa7b-cafcfba2d846/exporter/0.log"
Sep 09 16:47:53.600889 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:53.600851    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k59c2_67a83495-fd18-446f-aa7b-cafcfba2d846/extractor/0.log"
Sep 09 16:47:55.282448 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:55.282418    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jjpd4/perf-node-gather-daemonset-gh9pt"
Sep 09 16:47:55.872126 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:55.872086    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wv9ck_f94d706f-84ae-479d-a33f-2b74f580b953/manager/0.log"
Sep 09 16:47:56.197823 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:56.197757    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kfqtq_23eba5d0-bc47-4de9-9a9c-85b2c6ce8aca/manager/0.log"
Sep 09 16:47:56.258542 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:56.258490    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-574cc95cb9-nvx6m_17d2c65f-6cdc-4e48-ad13-3b6e3869a3cb/manager/0.log"
Sep 09 16:47:56.431293 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:56.431059    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67c7bcf47f-cm9dh_8a459374-9835-4b99-963e-0e698680e7b1/manager/0.log"
Sep 09 16:47:56.454573 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:56.454500    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67c7bcf47f-cm9dh_8a459374-9835-4b99-963e-0e698680e7b1/copy-manifests/0.log"
Sep 09 16:47:58.090683 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:58.090645    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dnm2k_cbdbfa4c-2f0b-4210-a043-bde75f00acf3/openshift-lws-operator/0.log"
Sep 09 16:47:58.869972 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:58.869938    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54fc5d6dc5-bcpm7_5bf761a4-0c32-4d5c-bc11-a81fc826ab75/kube-auth-proxy/0.log"
Sep 09 16:47:58.891214 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:58.891183    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wlrgd_b65f6b94-6fb5-4e6c-963b-8aea377ea05e/istio-proxy/0.log"
Sep 09 16:47:58.907935 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:47:58.907907    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wlrgd_b65f6b94-6fb5-4e6c-963b-8aea377ea05e/istio-proxy/1.log"
Sep 09 16:48:00.910685 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:00.910651    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54fc5d6dc5-bcpm7_5bf761a4-0c32-4d5c-bc11-a81fc826ab75/kube-auth-proxy/0.log"
Sep 09 16:48:00.933737 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:00.933701    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wlrgd_b65f6b94-6fb5-4e6c-963b-8aea377ea05e/istio-proxy/0.log"
Sep 09 16:48:00.948884 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:00.948845    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wlrgd_b65f6b94-6fb5-4e6c-963b-8aea377ea05e/istio-proxy/1.log"
Sep 09 16:48:03.278284 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:03.278248    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-27cl2_03592906-9343-483f-9448-a8caaa7b59ea/migrator/0.log"
Sep 09 16:48:03.298373 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:03.298349    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-27cl2_03592906-9343-483f-9448-a8caaa7b59ea/graceful-termination/0.log"
Sep 09 16:48:03.673428 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:03.673392    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-xlrkw_1e74fbbd-d60f-49f4-a7a9-842799743d6a/kube-storage-version-migrator-operator/1.log"
Sep 09 16:48:03.675267 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:03.675226    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-xlrkw_1e74fbbd-d60f-49f4-a7a9-842799743d6a/kube-storage-version-migrator-operator/0.log"
Sep 09 16:48:04.992216 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:04.992188    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgs8j_f100dd61-6da6-4a68-9a9c-ca5402787eb5/kube-multus-additional-cni-plugins/0.log"
Sep 09 16:48:05.015704 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.015680    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgs8j_f100dd61-6da6-4a68-9a9c-ca5402787eb5/egress-router-binary-copy/0.log"
Sep 09 16:48:05.036037 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.036011    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgs8j_f100dd61-6da6-4a68-9a9c-ca5402787eb5/cni-plugins/0.log"
Sep 09 16:48:05.055645 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.055621    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgs8j_f100dd61-6da6-4a68-9a9c-ca5402787eb5/bond-cni-plugin/0.log"
Sep 09 16:48:05.078239 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.078216    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgs8j_f100dd61-6da6-4a68-9a9c-ca5402787eb5/routeoverride-cni/0.log"
Sep 09 16:48:05.098341 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.098303    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgs8j_f100dd61-6da6-4a68-9a9c-ca5402787eb5/whereabouts-cni-bincopy/0.log"
Sep 09 16:48:05.117575 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.117551    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgs8j_f100dd61-6da6-4a68-9a9c-ca5402787eb5/whereabouts-cni/0.log"
Sep 09 16:48:05.270996 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.270925    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wmvg7_f84998c4-126c-43fe-9312-5e9b21762fb1/kube-multus/0.log"
Sep 09 16:48:05.298402 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.298374    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4w9ps_1d4dc8b5-2a2a-4d02-9553-13e9b24c7468/network-metrics-daemon/0.log"
Sep 09 16:48:05.315240 ip-10-0-137-148 kubenswrapper[2567]: I0909 16:48:05.315214    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4w9ps_1d4dc8b5-2a2a-4d02-9553-13e9b24c7468/kube-rbac-proxy/0.log"